Corey - Glow fish were developed from zebra danios, which are pretty active and not very shy. I would imagine that they may dart in and out of your cave, once discovered. But I can't imagine them hanging out in a cave for very long. It would usually be a shy type of fish that would prefer to do that.
I agree with James on the gravel issue, filtration and water changes will help there.