The Mt. Gagazet Caves are a separate section of Mt. Gagazet. The caves have their own set of fiends and they include the Submerged Areas of the game which also has its own set of fiends.
The team will pass through this area after traveling through Mt. Gagazet and just before reaching the Zanarkand Ruins. Check out the walkthrough and strategy guide section for additional details: