Caves are huge holes under the ground, in cliffs or under the sea. Caves can be formed in many ways. Most rock caves, especially limestone caves, are formed by rainwater that seeps into tiny cracks in the rocks. The rainwater contains minerals and chemicals that slowly causes the rock to dissolve, leaving behind a large hole. This process may take several thousand, or even a few million years.