Limestone is a sedimentary rock composed primarily of calcium carbonate (CaCO3). Its solubility in slightly acidic water makes it susceptible to erosion and dissolution, creating the vast cave systems we see.
While other types of sedimentary rocks can also form caves (like sandstone), limestone's widespread presence in the eastern US, combined with its unique chemical properties, make it the most common rock type associated with caves in the region.