The most common naturally magnetic stone found in caves is magnetite. It's a naturally occurring iron oxide mineral that is strongly attracted to magnets.

While other magnetic minerals exist, magnetite is the most readily available and abundant, making it likely to be found in caves.