That's a bit backwards! A stalagmite grows up from the floor of a cave, while a stalactite hangs down from the ceiling.

Think of it this way:

* Stalagmite - M for Mountain, growing up from the ground

* Stalactite - C for Ceiling, hanging down