While diamond is made of carbon, which is a non-metal, it's incredibly hard due to its unique crystal structure. The strong covalent bonds between the carbon atoms in a diamond lattice create an incredibly strong material.
It's worth noting that diamond is considered the hardest naturally occurring substance on Earth. However, some synthetic materials, like lonsdaleite, have been shown to be even harder than diamond in laboratory settings.