Here's why:
* The Earth's crust is a mosaic of rock types: The crust is composed of various igneous, sedimentary, and metamorphic rocks. Granite is common in continental crust, but it's not ubiquitous.
* Depth matters: As you descend into the Earth, the composition changes. The upper crust (where granite is more prevalent) gives way to the lower crust, which is generally more mafic (rich in magnesium and iron) and contains rocks like gabbro and basalt.
In other words, you don't need to dig down miles and miles to find rock that isn't granite. You'd likely encounter other rock types relatively close to the surface, especially in areas where the geology is diverse.
It's important to remember that the Earth's composition varies significantly from place to place, so there isn't a single, universal answer to this question.