This is because the sun is highest in the sky at noon, and the angle of the sun's rays is most direct, resulting in the shortest shadow.
The longest shadows are cast during sunrise and sunset when the sun is low in the sky.