The only planet that orbits the sun lying on its side is Uranus.

Its axis of rotation is tilted at a whopping 98 degrees, meaning it essentially spins on its side, unlike the other planets in our solar system which rotate more upright.