This is because the Earth rotates on its axis once every 24 hours, but it also orbits the Sun, completing a full orbit in 365 days. This means that the Earth needs to rotate slightly more than a full turn to bring the same star back to the same position in the sky.

This difference in rotation is about 4 minutes, resulting in the stars rising about 4 minutes later each day.