No, the Sun is not the only star in the Milky Way galaxy.
The Milky Way is home to billions of stars, with estimates ranging from 100 billion to 400 billion. Our Sun is just one of these stars, and it's actually a pretty average one in terms of size and brightness.