Here's a simple way to think about it:
* Imagine a rope tied to a wall.
* You shake the rope up and down.
* The wave travels horizontally along the rope, but the rope itself moves up and down.
So, the wave moves horizontally, but the medium (the rope) vibrates vertically.