It's best to have it horizontal.

Discs scratch easily when it is vertical.