If you want a Portrait (vertical) display you must do two things.
First, get a display that you can rotate physically. That is, turn it so it is longer vertically. Depending on the display (and not your Mac's native display) this could present stability issues. Second, follow the directions in this
support article. It is quite simple once you overcome the physical component.
The article does note that all Systems may not support rotation.
