Quickfix: Install pavucontrol. You can control on a per application basis which output to send audio to and move the stream on the fly.

It doesn't "Just work" in windows. Windows will set a default and send all audio to that device without any controls for moving audio from one output to another. I have to restart my browser if I want to move from watching netflix on my monitor to my TV.