Damn, wish those dedicated servers were available in Hetzner's US data center. As far as I'm aware, the closest thing to a competitor in the US is OVH, and the server you get for that price is about a quarter of the capacity. That's plenty for my little company, but still...
In our case, we're running on top of a PaaS (think Heroku). Vertical vs Horizontal scaling is essentially the same complexity for the scale we're currently at.
Massive servers are laughably cheap these days. E.g. 16 cores, 128GB RAM is €112 from Hetzner.