Actually the elements popping out upwards is a pretty good approach as well!

Now, it might be a bit problematic when the windows are aligned with the top of the screen (in which case either the window would need to be moved or the title elements would just overlap the contents and be expanded downwards, much like tooltips would).

But yes, that's definitely one way to go about it!