There are at least three different ways switching a transistor consumes energy, the power for charging the gate is only one of them and tends to not be the limiting factor in small power bricks. The other two are current spikes in the channel during the switch in logic circuits (because you normally cannot let the output float, which means that during the switch you have to switch on both transistors at the same time, but that's not a problem when driving some inductor/transformer), and energy loss due to voltage drop while the transistor is moving between on and off states (that's where all the heat tends to come from - apart from the heat from the rectifying/free-wheeling diodes).