The difference is mostly noticeable in that the guest kernel takes up some RAM[1]. If you were really packing things tight, wasting some megabytes per container could start to hurt.

[1]: And for the non-hyperscalers with less tuning, you may be buffering I/O pages both in the guest and the host.