I think the problem is the Debian packaging, which has hundreds of MB of elisp or something.

https://packages.debian.org/sid/emacs-common

(yes, it does fit, but it takes up way more space than I'd like...)