Did you make sure to enable to cached template loader[1]?

>Enabling the cached template loader often improves performance drastically, as it avoids compiling each template every time it needs to be rendered.

[1] https://docs.djangoproject.com/en/dev/ref/templates/api/#dja...