> However, it would most probably not be worth using such an approach because of the prohibitive computational cost.

Looking at the current state of the art (Transformer etc), computational cost certainly is not the main issue.