Long term memory might not be limited but short term working memory is certainly limited. The short term working memory is important in solving problems in general.
This is actually an argument for committing those "arcane facts" to memory. The more of a concept you have internalized, the fewer slots it takes up in working memory when solving a problem, thus increasing your problem solving capacity.
