Well, you are still talking about models. The creation and annihilation operators are also mathematical structures. That does not mean, as you seem to imply, that "particle" physics cannot be conceptualized outside of QFT. QFT may be superseded someday and the physical systems we try to describe will still be exactly as they are. I'm not sure if you'll agree with me since I suspect you've got a reason not to.