The large payment providers have a banking license you can’t really grow without it that’s your hook into the credit card industry.

PayPal, Stripe and the rest are their own https://en.m.wikipedia.org/wiki/Acquiring_bank which means they can process the payment themselves.