We did for years, and even have a pretty cool one with dual filtration that prevented almost all grit. (the Espro) However, I didn't enjoy the wasted coffee and cleanup, and found that using refillable pods used less coffee and mess for the same product.
The annoying cleanup and wasted coffee seems specific to the espro.
Cleaning a normal one is really quick and I don't mind the remainder of fines as they quickly settle at the bottom of the cup.
