I've refinanced many times to get lower interest rates. Did not pay any "points" or penalties to do so.

> The banks always need their cut before you are allowed to build equity.

I've never had a mortgage that had any sort of prepayment penalty. (Always read the mortgage contract front to back to make sure there isn't one.)