That is highly specific to your own agreement, and such penalties are usually only for the first 3-5 years. For myself, I have always negotiated 0 prepayment penalties.