It's fine to list some reasons for using squared error, but you really can't decide on the error function without referring to a problem you're trying to solve.
Just look at the success of compressed sensing, based on taking the absolute value error seriously.
Just look at the success of compressed sensing, based on taking the absolute value error seriously.