I wasn't aware it was anything other than a slightly-silly gender-neutral term for members of the House of Representatives. I suppose 'critters' could be pejorative but I'd not seen it used that way.