I solved this by having isolated gemset for every project. This way I can use rake without fear of having multiple conflicting gem versions.