I use my simple little command line tool filewatcher to autorun tests. You supply it with file patterns and shell commands to be run when files matching the patterns is updated, added or deleted. It's available via gem install filewatcher. It was a great milestone when most of the code was from other developers pull request.