You don't really need automated tests. You can use a reproducible bug report as test input, then use git-diff to determine the first point it time it appears.