Take DOB + n * 365.25 and then pick whatever day that falls in? That way it shouldn’t drift overall.
Though, I guess it would imply that what day of the year people celebrate on, would be off by one day on leap years compared to what it is on other years?