I don't really understand that response. What I'm saying is that if these addresses become one of the actually-checked human-verifiers, it will be easier to circumvent, because those numbers look comparably easier for a virtual classifier to evaluate.

The house numbers are easier for a computer to classify than the messy, weird contorted letters.

Then they'll do what they did for books – introduce distortion. reCAPTCHA has already solved this problem.