So he gave a tech-talk at Google, around 2008, and yes he had lots of graphs and such but during the Q&A session he kept retreating into generalized ideas rather than data. I recall the question about how he came up with his numbers for machines to hold a consciousness as one such exchange.

The impression I certainly got was that his approach is to theorize about something, then design experiments to test out his theory. As opposed to running a bunch of experiments and then figuring out a theory that would explain the collected data.

That said, I've got mad respect for his work and have enjoyed his talks and writings. Your comment though suggests you think 'theorist' is a negative in some connotation? Why is that?

> The impression I certainly got was that his approach is to theorize about something, then design experiments to test out his theory. As opposed to running a bunch of experiments and then figuring out a theory that would explain the collected data.

There's nothing wrong with this, as you've written it. (There might be a problem with his implementation.) All else being equal, I trust a theory which has made ten accurate predictions over a theory which merely explains ten previous observations.

You would be making a mistake unless the predictions had a high degree of "unexpectedness" or the ten prior observations lacked coherence.

If one person develops a theory and makes ten predictions which turn out to be true; and if a second person observes the same ten things, and then develops a theory without knowing the first; then I consider this stronger evidence in favor of the first theory than of the second. (The second might e.g. be more elegant, in which case I might prefer it anyway.)

This is true whatever the observations are. If they're unsurprising, then we already had a good theory, in which case I question the need for the two new ones, but that applies to both equally.

It may be that Kurzweil is falling into the trap of misinterpreting his results to fit his theory, but that can be done just as well when you try to base a theory off existing data. On the other hand, the Texas sharpshooter fallacy can only happen if you collect data before coming up with your theory.

I don't care for Kurzweil but I don't see anything wrong with hypothesizing about something and then designing experiments to test that hypothesis, rather than just being a mindless "data scientist." :) Sounds pretty normal to me.

> His tendency to handwave rather than retreat to data? What the heck are you talking about? Have you seen how many graphs he puts in his presentations?

The ability to present something in graph form does not mean that it isn't handwavy bafflegab rather than data.

One need look no further than his absurd joke of a "paradigm shifts"/"countdown to the singularity" graph.