why are people surprised that an AI model trained on a huge amount of data is good at answering stuff on these types of tests? Doctors and Lawyers are glorified databases/search engines at the end of the day, 99% of them are just applying things they memorized. Lawyers are professional bullshitters, which is what the current generation of AI is great at
I'll get more concerned if it really starts getting good at math related tasks, which I'm sure will happen in the near future. The government is going to have to take action at some point to make sure the wealth created by productivity gains is somewhat distributed, UBI will almost certainly be a requirement in the future
Among the general public, doctors and lawyers are high status and magical. An article about how AI will replace them would be more impressive to that public than it creating some obscure proof about the zeroes of the zeta function, even though the latter would be far more indicative of intelligence/scary from an AI safety perspective.
"Doctors and Lawyers are glorified databases/search engines at the end of the day" - well, don't be suprised if AI replaces programmers before doctors and lawyers - patients will likely prefer contact with human rather than machines, and lawyers can just lobby for laws which protect their position
And yet the programmers on HN will be yelling they don't need unions as the security guards are dragging them away from their desks at Google, because you know, we'll always need good programmers.
if AI gives near equal results for way less cost than people will work around the law to get AI treatment. There are already AI models better at diagnosing cancer than human doctors. I see a future where people send in various samples and an AI is able to correlate a huge number of minor data points to find diseases early
The best doctor knows what's going on in the body. Has a good understanding of human biology at all levels, from molecular reactions to organ interactions. If I could feed test results to the AI and it would tell me what's wrong, that would be amazing. It's almost equivalent to building a simulation of the human body.
I've joked for a long time that doctors are inference machines with a bedside manner. That bedside manner though is critical. Getting an accurate history and suitably interpolating is a huge part of the job.
I wouldn’t be at all surprised if an LLM was many times better than a human at math, even devising new axioms and building a complete formal system from scratch would be impressive, but not game changing. These LLMs are very good at dealing with formal, structured systems, but not with in formalized systems like what humans deal with everyday.
I'll get more concerned if it really starts getting good at math related tasks, which I'm sure will happen in the near future. The government is going to have to take action at some point to make sure the wealth created by productivity gains is somewhat distributed, UBI will almost certainly be a requirement in the future