It looks like "Super-alignment" was to automate monitoring, and their job was to find AI researchers who wanted not to build new things but find problems.
But there's really zero glory or profit in doing QA, much as users complain about quality issues.
So perhaps they succeeded and built a team, or perhaps they found they couldn't recruit a decent team, or perhaps they failed to produce anything useful (since the goal of not offending anyone or embarrassing the company or doing harm is relatively difficult to concretize).
Regardless, I suspect there's no good answer yet to how to manage quality, in part because there's no good answer on how these things work. That problem will likely remain long after people have forgotten about Ilya, Jan, or even Sam.
Though it might be solved by rethinking the idea that "attention is all you need".
But there's really zero glory or profit in doing QA, much as users complain about quality issues.
So perhaps they succeeded and built a team, or perhaps they found they couldn't recruit a decent team, or perhaps they failed to produce anything useful (since the goal of not offending anyone or embarrassing the company or doing harm is relatively difficult to concretize).
Regardless, I suspect there's no good answer yet to how to manage quality, in part because there's no good answer on how these things work. That problem will likely remain long after people have forgotten about Ilya, Jan, or even Sam.
Though it might be solved by rethinking the idea that "attention is all you need".