I made a text editor that detects whether something has been AI generated by analyzing the keystrokes and edit history: www.collie.ink

Haven’t really told anyone about it so no one is using it, but I think it’s a good idea!

Very interesting! I can see how useful it would be, though I’m hoping the adversarial “AI learns how a specific individual types” and just dumps its output in there doesn’t become a thing.

What's so hard about hand copying to paper the essay the AI wrote?

Presumably this would also be joined with in-person proctoring, with a blue book, or its equivalent, and a writing utensil. Not much room to copy down an AI-hallucinated answer when all you have on your person is pen and paper.

that's all fine and good for a subset of essays, but there are others, like research reports, that take much longer than 2 hours to complete.

Pair it with an in-depth oral examination based on the report. Hell even have AI conduct the oral examination, since it can read it thoroughly much quicker than any teacher or TA and draft good questions. The teacher can grade for correctness and whatever other factors they already grade for.

can an llm do citations and bibliography without hallucinating? This seems pretty easy to verify and hard to cheat with.

Have you tried Gemini Deep Research?

Can’t I just do it on a computer and then copy it over ?

Yes for homework papers you could, though you'll still be learning (and often retaining) a lot in the process of handwriting a copy :-D

There's also classroom time being given to students for their writing, with no computers available (or with just monitored access with much AI stuff blocked)