Anthropic had a slip-up like this recently with a legal filing (totally unrelated to the report, just a similar example of bad citations). After being challenged by a judge, they said:
> A Latham & Watkins associate located that article as potential additional support for Ms. Chen’s testimony using a Google search. The article exists [...]
> [...] I asked Claude.ai to provide a properly formatted legal
citation for that source using the link to the correct article. Unfortunately, although providing the correct publication title, publication year, and link to the provided source, the returned citation included an inaccurate title and incorrect authors.
Anthropic could be lying, but apparently the link is indeed correct, so the account seems plausible.
However, the current situation is less understandable. The article says that "some correctly cited papers were inaccurately summarized", which suggests that AI either was used for the report itself, or at least was told to add citations without the author's input, which would be far more irresponsible than what Anthropic did. The apparently completely hallucinated "paper on direct-to-consumer advertising of prescription drugs" also doesn't look good.
The article also mentions that "[a]n early copy of the report shared with reporters did not include citations", which does support the theory that citations were added after the fact (whether or not AI was also used for the report itself).
> A Latham & Watkins associate located that article as potential additional support for Ms. Chen’s testimony using a Google search. The article exists [...]
> [...] I asked Claude.ai to provide a properly formatted legal citation for that source using the link to the correct article. Unfortunately, although providing the correct publication title, publication year, and link to the provided source, the returned citation included an inaccurate title and incorrect authors.
Anthropic could be lying, but apparently the link is indeed correct, so the account seems plausible.
However, the current situation is less understandable. The article says that "some correctly cited papers were inaccurately summarized", which suggests that AI either was used for the report itself, or at least was told to add citations without the author's input, which would be far more irresponsible than what Anthropic did. The apparently completely hallucinated "paper on direct-to-consumer advertising of prescription drugs" also doesn't look good.
The article also mentions that "[a]n early copy of the report shared with reporters did not include citations", which does support the theory that citations were added after the fact (whether or not AI was also used for the report itself).
Source for Anthropic testimony: https://storage.courtlistener.com/recap/gov.uscourts.cand.43...