Lawyers representing Anthropic recently got busted for using a false attribution generated by Claude in an expert testimony.
But that's one of more than 20 court cases containing AI hallucinations in the past month alone977 Archives according to a new database created by French lawyer and data scientist Damien Charlotin. And those were just the ones that were caught in the act. In 2024, which was the first full year of tracking cases, Charlotin found 36 instances. That jumped up to 48 in 2025, and the year is only half way over. The database, which was created in early May, has 120 entries so far, going back to June 2023.
SEE ALSO: More concise chatbot responses tied to increase in hallucinations, study findsA database of AI hallucinations in court cases shows the increasing prevalence of lawyers using AI to automate the grunt work of building a case. The second oldest entry in the database is the Mata v. Avianca case which made headlines in May, 2023 when law firm Levidow, Levidow & Oberman got caught citing fake cases generated by ChatGPT.
The database tracks instances where an AI chatbot hallucinated text, "typically fake citations, but also other types of arguments," according to the site. That means fake references to previous cases, usually as a way of establishing legal precedent. It doesn't account for the use generative AI in other aspects of legal documents. "The universe of cases with hallucinated content is therefore necessarily wider (and I think much wider)," said Charlotin in an email to Mashable, emphasis original.
"In general, I think it's simply that the legal field is a perfect breeding ground for AI-generated hallucinations: this is a field based on load of text and arguments, where generative AI stands to take a strong position; citations follow patterns, and LLMs love that," said Charlotin.
The widespread availability of generative AI has made it drastically easier to produce text, automating research and writing that could take hours or even days. But in a way, Charlotin said, erroneous or misinterpreted citations for the basis of a legal argument are nothing new. "Copying and pasting citations from past cases, up until the time a citation bears little relation to the original case, has long been a staple of the profession," he said.
The difference, Charlotin noted, is that those copied and pasted citations at least referred to real court decisions. The hallucinations introduced by generative AI refer to court cases that never existed.
Judges and opposing lawyersare always supposed to check citations for their own respective responsibilities in the case. But this now includes looking for AI hallucinations. The increase of hallucinations discovered in cases could be the increasing availability of LLMs, but also "increased awareness of the issue on the part of everyone involved," said Charlotin.
Ultimately, leaning on ChatGPT, Claude, or other chatbots to cite past legal precedents is proving consequential. The penalties for those caught filing documents with AI hallucinations include financial sanctions, formal warnings, and even dismissal of cases.
That said, Charlotin said the penalties have been "mild" so far and the courts have put "the onus on the parties to behave," since the responsibility of checking citations remains the same. "I feel like there is a bit of embarrassment from anyone involved."
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence
Russian photo studio lets you snap photos on a private jet for the Instagram likesNASA named the Mars rover landing site after famed Black sciWhat happened when Waymo reenacted real fatal car crashes with its autonomous vehicleThink cryptocurrency is bad? NFTs are even worse.How Facebook, Twitter, YouTube responded to Trump's liesJustin Bieber covered his abs with an elaborate tattoo and the internet is still processingInstagram Lite keeps all the key features in a 2MB package'PG: Psycho Goreman' director Steven Kostanski talks his cult hitApple is discontinuing the pricey iMac Pro, so get it while you canOnePlus 9 is coming in 2 weeks, with a HasselbladThe woman who took down Uber gives her first interview since speaking upGoogle Maps now lets you draw missing roads and add realApple is investing more than 1 billion euros in new facility in MunichBarack Obama is back on the campaign trail, babyFootage shows ferocious winds, heavy floods caused by Typhoon LanFiona the hippo has inspired a Halloween jack'How To with John Wilson' and coping with the pandemic anniversaryThe Sonos Roam is a small, portable smart speaker for $169CNN subtweets Donald Trump with an ad about an appleWe all hate Facebook. So why aren't we deleting our accounts? Hands on with Microsoft's Surface Pro 6, Surface Laptop 2 This is the OnePlus 6T The Olympic committee wants to ban non Donald Trump portrayed as ultimate Hollywood movie villain 6 badass facts you might not know about Beatrix Potter This otherwise lovely proposal may have also escalated a sibling rivalry Serena Williams shows different side of domestic violence in chilling video Google Maps wants to be the only app you need for your commute 'That's what I'm talking about:' Bill Clinton loved Barack Obama's speech When Hillary Clinton embraces her inner nerd, she wins J.K. Rowling blasts website for using her image without permission Video game villains, ranked Malia Obama wisely attended Lollapalooza instead of Democratic convention 'Assassin's Creed Odyssey' is a journey of Olympic proportions: Review Uplifting new hashtag celebrates black women's accomplishments Hillary Clinton's presidential campaign hacked The best 'Game of Thrones' gifts for her Newfound object on the edge of the solar system could lead to Planet X Google's new easter egg is a secret text adventure game Hillary Clinton's acceptance speech
2.0062s , 10138.1171875 kb
Copyright © 2025 Powered by 【1977 Archives】,Unobstructed Information Network