Judge Catches AI-Generated Errors in Official Court Transcript

Full text

A judge caught a court reporter making AI-generated errors in a court transcript, and put stenographers everywhere on notice for their use of AI.

In a memorandum decision concerning a case about a man who sold drugs to another man who overdosed and died, filed on July 23, Judge Paul Felix wrote in a footnote of the decision that a transcript contained errors that looked a lot like generative AI. The footnote was spotted by attorney Rob Freund on X .

“At one point in the transcript, a motion, presumably made by the State, is attributed to the trial court. At another point, an objection, presumably made by Williams, is attributed to the Bailiff. At yet another point, the State’s closing argument is attributed to the trial court,” judge Felix wrote. “These errors, among others not described herein, complicated but did not substantially impede our review of Williams’s appeal. Regardless, we remind the Court Reporter that this court relies on transcripts being true and accurate representations of the transcribed proceedings. Based upon the types of errors reviewed, it appears that generative artificial intelligence may have assisted with the preparation of this transcript. While AI can improve efficiency and be a productive tool for many professionals, it is incumbent upon those using such systems to proofread and ensure the accuracy of the generated product.”

In case after case after case , for the last few years, judges have been catching lawyers using AI in court filings. These situations are always messy and embarrassing for the attorneys — whose whole job it is to represent their clients to the best of their ability by citing existing case law and legal precedent, which AI routinely fucks up — and judges are becoming more outspoken about their frustrations. In May, judges in the Supreme Court of the State of New York Appellate Division laid into several lawyers for more than 20 minutes after accusing one of them of using AI and the others of being too sloppy to catch it; the judges called the entire situation “striking, concerning, disappointing, and saddening.” Lawyers, meanwhile, blame paralegals, head colds, and “rushing.”

But this is the first time a court reporter has been publicly put on notice for not catching AI-generated errors in transcripts, raising the specter of there being errors not just in court filings from attorneys but in the records of official proceedings of a trial. There are many apps and companies that offer AI-generated transcripts for court reporting, but stenographers say their expertise as human listeners and skilled transcribers, especially since AI tends to guess instead of pausing to ask for a re-statement or resolve ambiguity before putting it into the court record, is still extremely valuable in the courtroom.