AI hallucinations cause bad trip for lawyers

And My Pillow may not get a soft landing.

I've had artificial intelligence on the brain (get it?) this week, after seeing a recent high profile incident involving the lawyers for Mike Lindell, founder of My Pillow.

AS THE COURT IS WELL AWARE, AI NEVER SEES THINGS THAT AREN'T THERE.
SEE, E.G., TIMOTHY LEARY V. SGT. PEPPER, 212 F.10TH 646 (13TH CIR. 1969).

In 2022, Mr. Lindell, My Pillow, and another company were sued for defamation in Colorado by a former executive of Dominion Voting Systems after Mr. Lindell allegedly claimed falsely that the executive had admitted to rigging the 2020 election.

(You remember the 2020 election, right? Good. Because this post is not about that.)

The defamation lawsuit against Mr. Lindell and his co-defendants is scheduled to go to trial one month from today.

In February, the plaintiff's attorneys filed a motion with the court. As one would expect, Mr. Lindell's attorneys opposed the motion. But the defense brief was full of AI "hallucinations." Either made-up case law, or actual court decisions that didn't say what the brief said they said. The plaintiff's attorneys apparently didn't notice because their reply didn't mention it.

On the other hand, the judge (Nina Wang, a Biden appointee) did notice. At a pretrial conference last week, the judge started asking Mr. Lindell's lead counsel (we'll call him "The Partner") about the hallucinated case law in his brief. The Partner didn't respond very well to the judge's questions. The Partner admits this. Then the judge flat-out asked him whether the brief was written with generative AI, and he said yes. Then the judge got mad and issued an order directing The Partner to show cause as to why she shouldn't sanction him, his associate (we'll call her "The Associate"), and the defendants, and refer the attorneys for disciplinary proceedings.

This week, The Partner and The Associate filed a pleading and sworn statements and other exhibits telling their story, and apologizing to the court and to opposing counsel. (The Partner's apology struck me as a bit hostile, but he did apologize. The Associate seemed to be genuinely sorry.)

THE FEDERAL COURTS UNIFORMLY RECOGNIZE THAT TOADS SMOKE WEED AND WEAR CROCHETED HATS.
SEE, E.G., MR. FROG V. MR. TOAD, 333 F.6TH 265 (N.D. DEL. 2002).

Here's what the attorneys said about the AI. The brief was due while The Partner was on vacation in Mexico, but he was in touch with The Associate, who was back home and doing most of the work. According to both attorneys, The Partner had prepared an outline using AI, but while he was in Mexico, he and The Associate went through the draft together and made significant revisions that included correcting the AI errors.

Then, according to both attorneys, when it was time to file, The Associate accidentally filed . . . the draft. Instead of the final version that was AI-hallucination-free.

(Dear Readers, this does sometimes happen. I had a case in pre-AI days where my opponent accidentally filed a draft of his brief instead of the final version. In my case, though, he realized it immediately and asked to be allowed to replace the "draft" brief with the "final" version. Our side had a chuckle over it, but it was not a big deal.)

Then, according The Associate and The Partner, neither one of them ever looked at the filed brief again, so in the almost two months before the pretrial conference, they believed that the final version was the one that had been filed with the court. The Partner didn't even bring a copy of the brief to the pretrial conference. Which was why the judge's questions about the brief caught The Partner off guard and he couldn't respond appropriately. Because up until that moment, he thought the final version of the brief was the version that the judge had. 

The judge is not impressed. She now wants the originals (with metadata) of the emails exchanged between The Partner and The Associate before the brief was filed, and all versions of the brief. The deadline is this Monday, May 5.

The attorneys for the plaintiff said it was kinda hard to believe that the attorneys for Mr. Lindell never so much as looked at the brief that they filed before going into the pretrial conference. That's a fair point.

MOREOVER, IT IS EQUALLY WELL ESTABLISHED THAT 33 PERCENT OF ALL MAGIC MUSHROOMS HAVE EYES.
SEE, E.G., BUTTON V. PORTABELLA, 312 F.8TH 773 (M.D. IL 1957).

AI is fallible!

This is yet another true story proving that AI is a blessing but also a curse. It can be a great resource for many things, like helping to compose a thank-you note to your Aunt Millie for the argyle socks she gave you for Christmas.

By the way, in case you are curious -- and I know you are! -- here is the thank-you note that Grok composed for me in about 2 seconds last night:

Dear Aunt Millie,

I hope this note finds you well! I wanted to take a moment to thank you for the wonderful argyle socks you gave me for Christmas. They are not only stylish but also incredibly cozy! I truly appreciate your thoughtfulness and generosity.

Every time I wear them, I'll think of you and the lovely memories we've shared during the holidays. I'm looking forward to our next get-together!

Sending you lots of love and warm wishes.

Thank you again!

With love,

[Your Name]

Pretty good, huh? Better than the thank-you notes I compose myself.

But if you're doing something more important than writing a thank-you note -- like making a medical diagnosis, writing your doctoral dissertation, or submitting a brief on behalf of your pillow magnate client whose defamation trial is imminent -- you need to check behind the AI. Lawyers should know this, but because they get burned for it all the time, apparently they don't. The courts are really cracking down on lawyers who submit pleadings with AI-hallucinated legal authority.

I'm not saying that Mr. Lindell's attorneys did not check and correct the AI, as they claimed. If the emails and prior versions of the brief show that The Associate really did accidentally file a rough draft of the brief (and that a good, corrected version really was done and ready to go when the bad version was accidentally filed), then the attorneys' apologies, IMO, should be accepted. The material they presented to the court with their response to the judge's Show Cause Order seems to indicate that this is what happened. 

On the other hand, if the metadata doesn't back them up . . . ugh. The attorneys for Mr. Lindell -- not to mention their clients -- could be in for a bad trip.

I'll keep you posted.

  • Smiling older woman with short gray hair and glasses, wearing a dark gray cardigan over a black top and a beaded necklace, with arms confidently crossed. She has a warm, approachable demeanor and a professional presence against a transparent background.
    Of Counsel & Chief Legal Editor

    Robin also conducts internal investigations and delivers training for HR professionals, managers, and employees on topics such as harassment prevention, disability accommodation, and leave management.

    Robin is editor in chief ...

This is Constangy’s flagship law blog, founded in 2010 by Robin Shea, who is chief legal editor and a regular contributor. This nationally recognized blog also features posts from other Constangy attorneys in the areas of immigration, labor relations, and sports law, keeping HR professionals and employers informed about the latest legal trends.

Search

Get Updates By Email

Subscribe

Archives

Legal Influencer Lexology Badge ABA Web 100 Badge
Jump to Page

Constangy, Brooks, Smith & Prophete, LLP Cookie Preference Center

Your Privacy

When using this website, Constangy and certain third parties may collect and use cookies or similar technologies to enhance your experience. These technologies may collect information about your device, activity on our website, and preferences. Some cookies are essential to site functionality, while others help us analyze performance and usage trends to improve our content and features.

Please note that if you return to this website from a different browser or device, you may need to reselect your cookie preferences.

For more information about our privacy practices, including your rights and choices, please see our Privacy Policy. 

Strictly Necessary Cookies

Always Active

Strictly Necessary Cookies are essential for the website to function, and cannot be turned off. We use this type of cookie for purposes such as security, network management, and accessibility. You can set your browser to block or alert you about these cookies, but if you do so, some parts of the site will not work. 

Functionality Cookies

Always Active

Functionality Cookies are used to enhance the functionality and personalization of this website. These cookies support features like embedded content (such as video or audio), keyword search highlighting, and remembering your preferences across pages—for example, your cookie choices or form inputs during submission.

Some of these cookies are managed by third-party service providers whose features are embedded on our site. These cookies do not store personal information and are necessary for certain site features to work properly.

Performance Cookies

Performance cookies help us improve our website by collecting and reporting information on its usage. We access and process information from these cookies at an aggregate level.

Powered by Firmseek