A New Mexico attorney was fined $5,000 and held in contempt after using ChatGPT to generate evidence in a murder appeal, including fabricated witness statements and fake police testimony. The court determined that the lawyer submitted citations to cases and witnesses that did not exist, directly misleading the court and harming his client's case.

This is one of the first high-profile cases where a court has formally sanctioned a lawyer for AI-generated misinformation, establishing a precedent that using AI without verification can result in disciplinary action and financial penalties.

What This Means for Your Business

Any organization using AI tools for legal work, compliance, research, or documentation must establish verification protocols. AI models, including ChatGPT, can confidently produce false information (called hallucinations), and relying on their output without human review exposes you to legal liability. If your firm uses AI for drafting contracts, legal research, regulatory filings, or evidence, implement mandatory human review before submission. This is now a liability issue, not just best practice.