AI in HealthcareNEJM AI

Does AI-Powered Clinical Documentation Enhance Clinician Efficiency? A Longitudinal Study

December 1, 2024

NEJM AI study examining the longitudinal impact of AI-powered ambient clinical documentation on clinician efficiency, finding nuanced results across practice settings.

Read the original article at NEJM AI

AuthAnnie's Take

Our perspective on this story

A longitudinal study published in NEJM AI examining whether AI-powered clinical documentation enhances clinician efficiency produced results that physician practices should examine carefully: the findings are nuanced, not uniformly positive. While ambient AI documentation tools showed promise in reducing after-hours documentation time and improving clinician satisfaction, the efficiency gains varied significantly across practice settings, specialties, and individual physicians. For practices considering ambient AI investments — and for those thinking about how clinical documentation quality connects to denial management — this study provides essential context.

What the Study Found

The NEJM AI study tracked clinicians using AI-powered ambient documentation over an extended period, measuring multiple efficiency metrics including time spent on documentation, after-hours charting (often called "pajama time"), note quality, and clinical throughput. Key findings include:

  • Clinicians using ambient AI reported meaningful reductions in after-hours documentation time, particularly in primary care settings
  • The efficiency impact was not uniform — some specialties and practice settings showed minimal improvement
  • Note length and content changed with AI assistance, with implications for both completeness and conciseness
  • Clinician adoption patterns varied, with some physicians integrating the technology seamlessly while others found it disruptive to their workflow

The nuanced results are actually more useful than uniformly positive findings because they help practices set realistic expectations and identify the conditions under which ambient AI documentation delivers genuine value.

The Denial Management Connection

Clinical documentation quality is the upstream determinant of almost every denial management outcome. When a payer denies a claim for medical necessity, the appeal depends on the clinical documentation supporting the service. When a prior authorization requires clinical justification, the strength of that justification depends on what was documented during the patient encounter. Ambient AI documentation tools sit at this critical intersection.

The potential upside for denial management is significant. If ambient AI captures clinical reasoning, examination findings, and medical decision-making more consistently and completely than hurried physician notes, the documentation foundation for denials and appeals improves. A physician who documents that a patient "failed conservative therapy" as part of natural clinical conversation captured by ambient AI creates stronger appeal evidence than one who writes a terse note after the fact.

The potential risk is also real. AI-generated notes that are voluminous but imprecise — capturing everything said during an encounter without clinical structure — may actually make it harder to extract the specific evidence needed for a targeted appeal. The NEJM AI study's finding that note characteristics changed with AI assistance underscores the importance of evaluating not just how much documentation is generated, but whether its structure and content support the downstream uses that matter most.

What Practices Should Consider

The study's mixed results suggest that ambient AI documentation is not a plug-and-play solution. Practices considering adoption should evaluate the technology against their specific documentation challenges. If your primary documentation problem is incompleteness — physicians not capturing the clinical detail that supports medical necessity — ambient AI may address it. If your problem is documentation structure — the right information is present but not organized in ways that translate to effective appeals — ambient AI may generate more raw material without solving the organizational challenge.

The most sophisticated approach treats ambient AI as one component of a documentation-to-denial-management pipeline. Better documentation feeds better coding, which feeds cleaner claims, which reduces denials. When denials do occur, better documentation provides stronger evidence for appeals. The NEJM AI study does not prove that ambient AI delivers this end-to-end benefit. But it establishes that the technology can improve the documentation input that starts the entire chain. The question is whether your practice can connect that input to the downstream outcomes that matter.

Ready to stop losing revenue to denials?

See how AuthAnnie helps your practice fight back — and win.

Request a Demo