Medical emergency? Call 911. This site is education for professionals and the public, not medical advice.
DR GPT™ LabsDVDR GPT™ Voice
A physician's guide

Voice AI in healthcare:
where it helps, where it hurts

Voice is the most natural way people talk to each other, and now to software. Here is how I think about the three kinds of voice AI showing up in hospitals and clinics.

1. Ambient scribes

An ambient scribe listens to a visit, with permission, and drafts the clinical note. Done well, it lets a clinician look at the patient instead of the keyboard. The risk is a note that sounds right but records something that never happened, or misses something that did.

  • Ask the patient before recording, every time, and respect a no.
  • Read and correct every draft before you sign it. Your signature means you own it.
  • Check medications, doses, laterality and negatives with extra care.

2. AI phone and messaging agents

Voice agents can schedule visits, send reminders and answer routine questions at any hour. They can also frustrate or mislead a frightened caller.

  • Say clearly at the start that the caller is talking to AI.
  • Route chest pain, stroke symptoms, breathing trouble and thoughts of self-harm to a human or to 911 immediately.
  • Make it easy to reach a person at any point in the call.

3. Voice assistants for patients

Patients now ask voice assistants and chatbots about symptoms and medicines. I encourage using AI to prepare questions for a visit, not to replace the visit. My free safe prompt builder helps.

Questions to ask any voice AI vendor

  1. Where is the audio stored, for how long, and is it used for training?
  2. How are errors in transcripts found and corrected?
  3. How does it perform with accents, other languages and background noise?
  4. How does it hand off to a human, and how fast?

This guide is education, not legal or compliance advice. Follow your organization's policies on recording and patient consent, and state and federal law.

Written by , board-certified emergency physician. Last reviewed November 12, 2026.

About the author.
Bring this talk to your team
Harvey Castro, MD, MBA: board-certified emergency physician, 6x TEDx speaker and healthcare AI keynote speaker, in English and Spanish.
Book Harvey to speak
Get my free DR GPT™ newsletter
Healthcare AI in plain language from an ER physician, about twice a week.
Subscribe free