AI Agent Governance: Rules, Escalation and Audit Trails for Customer-Facing Agents
How to govern AI agents that talk to customers: approved content rules, escalation paths, logging, human-in-the-loop review and a monthly QA routine.
What HIPAA actually requires of an AI receptionist, when your vendor must sign a BAA, and the questions to ask before patient data reaches your phone line.
There is no such thing as a "HIPAA-certified" AI receptionist. HHS does not certify software or vendors, so the label on a vendor's homepage tells you nothing. What actually determines your exposure is whether the tool creates, receives, maintains or transmits protected health information (PHI) on your behalf, whether the vendor will sign a business associate agreement, and how the system is configured, secured and logged. Everything else is marketing.
This article describes what the rules say, using HHS's own published guidance, and lists what you should verify with your counsel before patient calls run through any phone agent. It is not legal advice, and no article can replace a lawyer who knows your state, your practice and your contract.
HIPAA's Privacy, Security and Breach Notification Rules apply to covered entities: health plans, clearinghouses, and providers who transmit health information electronically in connection with covered transactions. A dental practice, med spa, chiropractic clinic or physical therapy office that bills insurance is a covered entity. So is a solo practitioner.
The rules also apply directly to business associates: people or companies that perform functions involving PHI on a covered entity's behalf, or provide services that involve disclosing PHI to them. HHS's guidance page gives examples, and one of them is directly relevant here: a "third-party vendor Artificial Intelligence (AI) chatbot on a provider's patient portal that provides services involving the patient's PHI such as symptom assessment, medical reminders, and appointment scheduling."
Read that example slowly, because it describes what most AI receptionists do. If your agent answers calls, schedules appointments, and captures symptom or insurance details, then the vendor is very likely a business associate, and a BAA is expected before PHI flows.
Not every call involves PHI, and being precise about this is what separates a real compliance review from vendor slogans.
The practical conclusion: for most healthcare practices, an AI receptionist that books appointments will touch PHI, so plan for the BAA path rather than hoping to avoid it.
A BAA is a written contract in which you obtain satisfactory assurances that the business associate will appropriately safeguard PHI. HHS publishes sample provisions that walk through the required elements, including permitted and required uses and disclosures, the vendor's commitments, and what happens when obligations are breached. Your counsel should review the actual agreement, but the following items are the ones clients most often miss.
Most exposure comes from how the agent is wired, not from the model underneath it.
Three more authorities show up in serious reviews.
None of this is exotic. It is the same due diligence you would do for a cloud EHR vendor, applied to the newest vendor on your phone line. If you want to see how we approach the phone side of healthcare intake, the AI receptionist service and the dental industry page describe setups that keep clinical matters with your team, and the appointment reminder workflow shows a low-risk automation to start with. Practices in aesthetics and wellness can start with the med spa page. For the messaging side of compliance, the SMS compliance guide addresses consent and registration questions that often arrive at the same time.
Start with a data-flow question, not a vendor question: list every piece of patient information your current phone process touches, and where it lives. The free six-step AI automation plan on our homepage templates that audit, including the compliance checkpoints to walk through with counsel: start your AI automation plan. When you are ready to review a specific vendor or build, book a call and we will go through the questions together.
Is any AI receptionist "HIPAA certified"?
No. HHS does not certify products or vendors, so "HIPAA certified" is a marketing phrase, not a credential. What matters is whether your specific setup creates or handles protected health information, whether the vendor will sign a business associate agreement, and how their system is actually configured and secured.
Does my AI receptionist need a business associate agreement?
If the vendor creates, receives, maintains or transmits protected health information on your behalf, HIPAA expects a BAA. HHS's own guidance lists a third-party AI chatbot that provides services involving patient PHI, such as appointment scheduling, as an example of a business associate. If scheduling or symptom details flow through the tool, assume you need one and have counsel confirm.
What happens if an AI receptionist records calls with patient information?
Recordings and transcripts of calls containing PHI are themselves PHI, so they fall under your HIPAA obligations and your state's recording consent rules. Ask where the recordings are stored, how long they are kept, who can access them, and how deletion works. Have counsel confirm your consent notice requirements before you enable recording.
Does HIPAA apply to every business that answers a patient's call?
No. HIPAA applies to covered entities (most providers and plans) and their business associates. A dental office scheduling a patient's cleaning is squarely in scope. A business that just answers general questions without health information may fall outside HIPAA, but state consumer health laws like Washington's My Health My Data Act can still apply.
What should I ask an AI receptionist vendor about PHI?
Whether they will sign a BAA, where data is stored and processed, how it is encrypted, who can access it, how long it is retained, how deletion works, how breaches are reported to you, and whether subcontractors are bound by the same terms. Get answers in writing and have your counsel review the agreement before go-live.
How to govern AI agents that talk to customers: approved content rules, escalation paths, logging, human-in-the-loop review and a monthly QA routine.
What US service businesses must know before texting leads: consent, A2P 10DLC registration, toll-free verification, quiet hours, STOP handling and records.
How AI receptionist pricing really works - flat plans, per-minute, per-call and per-resolution models, what drives cost, and the fees quotes tend to hide.
More articles: browse the full Praktivo blog.