SOAP Health's patients answer their medical history questions by speaking, guided by an assistant they can see.
SOAP Health wanted patients to give a complete medical history easily before a visit, so their providers can spot conditions such as cancer, heart disease and type 2 diabetes early.
What changed
What stood in the way.
- The SOAP Hub interview module had no interactive features, and patients typed every answer.
- The AI Genie assistant was a small avatar that patients overlooked, which led to dropouts, and frequent code changes kept surfacing bugs.
- 200+screens with voice input (as reported)
- 66%less documentation workload (as reported)
- 2 hours/daysaved (as reported)
What we built.
- A microphone and speech to text on about 200 screens of the interview module.
- A new full-size AI Genie avatar with expressive gestures, and voice commands so patients can talk to it.
- Continuous testing and fixing of the bugs that the platform's frequent refactoring surfaced.
- A stack of Remix, React, Node.js with TypeScript, Firebase, Prisma and BabylonJS on Google Cloud.
- Remix
- React
- Node.js
- TypeScript
- Firebase
- Prisma
- BabylonJS
- Google Cloud
What this work shows about us.
Voice input reached more than 200 screens on schedule while the platform was being refactored around it.
Making the assistant visible and speakable addressed why patients dropped out of a long questionnaire.
Want to add voice input to your EHR like this? Tell us what you want to change. Our AI assistant, Ask Unthinkable, helps you define your requirements, then connects you with the right team.
Start your plan ↗If we built it today, with AI.
What we would add now, moment by moment.
An agent would send the interview before the appointment, help the patient finish it by voice and tell them what is left. The questions stay as the clinicians set them.
An agent would turn the patient's answers into a draft SOAP note and point out answers that need a follow-up question. The provider still decides the assessment and plan.
Where this work fits.
- Hospitals & clinicsYour hospital is meant to deliver care without making patients wait.
- Records & imaging (EHR, PHR, PACS)Clinicians and patients find the record or image they need without asking twice.
- A US-based global clinical research firmVaccine study participants report their side effects in an app, and can leave the study with their data fully removed.
- Script SenseNew Zealand pharmacy patients get a text when their prescription is ready, filled from an electronic prescription without paper.
Facts and figures from the project records; nothing added.
Want this for your business?
Tell us what you run or what you're building. Our AI assistant, Ask Unthinkable, helps you define your requirements, then connects you with a senior AI engineer.
Send us a note instead
An AI agent. This prototype uses prepared answers and sends nothing.
We use essential cookies to run this site. With your consent we also use analytics cookies to see which pages help. Privacy policy