RESULTS · Published · Updated
The best AI scribe for Hindi
Hanah was the best AI scribe we tested on a consultation held entirely in Hindi. CliniScripts was second and Heidi third. CliniScripts and Hanah were within the margin of error on note accuracy, and Hanah led on time and transcription.
The test
The consultation is a short clinic visit in Hindi: two weeks of tiredness, headaches that are worse in the evening, occasional dizziness and poor sleep from work stress, with a blood test ordered and advice on meals, water and sleep. Six AI scribes recorded it five times each, each set to Hindi where the product asks for a language, and every note was graded blind against the 17 clinical facts said in the consultation. Notes could be written in English or Hindi. We rank scribes by time to a finalised note, which is the wait after pressing stop plus the time a clinician needs to review the note and fix what is wrong. The recording, transcripts, notes and grading reasons are on the test page.
Results
| Rank | Scribe | Time to a finalised note | Note errors per note | Coverage | Hallucination flags per note | Word error rate |
|---|---|---|---|---|---|---|
| 1 | Hanah | 52 s | 1.2 | 96% | 0.0 | 2.0% |
| 2 | CliniScripts | 1 min 50 s+57 s | 2.2+1.0 | 94%−2% | 0.6+0.6 | 3.6%+1.6% |
| 3 | Heidi | 1 min 56 s+1 min 04 s | 3.8+2.6 | 86%−11% | 0.6+0.6 | 4.3%+2.3% |
| 4 | Lyrebird | 2 min 12 s+1 min 20 s | 5.8+4.6 | 82%−15% | 1.4+1.4 | 3.5%+1.5% |
A Hanah note was ready to finalise 52 seconds after the consultation ended, on average. It captured 96% of the facts, with 1.2 note errors per note and no hallucination flags in any run. Reviewing and fixing it took 91% less time than writing the note yourself.
CliniScripts was second at 1 minute 50 seconds. It had 2.2 note errors per note and 94% coverage, both within the margin of error of Hanah's. Heidi was third at 1 minute 56 seconds, with 3.8 note errors per note, and Lyrebird fourth at 2 minutes 12 seconds.
Hanah transcribed Hindi most accurately, with a word error rate of 2.0%. Lyrebird was next at 3.5% and CliniScripts at 3.6%. Hanah produced its note a median 6 seconds after stop.
Findings
- The patient said they sometimes skip meals. One scribe translated this as cannabis being "sometimes skipped" and recorded cannabis use in every note.
- Hanah had no hallucination flags in any run, and it was the only scribe with none.
- The patient put their poor sleep down to work stress. CliniScripts recorded this in every run, while Hanah recorded it only in part in every run.
- Hanah used 3.3 MB of data for the consultation, the least of any scribe. Heidi used 23.3 MB.
Our Heidi review covers how Heidi did across all 12 consultations, with a video walkthrough.
Frequently asked questions
What is the best AI scribe for Hindi?
Hanah was the best AI scribe we tested on a consultation held entirely in Hindi. Its notes were ready to finalise 52 seconds after the consultation, on average, and it had the lowest word error rate. CliniScripts was second and Heidi third.
How was the Hindi consultation tested?
Six AI scribes recorded it five times each, each set to Hindi where the product asks for a language. Notes could be written in English or Hindi, and every note was graded blind against the 17 clinical facts said in the consultation.
Which AI scribe transcribes Hindi most accurately?
Hanah had the lowest word error rate on the Hindi consultation at 2.0%. Lyrebird was next at 3.5% and CliniScripts at 3.6%.
Figures in this article come from the ScribeStandard benchmark. See the full results, each test and how we test.
Explore results