RESULTS · Published · Updated
The best AI scribe for myotherapy
Hanah was the best AI scribe we tested on a 50-minute myotherapy consultation, and it led by more than the margin of error. Heidi was second and CliniScripts third.
The test
The consultation is a long treatment session for a flare of long-standing low back pain and a sore right shoulder, ending with a home stretching program and lifting advice. It is the benchmark's stress test, with a television and voices from another room playing in the background. Six AI scribes recorded it five times each, and every note was graded blind against the 40 clinical facts said in the consultation. We rank scribes by time to a finalised note, which is the wait after pressing stop plus the time a clinician needs to review the note and fix what is wrong. The recording, transcripts, notes and grading reasons are on the test page.
Results
| Rank | Scribe | Time to a finalised note | Note errors per note | Coverage | Hallucination flags per note | Word error rate |
|---|---|---|---|---|---|---|
| 1 | Hanah | 1 min 40 s | 0.6 | 100% | 0.2 | 1.3% |
| 2 | Heidi | 3 min 41 s+2 min 01 s | 9.6+9.0 | 82%−18% | 0.8+0.6 | 3.9%+2.6% |
| 3 | CliniScripts | 4 min 16 s+2 min 36 s | 9.0+8.4 | 88%−12% | 2.2+2.0 | 1.1% |
| 4 | Freed | 4 min 40 s+3 min 00 s | 6.4+5.8 | 86%−13% | 0.8+0.6 | 66.8%+65.6% |
A Hanah note was ready to finalise 1 minute 40 seconds after the consultation ended, on average, and its five runs were within 24 seconds of each other. It captured 99% of the facts, with 0.6 note errors per note, the fewest of any scribe. Reviewing and fixing it took 81% less time than writing the note yourself.
Heidi was second at 3 minutes 41 seconds and CliniScripts third at 4 minutes 16 seconds. CliniScripts had the second highest coverage at 88%. Freed was fourth at 4 minutes 40 seconds and had the second fewest note errors at 6.4.
CliniScripts and Hanah had the lowest word error rates, 1.1% and 1.3%, a difference within the margin of error. Neither had a mis-heard word that changes clinical meaning in any run.
Findings
- Hanah used 13.5 MB of data over the 50 minutes. Heidi used 145 MB and CliniScripts 132 MB.
- Freed's transcripts included long passages that were not part of the consultation, which took its word error rate to 66.8%.
- Hanah and CliniScripts had no mis-heard words that change clinical meaning in any run, despite the background television.
- Hanah had one hallucination flag across its five runs: it described a load-related muscular component, which the therapist did not say.
Our Heidi review covers how Heidi did across all 12 consultations, with a video walkthrough.
Frequently asked questions
What is the best AI scribe for myotherapy?
Hanah was the best AI scribe we tested on a 50-minute myotherapy consultation. Its notes were ready to finalise 1 minute 40 seconds after the consultation, on average, with the fewest note errors. Heidi was second and CliniScripts third.
Do AI scribes work with background noise?
This consultation is the benchmark's stress test, with a television and voices from another room playing in the background. Hanah and CliniScripts had no mis-heard words that change clinical meaning in any run. Freed's transcripts included long passages that were not part of the consultation, which took its word error rate to 66.8%.
How was the myotherapy consultation tested?
It is a long treatment session for a flare of long-standing low back pain and a sore right shoulder. Six AI scribes recorded it five times each, and every note was graded blind against the 40 clinical facts said in the consultation.
Figures in this article come from the ScribeStandard benchmark. See the full results, each test and how we test.
Explore results