Edge-case testing

OpTally — testing status & checklist

Updated Aug 13, 2026 · current deploy 7d68484e · voice-first surgical case logger

fixes shipped this cycle

4,491

CPT codes now in the catalog

open — held or a decision

Fixed & deployed

Everything found this cycle and closed. Each verified with offline tests — no live Claude calls.

Item	Area	What was wrong → fix	Status
C2	Accounts	A 2nd account on a shared browser inherited the 1st's cases / app-lock / API key → local data now wiped unless it provably belongs to the same account. Cross-account data isolation.	Fixed
E2	CPT	Catalog was 18 codes → scraped ACGME's full table: 4,491 codes with authoritative category mappings.	Fixed
E3	CPT	Datalist → live typeahead: type a code, procedure, or eponym (`whipple`) → tap to add.	Fixed
P7	Parse	"Colorectal surgery" didn't resolve → rotation list merged with ACGME's full list (36).	Fixed
—	Categories	Adding a CPT now suggests its ACGME categories to tap (non-destructive).	Fixed
P8	Parse	Trauma cases didn't check "Involved trauma" → now auto-checks from the trauma category / CPT.	Fixed
P9	Parse	"Unable to determine procedure" dumped a sentence + junk CPT → now blanks + flags cleanly.	Fixed
E1	Form	Approach silently defaulted to "Lap" → now blank (`—`).	Fixed
D1	Dictation	Screen lock killed the mic mid-dictation → screen wake-lock while recording.	Fixed
D2	Dictation	Mic dropped silently → visible "mic stopped — tap to resume" warning.	Fixed
M1	Multi-case	Couldn't see what was said per case → each review shows its own "What you said".	Fixed
T1	Techniques	"lap" vs "laparoscopic appendectomy" made 2 techniques → normalized dedup (open/lap stay separate).	Fixed
T2	Techniques	Seeded "Sleeve gastrectomy" looked like real data → now badged "Sample".	Fixed
B1	Bug report	One screenshot only → up to 4 screenshots.	Fixed
P1	Parse	~60s cold first-parse → free warm-up on capture-open (pre-connects to Anthropic; no cost).	Fixed
P11	Offline	"Load failed" toast → "📴 You're offline — parsed on-device instead."	Fixed

Verified passing

Confirmed working in your self-test (clean input).

Single case fills all fields · MRN captured every way · MRN never appears in the title
Multi-case split ("case one… next case… three") · cancel → advances to next case
Dates ("yesterday", "last Tuesday", "8/3", "August 3rd") · no date → today, local
Approaches correct · attending variants → roster "Last, First" · unknown attending kept + flagged
Gibberish → no crash · mic denied → type instead · no internet → on-device fallback (fast)
All fields edit cleanly · second procedure + Primary / Robotic toggles work

Open — held on purpose or a decision

Not oversights. Each with the reason and my recommendation.

Item	Why it's open / recommendation	Status
P5 MRN "one 2345"	Recommend leaving. Auto-converting spoken number-words into an exact patient ID risks logging a wrong MRN. Blank + flag (you type it) is the safe default.	Held
P3 Garbled fields	Can't reproduce from code — anomalous model output, not a code bug. If it recurs, screenshot the transcript + bad fields and we'll catch the cause.	Held
P6 Parse accuracy	Needs live-parse iteration, which the "no live Claude calls on your credit while testing" rule blocks me from doing solo. Revisit deliberately.	Held
O1 Default site	Hard-defaults to "LA General" — fine for this cohort; make blank / configurable for a general or native-app release.	Decision
O2 Roster onboarding	Rotations now seeded; attending + site onboarding (CSV import or quick paste) is the remaining piece — a feature to design.	Feature
A1 Admin access	Admin page is a little hard to reach. Minor UX; low priority (only you use admin).	Minor

Continued checklist

The next testing pass — tap to check off. Your progress is saved on this device.

0 / 0

Accounts & multi-device

Sign up fresh email → 0 cases (bleed regression)
Switch coreyiambrose ⇄ test account → each shows only its own data
Delete account → re-signup same email → clean
Recovery-code reset → data intact
Two devices: log on phone → appears on laptop after sync
Offline edit on one device → sync → no clobber / loss

Dictation & parse

Long 3-case dictation with screen auto-lock → no words lost
"Colorectal surgery" / "Hepatobiliary" rotation → now resolves
"ED thoracotomy on trauma" → Involved trauma auto-checked
First parse after idle → fast (warm-up); note the seconds
Unknown / misheard attending → kept + flagged, not dropped

CPT & categories

Typeahead: 44970, whipple, open appendectomy, distal pancreatectomy, hernia
Open vs lap resolve to different codes
Add a CPT → "Suggested from CPT" chips appear; tap adds the category
Name-only CPT (no code) still allowed
Primary + Robotic toggles on multiple CPTs

Techniques

"lap appendectomy" then "laparoscopic appendectomy" from cases → same technique
"Sleeve gastrectomy" shows "Sample" badge
Create technique from a case → sections + attending prefs save

ACGME auto-fill (extension)

Copy & open ACGME → panel appears, fills fields
CPT add + set Primary + Robotic per code
Rotation name matches an ACGME option (list now aligned)
Multi-case queue survives ACGME's post-submit reload

Feedback, surveys & security

Bug report with 2–4 screenshots → all show in admin
"Don't include patient info" warning visible on the bug form
Pre-survey submits; metrics tick in admin
MRN never leaves the device to Claude · events are counts/latency only

Raw chronological notes live in OpTally-Testing-Log.md. Security items tracked in OpTally-Security-Audit.md. This page's checklist state is stored only in this browser.