Quiz check: fix before handing over, with an independent second review
All checks were successful
Verify and publish V2 container / build-and-push (push) Successful in 29s
All checks were successful
Verify and publish V2 container / build-and-push (push) Successful in 29s
- The check can rewrite a whole question (garbled or contradictory stems, missing data, two defensible answers); a key fix that changes nothing is skipped. - Removed questions are replaced with new ones, so a 50-question quiz stays 50. - A second, independent model call reads the whole quiz for badly written items, helped by a scan for leftovers such as "A 78 kg? No - an 80 kg". - The quiz is checked again after any rewrite, replacement or open problem, up to three rounds, before it is handed over. - Reviewers see full rationales (a shortened one is marked as shortened). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
85d5c9186d
commit
1a212bb8ba
8 changed files with 412 additions and 26 deletions
|
|
@ -173,6 +173,11 @@ has no information); MCP and web search tools load automatically; share-link AI
|
|||
week, can be limited to the US or Arizona (`server/services/geo.ts`, DB-IP Lite) and is locked
|
||||
by abuse protection (migration 8).
|
||||
|
||||
Follow-up the same day: the quiz check no longer hands over a quiz with known problems. It can
|
||||
rewrite a whole question, removed questions are replaced, a second independent review reads the
|
||||
whole quiz for badly written items (a writer changing its mind mid-stem), and the quiz is
|
||||
checked again until it passes (at most three rounds).
|
||||
|
||||
Tests: `tests/revision5.test.ts`. Live check on the rev1 copy with DeepSeek flash: a visitor's
|
||||
10-card set was written, named ("Heparin, Furosemide, and Dosage Calculations"), saved and
|
||||
listed once with the New tag; cards were single facts with no hints. The rev1 copy's 401 was its
|
||||
|
|
@ -181,7 +186,7 @@ stored DeepSeek connection still holding the old key; it was updated from `.env`
|
|||
## Verification status
|
||||
|
||||
Baseline: 162 tests passed, TypeScript passed and production web/server builds passed.
|
||||
Added six regression tests. Full `npm run check` passes: **274 tests** (fifth revision, 2026-11-16; 261 after share-link generation, 2026-11-15; 257 after the fourth revision; 247 after the third, 208 after the second, 181 on 2026-11-12), TypeScript
|
||||
Added six regression tests. Full `npm run check` passes: **280 tests** (check loop and second review, 2026-11-16; 274 after the fifth revision; 261 after share-link generation, 2026-11-15; 257 after the fourth revision; 247 after the third, 208 after the second, 181 on 2026-11-12), TypeScript
|
||||
and both production builds. The Docker `test` stage runs the same 181 tests on Node 24. Tests were run with loopback access for the mock provider.
|
||||
|
||||
The earlier agent manually exercised quiz completion/results, flashcards, streak effects,
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue