Faster quiz generation: planned parallel batches, room to reason
All checks were successful
Verify and publish V2 container / build-and-push (push) Successful in 25s
All checks were successful
Verify and publish V2 container / build-and-push (push) Successful in 25s
- Output limits leave room for reasoning (answer plus 8k-64k by effort, up to the model maximum); a call cut off before answering is retried with double the limit. At "max" effort, batches were being cut off at 16k tokens. - Quizzes are planned first (one distinct angle per question), then written in waves of four batches; med math runs alongside the first wave. - Replacements for removed questions are planned and written in parallel. - The Python check and the second review run at the same time each round. Measured live (DeepSeek flash, max reasoning, 50 questions): 7 min 21 s with no duplicates, against 20 min and 29 replaced duplicates without planning. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
1a212bb8ba
commit
2454ab6e95
8 changed files with 213 additions and 51 deletions
|
|
@ -178,6 +178,11 @@ rewrite a whole question, removed questions are replaced, a second independent r
|
|||
whole quiz for badly written items (a writer changing its mind mid-stem), and the quiz is
|
||||
checked again until it passes (at most three rounds).
|
||||
|
||||
Speed (timed live on a 50-question quiz): output limits now leave room for reasoning (calls at
|
||||
"max" were being cut off at 16k tokens), questions are planned before writing so batches can run
|
||||
four at a time without overlapping, replacements are planned and parallel too, and the two
|
||||
reviews run side by side. 50 questions: 7 min 21 s, 0 duplicates, all checks passed.
|
||||
|
||||
Tests: `tests/revision5.test.ts`. Live check on the rev1 copy with DeepSeek flash: a visitor's
|
||||
10-card set was written, named ("Heparin, Furosemide, and Dosage Calculations"), saved and
|
||||
listed once with the New tag; cards were single facts with no hints. The rev1 copy's 401 was its
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue