Keep rationales on what the question tests
All checks were successful
Verify and publish V2 container / build-and-push (push) Successful in 30s
All checks were successful
Verify and publish V2 container / build-and-push (push) Successful in 30s
Med math rationales were padded with unrelated drug facts (TSH and heart rate for a levothyroxine tablet calculation) because the math prompt asked for "one safety check" and the rationale format asked for at least two bullets. - Rationales take 1 to 4 bullets, each about what the question tests, with fewer bullets preferred to padding. - Med math rationales explain only the calculation: the conversion, the method and an arithmetic check. - The second review rewrites a rationale or "why" that brings in facts the question does not test. - The outside-chatbot instructions say the same. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
0ad6290250
commit
fe94dbf876
4 changed files with 11 additions and 6 deletions
|
|
@ -460,7 +460,8 @@ Flag a question only for a real problem:
|
|||
- the writer changed its mind or left a note in the text (for example "A 78 kg? No — an 80 kg client", "Actually,", "wait"), or the wording is garbled, truncated or repeated;
|
||||
- data needed to answer is missing, or the stem contradicts itself, the options or the rationale;
|
||||
- two options are defensible, or none is correct; the rationale disagrees with the keyed answer;
|
||||
- an option gives the answer away, or the content is clinically wrong or outdated.
|
||||
- an option gives the answer away, or the content is clinically wrong or outdated;
|
||||
- the rationale or a choice's "why" brings in facts the question does not test (for example lab monitoring or dose limits in a plain dosage calculation): rewrite it to explain only what the question asks.
|
||||
For each problem give the complete corrected question with rewrite (same type, the same clinical point, following the rules for its type: single = 4 options with exactly one correct; multi = 6 options with 2 to 5 correct and a stem ending "Select all that apply."; a short plain stem; choices concise and parallel, with no explanation tacked on; numeric = one option, the correct answer with its unit, and "why" showing the working), or remove it if it cannot be saved. Do not flag style preferences or answer order. Call submit_proofread once; an empty list is the right answer when every question is sound.`;
|
||||
|
||||
/**
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue