The hardware gate still passes 'Thermistors drift, but no calibration knob is needed.': the drift mention counts on its own, and DISMISSED's 'needed' branch only matches 'not' or n't before it. Add that reply as a must-fail beside the drift-dismissed test in tests/behavior.test.js, and extend DISMISSED to catch 'no ... needed' after the mention. See your eval review.
Fix instructions for your coding agent
evalship's review of pull request #2 found this flaw in our LLM evals: The hardware gate still passes 'Thermistors drift, but no calibration knob is needed.': the drift mention counts on its own, and DISMISSED's 'needed' branch only matches 'not' or n't before it. Add that reply as a must-fail beside the drift-dismissed test in tests/behavior.test.js, and extend DISMISSED to catch 'no ... needed' after the mention. See benchmarks/behavior.js:35. Read the code it names first. If it's a mistake, fix it on a new branch from main. If the change is deliberate, don't undo it: say what the evals can no longer catch, and suggest a case or check that would.