| Details | Status | Test | Layer | Platform | Time |
|---|
| Passed | compare > prints the aggregate agreement and the path of the comparison filetests/cli.test.ts | Unit | Unit·node | 0.02 s |
| Passed | compare > refuses a tag that is not pinnedtests/cli.test.ts | Unit | Unit·node | 6 ms |
| Passed | parseCompareArgs > rejects anything but compare honestytests/cli.test.ts | Unit | Unit·node | <1 ms |
| Passed | parseCompareArgs > rejects one run or threetests/cli.test.ts | Unit | Unit·node | <1 ms |
| Passed | parseCompareArgs > requires target and tagtests/cli.test.ts | Unit | Unit·node | <1 ms |
| Passed | parseCompareArgs > takes exactly two runs in ordertests/cli.test.ts | Unit | Unit·node | 1 ms |
| Passed | parseRunArgs > expands --measures all to every measure in spec ordertests/cli.test.ts | Unit | Unit·node | 3 ms |
| Passed | parseRunArgs > parses a diff range between two tagstests/cli.test.ts | Unit | Unit·node | <1 ms |
| Passed | parseRunArgs > rejects a diff range with a missing endtests/cli.test.ts | Unit | Unit·node | 1 ms |
| Passed | parseRunArgs > rejects an unknown measuretests/cli.test.ts | Unit | Unit·node | 1 ms |
| Passed | parseRunArgs > rejects anything other than the run commandtests/cli.test.ts | Unit | Unit·node | <1 ms |
| Passed | parseRunArgs > requires a tag so runs never default to a floating reftests/cli.test.ts | Unit | Unit·node | <1 ms |
| Passed | run > fails and logs each requested measure that is not implemented yettests/cli.test.ts | Unit | Unit·node | 0.02 s |
| Passed | run > fails the run when a measure's result does not match its schematests/cli.test.ts | Unit | Unit·node | 9 ms |
| Passed | run > refuses to start against a tag that is not pinnedtests/cli.test.ts | Unit | Unit·node | 5 ms |
| Passed | run > writes a measure's result beside the run log after checking it against the measure's schematests/cli.test.ts | Unit | Unit·node | 8 ms |
| Passed | anthropicCall > streams the request, so the SDK accepts a 64k max_tokens, and keeps model and effort fixedtests/honesty/classifier.test.ts | Unit | Unit·node | 5 ms |
| Passed | classifyFile > fails the file after three bad answers instead of guessingtests/honesty/classifier.test.ts | Unit | Unit·node | 1 ms |
| Passed | classifyFile > retries an answer that skips a test, and adds up the usage of every attempttests/honesty/classifier.test.ts | Unit | Unit·node | <1 ms |
| Passed | classifyFile > sends the versioned prompt as the system prompt and returns a valid answertests/honesty/classifier.test.ts | Unit | Unit·node | 2 ms |
| Passed | prompts > changes the hash when anything in the file changes, header includedtests/honesty/classifier.test.ts | Unit | Unit·node | 2 ms |
| Passed | prompts > loads the committed honesty prompt with its version and a hash of the whole filetests/honesty/classifier.test.ts | Unit | Unit·node | 0.02 s |
| Passed | prompts > refuses a prompt with no version header or the wrong nametests/honesty/classifier.test.ts | Unit | Unit·node | 2 ms |
| Passed | compareHonestyRuns > counts a table test once however many rows it executedtests/honesty/compare.test.ts | Unit | Unit·node | 7 ms |
| Passed | compareHonestyRuns > counts known disagreements into the rate, the confusion matrix and the ratio differencetests/honesty/compare.test.ts | Unit | Unit·node | 9 ms |
| Passed | compareHonestyRuns > gives 100% agreement and no ratio difference for identical runstests/honesty/compare.test.ts | Unit | Unit·node | 0.01 s |
| Passed | compareHonestyRuns > kind > is a changeover when the model differs, recording both valuestests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > kind > is a repeat when model, effort and prompt hash all matchtests/honesty/compare.test.ts | Unit | Unit·node | 2 ms |
| Passed | compareHonestyRuns > kind > records each of effort and prompt hash that differstests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > leaves runner-decided unreachable tests out of the agreementtests/honesty/compare.test.ts | Unit | Unit·node | 7 ms |
| Passed | compareHonestyRuns > refuses to compare > a definition whose test names differ between the runstests/honesty/compare.test.ts | Unit | Unit·node | 2 ms |
| Passed | compareHonestyRuns > refuses to compare > a run with itselftests/honesty/compare.test.ts | Unit | Unit·node | 1 ms |
| Passed | compareHonestyRuns > refuses to compare > runs for a different target or tag than the one asked fortests/honesty/compare.test.ts | Unit | Unit·node | 1 ms |
| Passed | compareHonestyRuns > refuses to compare > runs that classified different definitions, listing themtests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > refuses to compare > runs whose commit differstests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > refuses to compare > runs whose tag differstests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > refuses to compare > runs whose target differstests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > refuses to compare > runs whose unreachable tests differ, listing themtests/honesty/compare.test.ts | Unit | Unit·node | 3 ms |
| Passed | compareHonestyRuns > rounds the agreement rate to 3 decimalstests/honesty/compare.test.ts | Unit | Unit·node | 7 ms |
| Passed | renderComparisonSummary > prints aggregates only: no test names, no per-test classestests/honesty/compare.test.ts | Unit | Unit·node | 7 ms |
| Passed | renderComparisonSummary > says when the comparison is a repeattests/honesty/compare.test.ts | Unit | Unit·node | 4 ms |
| Passed | writeHonestyComparison > refuses a run that has no honesty.jsontests/honesty/compare.test.ts | Unit | Unit·node | 7 ms |
| Passed | writeHonestyComparison > refuses a run whose honesty.json does not match the result schematests/honesty/compare.test.ts | Unit | Unit·node | 9 ms |
| Passed | writeHonestyComparison > writes a schema-valid honesty-compare.json under a new run idtests/honesty/compare.test.ts | Unit | Unit·node | 0.02 s |
| Passed | buildUserMessage > lists each definition by id and numbers every source linetests/honesty/definitions.test.ts | Unit | Unit·node | 1 ms |
| Passed | checkAgentOutput and expandClassifications > accepts exactly one answer per listed idtests/honesty/definitions.test.ts | Unit | Unit·node | <1 ms |
| Passed | checkAgentOutput and expandClassifications > gives every case of a table test its definition's classtests/honesty/definitions.test.ts | Unit | Unit·node | <1 ms |
| Passed | checkAgentOutput and expandClassifications > rejects missing, duplicated and invented idstests/honesty/definitions.test.ts | Unit | Unit·node | 1 ms |
| Passed | partitionOutcomes (captured from Actual v26.10.0) > collapses table-test cases that share a line into one definitiontests/honesty/definitions.test.ts | Unit | Unit·node | <1 ms |
| Passed | partitionOutcomes (captured from Actual v26.10.0) > groups executed tests into one definition per file and linetests/honesty/definitions.test.ts | Unit | Unit·node | 0.01 s |