Skip to content
testpulse
Passed

Run 39261291726

Branch
main
Commit
c9b74e7
Event
schedule
Started
Reports
1
Tests
92
Passed
92
Failed
0
Skipped
0
Duration
0 s

Reports in this run

StatusJob / module / platformResultsTestsReceivedTime
Passedtest/atpr/node92 passed920 s

Results

Failures first, then by suite
DetailsStatusTestLayerPlatformTime
Passedcompare > prints the aggregate agreement and the path of the comparison filetests/cli.test.tsUnitUnitnode0.02 s
Passedcompare > refuses a tag that is not pinnedtests/cli.test.tsUnitUnitnode6 ms
PassedparseCompareArgs > rejects anything but compare honestytests/cli.test.tsUnitUnitnode<1 ms
PassedparseCompareArgs > rejects one run or threetests/cli.test.tsUnitUnitnode<1 ms
PassedparseCompareArgs > requires target and tagtests/cli.test.tsUnitUnitnode<1 ms
PassedparseCompareArgs > takes exactly two runs in ordertests/cli.test.tsUnitUnitnode<1 ms
PassedparseRunArgs > expands --measures all to every measure in spec ordertests/cli.test.tsUnitUnitnode3 ms
PassedparseRunArgs > parses a diff range between two tagstests/cli.test.tsUnitUnitnode<1 ms
PassedparseRunArgs > rejects a diff range with a missing endtests/cli.test.tsUnitUnitnode1 ms
PassedparseRunArgs > rejects an unknown measuretests/cli.test.tsUnitUnitnode1 ms
PassedparseRunArgs > rejects anything other than the run commandtests/cli.test.tsUnitUnitnode<1 ms
PassedparseRunArgs > requires a tag so runs never default to a floating reftests/cli.test.tsUnitUnitnode<1 ms
Passedrun > fails and logs each requested measure that is not implemented yettests/cli.test.tsUnitUnitnode0.02 s
Passedrun > fails the run when a measure's result does not match its schematests/cli.test.tsUnitUnitnode7 ms
Passedrun > refuses to start against a tag that is not pinnedtests/cli.test.tsUnitUnitnode5 ms
Passedrun > writes a measure's result beside the run log after checking it against the measure's schematests/cli.test.tsUnitUnitnode7 ms
PassedclassifyFile > fails the file after three bad answers instead of guessingtests/honesty/classifier.test.tsUnitUnitnode1 ms
PassedclassifyFile > retries an answer that skips a test, and adds up the usage of every attempttests/honesty/classifier.test.tsUnitUnitnode<1 ms
PassedclassifyFile > sends the versioned prompt as the system prompt and returns a valid answertests/honesty/classifier.test.tsUnitUnitnode2 ms
Passedprompts > changes the hash when anything in the file changes, header includedtests/honesty/classifier.test.tsUnitUnitnode2 ms
Passedprompts > loads the committed honesty prompt with its version and a hash of the whole filetests/honesty/classifier.test.tsUnitUnitnode4 ms
Passedprompts > refuses a prompt with no version header or the wrong nametests/honesty/classifier.test.tsUnitUnitnode2 ms
PassedcompareHonestyRuns > counts a table test once however many rows it executedtests/honesty/compare.test.tsUnitUnitnode7 ms
PassedcompareHonestyRuns > counts known disagreements into the rate, the confusion matrix and the ratio differencetests/honesty/compare.test.tsUnitUnitnode9 ms
PassedcompareHonestyRuns > gives 100% agreement and no ratio difference for identical runstests/honesty/compare.test.tsUnitUnitnode0.01 s
PassedcompareHonestyRuns > kind > is a changeover when the model differs, recording both valuestests/honesty/compare.test.tsUnitUnitnode3 ms
PassedcompareHonestyRuns > kind > is a repeat when model, effort and prompt hash all matchtests/honesty/compare.test.tsUnitUnitnode3 ms
PassedcompareHonestyRuns > kind > records each of effort and prompt hash that differstests/honesty/compare.test.tsUnitUnitnode3 ms
PassedcompareHonestyRuns > leaves runner-decided unreachable tests out of the agreementtests/honesty/compare.test.tsUnitUnitnode7 ms
PassedcompareHonestyRuns > refuses to compare > a definition whose test names differ between the runstests/honesty/compare.test.tsUnitUnitnode2 ms
PassedcompareHonestyRuns > refuses to compare > a run with itselftests/honesty/compare.test.tsUnitUnitnode1 ms
PassedcompareHonestyRuns > refuses to compare > runs for a different target or tag than the one asked fortests/honesty/compare.test.tsUnitUnitnode1 ms
PassedcompareHonestyRuns > refuses to compare > runs that classified different definitions, listing themtests/honesty/compare.test.tsUnitUnitnode2 ms
PassedcompareHonestyRuns > refuses to compare > runs whose commit differstests/honesty/compare.test.tsUnitUnitnode3 ms
PassedcompareHonestyRuns > refuses to compare > runs whose tag differstests/honesty/compare.test.tsUnitUnitnode3 ms
PassedcompareHonestyRuns > refuses to compare > runs whose target differstests/honesty/compare.test.tsUnitUnitnode2 ms
PassedcompareHonestyRuns > refuses to compare > runs whose unreachable tests differ, listing themtests/honesty/compare.test.tsUnitUnitnode3 ms
PassedcompareHonestyRuns > rounds the agreement rate to 3 decimalstests/honesty/compare.test.tsUnitUnitnode7 ms
PassedrenderComparisonSummary > prints aggregates only: no test names, no per-test classestests/honesty/compare.test.tsUnitUnitnode7 ms
PassedrenderComparisonSummary > says when the comparison is a repeattests/honesty/compare.test.tsUnitUnitnode4 ms
PassedwriteHonestyComparison > refuses a run that has no honesty.jsontests/honesty/compare.test.tsUnitUnitnode6 ms
PassedwriteHonestyComparison > refuses a run whose honesty.json does not match the result schematests/honesty/compare.test.tsUnitUnitnode9 ms
PassedwriteHonestyComparison > writes a schema-valid honesty-compare.json under a new run idtests/honesty/compare.test.tsUnitUnitnode0.02 s
PassedbuildUserMessage > lists each definition by id and numbers every source linetests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedcheckAgentOutput and expandClassifications > accepts exactly one answer per listed idtests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedcheckAgentOutput and expandClassifications > gives every case of a table test its definition's classtests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedcheckAgentOutput and expandClassifications > rejects missing, duplicated and invented idstests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > collapses table-test cases that share a line into one definitiontests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > groups executed tests into one definition per file and linetests/honesty/definitions.test.tsUnitUnitnode8 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > marks runner-skipped tests unreachable without asking the agenttests/honesty/definitions.test.tsUnitUnitnode6 ms
Showing50of92