Skip to content
testpulse
Passed

Run 38616740519

Branch
main
Commit
a4485c4
Event
workflow_dispatch
Started
Reports
1
Tests
64
Passed
64
Failed
0
Skipped
0
Duration
0 s

Reports in this run

StatusJob / module / platformResultsTestsReceivedTime
Passedtest/atpr/node64 passed640 s

Results

Failures first, then by suite
DetailsStatusTestLayerPlatformTime
PassedparseRunArgs > expands --measures all to every measure in spec ordertests/cli.test.tsUnitUnitnode3 ms
PassedparseRunArgs > parses a diff range between two tagstests/cli.test.tsUnitUnitnode<1 ms
PassedparseRunArgs > rejects a diff range with a missing endtests/cli.test.tsUnitUnitnode1 ms
PassedparseRunArgs > rejects an unknown measuretests/cli.test.tsUnitUnitnode1 ms
PassedparseRunArgs > rejects anything other than the run commandtests/cli.test.tsUnitUnitnode<1 ms
PassedparseRunArgs > requires a tag so runs never default to a floating reftests/cli.test.tsUnitUnitnode<1 ms
Passedrun > fails and logs each requested measure that is not implemented yettests/cli.test.tsUnitUnitnode0.02 s
Passedrun > fails the run when a measure's result does not match its schematests/cli.test.tsUnitUnitnode8 ms
Passedrun > refuses to start against a tag that is not pinnedtests/cli.test.tsUnitUnitnode6 ms
Passedrun > writes a measure's result beside the run log after checking it against the measure's schematests/cli.test.tsUnitUnitnode8 ms
PassedclassifyFile > fails the file after three bad answers instead of guessingtests/honesty/classifier.test.tsUnitUnitnode1 ms
PassedclassifyFile > retries an answer that skips a test, and adds up the usage of every attempttests/honesty/classifier.test.tsUnitUnitnode<1 ms
PassedclassifyFile > sends the versioned prompt as the system prompt and returns a valid answertests/honesty/classifier.test.tsUnitUnitnode2 ms
Passedprompts > changes the hash when anything in the file changes, header includedtests/honesty/classifier.test.tsUnitUnitnode2 ms
Passedprompts > loads the committed honesty prompt with its version and a hash of the whole filetests/honesty/classifier.test.tsUnitUnitnode4 ms
Passedprompts > refuses a prompt with no version header or the wrong nametests/honesty/classifier.test.tsUnitUnitnode2 ms
PassedbuildUserMessage > lists each definition by id and numbers every source linetests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedcheckAgentOutput and expandClassifications > accepts exactly one answer per listed idtests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedcheckAgentOutput and expandClassifications > gives every case of a table test its definition's classtests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedcheckAgentOutput and expandClassifications > rejects missing, duplicated and invented idstests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > collapses table-test cases that share a line into one definitiontests/honesty/definitions.test.tsUnitUnitnode<1 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > groups executed tests into one definition per file and linetests/honesty/definitions.test.tsUnitUnitnode8 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > marks runner-skipped tests unreachable without asking the agenttests/honesty/definitions.test.tsUnitUnitnode5 ms
PassedpartitionOutcomes (captured from Actual v26.10.0) > refuses outcomes without a line, because classifications are keyed by file and linetests/honesty/definitions.test.tsUnitUnitnode1 ms
Passedsampling > is reproducible from the seed and differs between seedstests/honesty/spotcheck.test.tsUnitUnitnode0.01 s
Passedsampling > samples each table test once and never samples runner-decided teststests/honesty/spotcheck.test.tsUnitUnitnode1 ms
Passedsampling > takes 10%, at least 40, and never more than existtests/honesty/spotcheck.test.tsUnitUnitnode<1 ms
Passedspot-check files > never overwrites an existing formtests/honesty/spotcheck.test.tsUnitUnitnode6 ms
Passedspot-check files > refuses to score an unfinished formtests/honesty/spotcheck.test.tsUnitUnitnode8 ms
Passedspot-check files > rejects a class that is not one of the fourtests/honesty/spotcheck.test.tsUnitUnitnode<1 ms
Passedspot-check files > scores a filled form into an agreement rate and confusion matrix, oncetests/honesty/spotcheck.test.tsUnitUnitnode0.01 s
Passedspot-check files > writes a blind form: no agent class or justification appears in ittests/honesty/spotcheck.test.tsUnitUnitnode0.03 s
Passedsummarize > leaves unreachable tests out of the honesty ratio and marks it unverifiedtests/honesty/spotcheck.test.tsUnitUnitnode4 ms
Passedcoverage (captured from Actual v26.10.0) > adds hit counts across configs, so a line hit by either config is coveredtests/inventory/coverage-and-e2e.test.tsUnitUnitnode1 ms
Passedcoverage (captured from Actual v26.10.0) > counts each config on its owntests/inventory/coverage-and-e2e.test.tsUnitUnitnode6 ms
Passedcoverage (captured from Actual v26.10.0) > refuses to merge a file whose statement map differs between configstests/inventory/coverage-and-e2e.test.tsUnitUnitnode1 ms
PassedreadPlaywrightRun (captured from Actual v26.10.0) > lists a test that only passed on retry as flaky, and a failing one as failedtests/inventory/coverage-and-e2e.test.tsUnitUnitnode1 ms
PassedreadPlaywrightRun (captured from Actual v26.10.0) > reads runtime, workers and outcome counts from a full runtests/inventory/coverage-and-e2e.test.tsUnitUnitnode6 ms
PassedfindInconsistentTests > does not flag a test that fails every timetests/inventory/parsers.test.tsUnitUnitnode<1 ms
PassedfindInconsistentTests > flags a test that is missing from one runtests/inventory/parsers.test.tsUnitUnitnode<1 ms
PassedfindInconsistentTests > flags a test that passes in one run and fails in anothertests/inventory/parsers.test.tsUnitUnitnode1 ms
Passedmarkers > counts both screenshot assertion styles used by the targettests/inventory/parsers.test.tsUnitUnitnode1 ms
Passedmarkers > finds per-test retry options and ignores commentstests/inventory/parsers.test.tsUnitUnitnode1 ms
PassedreadPlaywrightList (captured from Actual v26.10.0) > counts 145 tests in 22 files with the config-level retrytests/inventory/parsers.test.tsUnitUnitnode9 ms
PassedreadPlaywrightList (captured from Actual v26.10.0) > treats a test.skip or test.fixme annotation as statically skippedtests/inventory/parsers.test.tsUnitUnitnode1 ms
PassedreadVitestReport (captured from Actual v26.10.0) > reads every test with a package-relative file and its linetests/inventory/parsers.test.tsUnitUnitnode8 ms
PassedreadVitestReport (captured from Actual v26.10.0) > reports the two skipped sync property tests with their locationstests/inventory/parsers.test.tsUnitUnitnode1 ms
PassedsummarizeWorkflowRuns (captured for the v26.10.0 commit) > records the conclusion when a test workflow did runtests/inventory/parsers.test.tsUnitUnitnode2 ms
PassedsummarizeWorkflowRuns (captured for the v26.10.0 commit) > reports that neither test workflow ran on the release committests/inventory/parsers.test.tsUnitUnitnode3 ms
PassedwriteResult > refuses to write a result that does not match its schematests/measure.test.tsUnitUnitnode2 ms