testing.FlatTestReport

Aggregated, already-flattened report returned to the CLI driver.

Reference version

Signature

class testing.FlatTestReport

Aggregated, already-flattened report returned to the CLI driver.

outcome is the aggregate verdict (honors testset runners). Counts are leaf-level: failed = hard failures, tolerated = failing leaves whose enclosing testset runner still passed (e.g. under PassRate), passed and total as usual. failed_names are the hard-failure names; messages are every failing run's message. The three name arrays partition selected leaf IDs by their actual outcome after applying testset-runner tolerance.

Source:<builtin>/testing/types.bamlbytes 35754311

Fields

passed

int

failed

int

tolerated

int

total

int

passed_names

string[]

failed_names

string[]

tolerated_names

string[]

passed_ms

int[]

Per-leaf durations, parallel to the matching name array, when the executed child partition supplied them; EMPTY when the identities came from fallback selection/failure correlation (durations unknown there). -1 marks an individual leaf with no measured run (an expansion failure sentinel). Consumers must treat a shorter-than-names array as "no duration for the tail", never index blindly.

failed_ms

int[]

tolerated_ms

int[]

messages

string[]