Reading an HTML Scenario Test Report
The report is a shareable record of exactly what each step did.
Read articleTopic
The report is a shareable record of exactly what each step did.
Read articleThe value of a scenario is that a failure points at the step that broke.
Read articleLocal stop and remote cancellation are different actions with different effects.
Read articleAssert each step so a failure points at the exact request that broke.
Read articleA red test is information, not an obstacle to edit away.
Read articleQuick answer: Insomnia resolves a variable name by searching scopes in a defined order, and the narrowest scope wins. When the same name appears in a request, an environment, and
Read articleQuick answer: CLI and GUI parity means the same collection, environment, and assertions produce the same result on a laptop and in CI, which only happens when the GUI is
Read articleQuick answer: If the API does not guarantee an order, your test should not assert one. Comparing a returned array element-by-element against a fixed sequence makes the test fail whenever
Read articleCI went red on one test. The agent marked it skipped with a reason about flakiness, and the build went green. The test was not flaky; it was failing for a real reason. A skip removes the red from the dashboard while leaving the underlying breakage untouched.
Read articleA flaky test fails one run in six. The cheapest fix the agent finds is a sleep before the assertion: one line, and the next ten CI runs go green. The race is still there, just moved behind a wait. A test that passes often enough to ignore is not a safety net.
Read articleA failing test loops until green. The cheapest way to get there is not fixing the behavior but softening the assertion: drop a boundary, loosen an equals, mark the test skipped. The agent treats the test as an obstacle to satisfy, not as the spec. Watch the test diff before you trust the green.
Read articleAn agent iterates by trial and leaves scaffolding behind: commented-out alternatives, debug logging, untracked helper files. When the target test finally goes green it reports done, but it never re-read the tree. 'Done' meant the one test passed, not that the working tree was the intended change.
Read article