Skip to content
lube

Test intelligence

8 formatsFlakinessRegressions

See the pattern behind a failing test.

Ingest results from any runner, track each test as a stable identity across runs, and let three independent flakiness signals tell a real failure from a flaky one.

  • checkout.spec
  • auth.spec
  • billing.spec
  • search.spec
pass flake fail
Outcomes across recent runs

Its place in the loop

Tests verify the work coming out of Engineering.

One connected loop, held on the stage this capability serves. The other stages stay as context so you can see what feeds in and what comes next.

BD
Discovery
Feedback
Product
Engineering
Release
Reliability
Evidence

Stage inventory

Engineering

Build and verify the change.

VCS insights

Inspect delivery workflow activity in the connected release workspace.

Available now

Test intelligence

Investigate test outcomes and flakiness evidence across runs.

Available now

API Explorer

Keep supported API contracts inspectable alongside release evidence.

Available now

Compute pricing

Compare public cloud compute pricing as planning evidence.

Available now

Coming later reflects product vision, not a delivery commitment.

Flakiness, shown not stated

A flaky test flips pass to fail on the same commit.

Watch one test flap between pass and fail while everything around it stays green. That non-determinism is exactly what the three flakiness signals catch.

latest run · per test

history → latest
  • checkout.spece2estable
  • auth.spec · token refreshintegrationflaky
  • search.specunitstable
  • billing.specintegrationstable
Latest result, per test

Ingest, identify, then detect

A single red build rarely tells the whole story.

Suite timing

Find the long pole in the run.

Every suite's duration fills to scale as the run is measured, and the slowest one is flagged so the bottleneck is obvious.

p50 / p95 / maxslowest flaggedper suite

suite duration

4m 12s
  • e2e checkout2m 41sslowest
  • integration1m 08s
  • unit38s
  • smoke12s
Suite duration this run

Flakiness signals

Three signals, not one guess.

Rerun, alternation, and windowed instability each catch a different shape of flake, so a test that only passes on retry and one that flips between runs are both caught.

rerunalternationwindowed
  • rerun signal
  • alternation
  • windowed
pass flake fail
auth.spec, flagged flaky

Regressions

A regression inbox, not a wall of logs.

A test that failed today but passed yesterday opens one entry per test-day with a resolve lifecycle, so new breakage is separated from old noise.

failed todayresolve lifecycleone per test-day
  • billing.spec · tax roundingnew
  • auth.spec · token refreshflaky
  • search.spec · rankingresolved
Regression inbox

An honest limit

Test intelligence is reporting, not a test runner. Raw per-test rows are kept for 7 days while daily and monthly aggregates persist, and there is no quarantine, CI gating, or code-coverage ingestion here.

Connected context

See what a test result belongs to.

Stop re-investigating the same flaky test.

Start free

Ingest results from your supported CI.