Beyond Green

Your tests passed.
We check what they missed.

Claim 1

A green test can hide a destroyed row.

upstream test
PASSED
archive request
POST /bookmarks/action → 200
screenshots
byte-identical
bookmarks, healthy
9 → 9
bookmarks, defective
9 → 8

One line changes: archiving deletes instead of hiding. The tile stays green.

Claim 2

Their own test looks straight past it.

get_by_text("Archive").click()

assertVisibleBookmarks(["1","3"])
assertVisibleTags([...])
assertReloads(0)
get_by_text("Remove").click()

assertVisibleBookmarks(["1","3"])
assertVisibleTags([...])
assertReloads(0)

Two operations whose whole difference is whether the data survives. Identical assertions.

Claim 3

So we investigate after the test passes.

A Scout proposes. A Critic attacks it and picks what to read. An Investigator revises. A Verifier rules, and can veto.

Walk the real trace in 3D →
Claim 4

It has to earn the right to answer.

  1. 1Scoutunknown · 0.57
  2. 2Criticinsufficient → database_state
  3. 4Investigatorsuspected · 0.62
  4. 5Criticsupported · 0.31 → keeps going
  5. 7Investigatorsuspected · 0.98
  6. 9Verifierregression · 0.98

Step 5: it agreed, at 0.31. Below the bar, so it fetched the contract instead of concluding.

Claim 5

Zero wrong verdicts in 24 investigations.

Two runs eachTypeSafeDeepSeek
Correct4/6 · 4/66/6 · 6/6
Wrong0 · 00 · 0
False positives0 · 00 · 0
Latency5.3–6.1 s78.8–92.5 s

Every failure is a refusal, never a wrong answer.

Claim 6

Cheap enough to run on every green test.

$0.14250 tests investigated
$0.07our entire two-day build
Claim 7

The cheap model gives up. It never guesses.

PolicyCorrect250 tests
TypeSafe alone8 / 12$0.14
Cascade12 / 12$5.36
DeepSeek alone12 / 12$15.67

Escalate only the refusals. Two thirds of the work never pays the higher rate.

Claim 8

We reproduced a real bug nobody designed for us.

Documenso #2485DefectiveFixed
Upstream tests2 passed2 passed
Rows claiming a send20
Emails actually sent00

A user-reported bug that shipped. Its own test loads the corrupted row and asserts the wrong two columns.

Claim 9

The contract is the ceiling, not the loop.

CaptureTypeSafeDeepSeek
Defectiveabstainsregression
Fixed controlabstainsregression

Neither separates the builds. DeepSeek flagged the fixed one too, so its finding is not a detection. Only the control caught that.

Your tests passed.
We check what they missed.

github.com/SashaSkind/safeci

Two notes on jev-1.13.0 →
← → to move

This deck needs WebGL.

Open the flat version at index.html instead.