Capabilities
What the conformance suite (SPEC 9.6, D-0020) observed for each pinned harness version. Each cell is one fault type on one capability class, probed 3 times. A fault type enters the parity set when every class the harness exposes passes every run, except classes recorded as parity gaps.
The payload reached the model and the side-effect check held in every run.
A reviewed parity gap: the harness does not deliver this type on this class. The reason is listed below.
No tool on the harness maps to the class, so conformance skipped it.
No harness has this type on this class: the fault catalog does not apply it there.
claude-code 2.1.289
fail open: with an injector build that throws on load, the probe shell call returned its real output
7.344 ms
deny, err, empty, trunc, falsefail, poison
Bash → shell, Edit → fs.edit, Read → fs.read, Write → fs.write
| Type | fs.read | fs.write | fs.edit | fs.search | fs.list | shell |
|---|---|---|---|---|---|---|
| deny | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | not tested | delivered 3/3 |
| err | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | not tested | delivered 3/3 |
| empty | delivered 3/3 | gap 0/3 | gap 0/3 | not tested | not tested | delivered 3/3 |
| trunc | delivered 3/3 | n/a | n/a | not tested | not tested | delivered 3/3 |
| falsefail | n/a | delivered 3/3 | delivered 3/3 | n/a | n/a | n/a |
| poison | delivered 3/3 | n/a | n/a | not tested | n/a | n/a |
Parity gaps
empty on fs.edit: mapper renders a fixed success lineempty on fs.write: mapper renders a fixed success line
Generated 2026-10-10T21:11:27Z. Source: capabilities/claude-code@2.1.289.json
opencode 1.18.35
fail open: with an injector build that throws on load, the probe shell call returned its real output
4.806 ms
deny, err, empty, trunc, falsefail, poison
bash → shell, edit → fs.edit, grep → fs.search, read → fs.read, write → fs.write
| Type | fs.read | fs.write | fs.edit | fs.search | fs.list | shell |
|---|---|---|---|---|---|---|
| deny | delivered 3/3 | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | delivered 3/3 |
| err | delivered 3/3 | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | delivered 3/3 |
| empty | delivered 3/3 | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | delivered 3/3 |
| trunc | delivered 3/3 | n/a | n/a | delivered 3/3 | not tested | delivered 3/3 |
| falsefail | n/a | delivered 3/3 | delivered 3/3 | n/a | n/a | n/a |
| poison | delivered 3/3 | n/a | n/a | delivered 3/3 | n/a | n/a |
Parity gaps
None recorded.
Generated 2026-10-11T00:58:49Z. Source: capabilities/opencode@1.18.35.json
pi 1.0.3
fail closed: with an injector build that throws on load, the probe shell call did not return its real output
5.687 ms
deny, err, empty, trunc, falsefail, poison
bash → shell, edit → fs.edit, read → fs.read, write → fs.write
| Type | fs.read | fs.write | fs.edit | fs.search | fs.list | shell |
|---|---|---|---|---|---|---|
| deny | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | not tested | delivered 3/3 |
| err | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | not tested | delivered 3/3 |
| empty | delivered 3/3 | delivered 3/3 | delivered 3/3 | not tested | not tested | delivered 3/3 |
| trunc | delivered 3/3 | n/a | n/a | not tested | not tested | delivered 3/3 |
| falsefail | n/a | delivered 3/3 | delivered 3/3 | n/a | n/a | n/a |
| poison | delivered 3/3 | n/a | n/a | not tested | n/a | n/a |
Parity gaps
None recorded.
Generated 2026-10-10T21:01:39Z. Source: capabilities/pi@1.0.3.json