Research note ยท November 2, 2026

Tools that quietly ignore a misnamed argument give quiet wrong answers.

300 places in 118 of 485 files

What we did

One of our tools read its input with default values and never checked which keys arrived. A key named "type" went unread, and 5 claims were stored as unverified.

What we found

The tool now reports the keys it ignored. A scanner found the same shape in 300 places across 118 of 485 files. The test runs both ways: the old version is flagged, the fixed one isn't.

What it means

Every tool an AI calls should say what it didn't use. Silence looks like success.

Source: Commit e5e5098c.