Ω Omega Protocol Bring us a question
OBSERVED

Finding · verify

A compiled PyTorch function returned a result computed for a different object state, with no recompilation, where the uncompiled function returned the right one. The investigation was carried out by a locally hosted model with nothing leaving the machine.

The system said
Compiled. No recompilation. The run completed.
The evidence showed
The compiled result belonged to an object state that no longer held; eager was right. Confirmed by an evaluator that recomputed both, on a machine nothing left.
§ 1

The record

FINDING · torchdynamo-compiled-result-stale-under-instance-changeverify · hidden trusted base
A compiled PyTorch function returned a result computed for a different object state, with no recompilation, where the uncompiled function returned the right one. The investigation was carried out by a locally hosted model with nothing leaving the machine.
Claim
On a frozen reproduction of PyTorch issue #196127, torch.compile constant-folded an isinstance check against a runtime-checkable data-member Protocol without guarding the attribute it read, so a compiled function reused its cached result after an object gained an instance attribute, and gave the same stale answer for two instances of one class that differed in that attribute, while eager execution was correct in both. A frozen evaluator that recomputed eager and compiled results itself confirmed both per-instance cases and two controls, and a hidden seven-cell matrix re-run after the run confirmed the phenomenon. The investigating worker was a locally hosted 27-billion-parameter open-weight model at temperature 0 with no network access and no human or frontier-model message during the run.
Status
OBSERVED Witnessed in one instance. No claim about how often.
Question
Passed is not correct
Subject
PyTorch's TorchDynamo compiler on a frozen reproduction of open issue #196127 (third-party system); the harness, evaluator and controls are Omega's. third-party subject
Frame
One pinned PyTorch build; one frozen task; one local worker run at temperature 0, 48 of 100 turns used; a hidden seven-cell matrix withheld from the worker.
Method
The worker constructs cases and an eager-versus-compiled oracle; a frozen evaluator recomputes eager, compiled and the recompilation counter for every submitted case and classifies the driver of any divergence; design and evidence sealed by hash before inference and re-verified after.
Oracle
Eager execution of the same function on the same inputs, recomputed by the evaluator, never taken from the worker's report.
Negative control
Present Two control cases that must not diverge did not; the hidden matrix's class-mutation cell had to be rejected by the evaluator and was; 0 hidden-matrix tokens appeared in the worker's trajectory; both seals re-verified after the run.
Denominator
2 evaluator-confirmed per-instance stale cases and 2 correct controls in the scored run; 7 of 7 hidden-matrix cells behaved as frozen; containment 47 of 47 checks.
Preregistration
Task, evaluator, hidden matrix and success bar frozen and hashed before inference; the bar was tightened from an earlier run before, not after, this one.
Limitation
One issue, one pinned build, one run. Nothing about the inductor backend, unions, method-bearing protocols, larger programs or the second scored call order. The upstream issue was already open and is not Omega's discovery; nothing was posted to it and no fix was proposed. The worker's own directional claim about which call order recompiles is unscored, conflicts with the hidden matrix, and is not evidence; its empty list of untested dimensions overstates completeness. No root cause was verified in the compiler's source. The result is a fact about this task, not a general capability of the local model.
Source
artifact not public
Reproduce
not reproducible from a public clone
Independent reproduction
None known.
§ 2

Where this sits

This finding answers Passed is not correct and supports the VERIFY stage of the operating method. It is an instance of the hidden trusted base mechanism.

Evidence ledgerBring us a problem