Ω Omega Protocol Bring us a question
MEASURED

Finding · verify

A proposed analytic gradient for a quantum-chemistry method matched independently computed finite differences in 22 of 22 cells; the released code path failed in 22 of 22. One of the referee's own thresholds fired on both arms alike and was reported as an instrument defect.

The system said
Gradient implemented; the author's one test molecule agreed with finite differences.
The evidence showed
Agreement on 11 molecules and two methods to the conventional floor; the released path wrong in all 22 cells; one of the referee's own thresholds found sitting below the library's floor by running it on the reference arm.
§ 1

The record

FINDING · pyscf-df-ccsd-gradient-matches-finite-differencesverify · hidden trusted base
A proposed analytic gradient for a quantum-chemistry method matched independently computed finite differences in 22 of 22 cells; the released code path failed in 22 of 22. One of the referee's own thresholds fired on both arms alike and was reported as an instrument defect.
Claim
PySCF pull request #3426 (density-fitted CCSD and CCSD(T) analytic nuclear gradients) agrees with central finite differences of PySCF's own density-fitted energy to at most 2.5e-7 Ha/Bohr on 11 molecules for both methods, indistinguishable from the conventional-integral floor; the release code path differs by 8.9e-6 to 1.3e-4 Ha/Bohr on every cell; disabling auxiliary-basis response breaks translational invariance by 5e-5 to 1.1e-3. A pre-registered rotational-invariance threshold of 1e-8 fired on both the pull request and the established path to within 1%, and was recorded as an instrument defect, not a defect in the pull request.
Status
MEASURED Empirical, with a stated sample.
Question
Passed is not correct
Subject
PySCF, an open-source quantum chemistry library, and pull request #3426, merged on 14 September 2026 (third-party system); the finite-difference referee is Omega's and its evidence was not posted upstream. third-party subject
Frame
11 molecules, CCSD and CCSD(T), 77 jobs; three finite-difference steps Richardson-combined; the pull-request environment is the 2.14.0 wheel plus the pull request's diff.
Method
Three invariants pre-registered with thresholds (finite-difference agreement, translational invariance, rotational invariance); four arms (pull request, release path, pull request without auxiliary response, conventional floor); the referee recomputes every gradient from raw energies with explicit loops and no library import.
Oracle
Central finite differences of the density-fitted energy, with the second-order step ratio checked in every cell.
Negative control
Present The release path had to fail agreement (22 of 22 did); the no-auxiliary-response arm had to break the sum rules (22 of 22 did); a 5e-6 perturbation had to be detected (11 of 11 was); the two environments had to give identical reference energies (11 of 11 did).
Denominator
22 of 22 cells agree to 2.5e-7 Ha/Bohr or better; 22 of 22 release-path cells fail; 11 molecules; 77 jobs.
Preregistration
Design, cells, thresholds and controls frozen before any trial; one driver defect before the first trial and the post-falsifier exploratory runs logged as deviations and kept out of every table.
Limitation
Agreement on 11 molecules establishes agreement on those 11 molecules. Not tested: open-shell references, periodic systems, symmetry-adapted molecules, systems larger than six atoms, auxiliary bases beyond the two used, or the geometry-optimiser path. The finite-difference referee differentiates the same energy code the pull request differentiates, so it establishes consistency with that code, not agreement with an external truth. The origin of the shared 1e-7 rotational residual is not identified. The evidence has not been posted to the pull request; this is an internal Omega record.
Source
artifact not public
Reproduce
not reproducible from a public clone
Independent reproduction
None known.
§ 2

Where this sits

This finding answers Passed is not correct and supports the VERIFY stage of the operating method. It is an instance of the hidden trusted base mechanism.

Evidence ledgerBring us a problem