ProofRun is a new open-source tool that cryptographically binds test results to specific code states, ensuring developers can verify if their software tests remain valid after changes.
Key Points
- ProofRun uses HMAC-SHA256 signatures to link test outcomes to a specific git commit and file fingerprint.
- The tool categorizes test statuses as PASS, FAIL, STALE, or NOT RUN, automatically flagging results as STALE if code changes occur.
- It operates entirely offline without telemetry, relying on real subprocess execution rather than AI-based inference or string matching.
- The project includes a GitHub Action that independently re-runs tests to prevent reliance on potentially tampered local receipt files.
- ProofRun is designed to hold AI coding agents accountable by ensuring their claims of passing tests are backed by verifiable, recent execution data.