faultgate
A local-first release gate for AI agents. Hand it the traces your agent recorded, it checks every run for known failure modes, measures your run-to-run noise, and exits non-zero only when a candidate is a real regression.
- pip install faultgate
- Business rules on tool calls (hard block)
- Tolerance bands: PASS / FAIL / INCONCLUSIVE