Automated test-runner wrapper and GitHub Action that intercepts non-deterministic flaky test failures in CI, isolates them with deterministic clock sandboxing, and prevents costly 40-minute matrix rebuilds.
Flaky tests are the #1 source of developer fatigue and CI cloud waste:
- A single race condition or timezone-dependent test fails in a 10-node matrix run.
- The entire build turns red, wasting $50–$300 per day in GitHub Actions compute hours.
- Engineers are forced to re-trigger builds manually, destroying velocity.
ci-flake-quarantine wraps your test runner (pytest, vitest, jest, cargo test). When a failure occurs:
- It automatically intercepts the specific failing test identifier.
- Re-runs it under an isolated deterministic sandbox (
FAKETIME,PYTHONHASHSEED, fixed timezone, mock clock). - If it passes in isolation, it logs the test into
.flake-quarantine.json, reports the flake, and returns exit code0so your PR doesn't fail. - Generates a quarantine health report and audit trail.
pip install ci-flake-quarantine# Wrap your existing pytest command
ci-flake-quarantine run --cmd "pytest tests/"
# Enforce quarantine with max 3 deterministic retries
ci-flake-quarantine run --cmd "pytest -v" --max-retries 3
# View all quarantined tests and their pass/flake ratio
ci-flake-quarantine list
# View quarantine statistics
ci-flake-quarantine stats
# Remove fixed test from quarantine
ci-flake-quarantine remove --test-id "tests/test_api.py::test_race_condition"
# Check license & direct wallet addresses
ci-flake-quarantine licenseAdd this step to your GitHub Actions workflow (.github/workflows/ci.yml):
- name: Run Tests with Flake Quarantine
uses: OrderStream/ci-flake-quarantine@v1
with:
command: "pytest tests/"
quarantine_file: ".flake-quarantine.json"
max_retries: 2
fail_on_quarantine: false| Tier | Price | Repositories | Core Capabilities |
|---|---|---|---|
| Community Free | **** | Unlimited | Standalone CLI runner and single-repo GitHub Action |
| Starter Suite | ** / mo** | Up to 10 Repos | Automated CI PR gates, 500 CI runs/mo, standard email support |
| Team Platform | ,499 / mo | Up to 50 Repos | Full 10-tool OrderStream suite, flaky test quarantine deterministic replay, zero-downtime shadow DB migration guard, 24/7 telemetry alarms |
| Enterprise Platform | ,999 / mo | Unlimited | Multi-repo speculative merge engine, zero-downtime migration orchestrator, WASM sandbox gate, dedicated 24/7 cloud keeper, custom SLA |
| M&A IP & Security Audit | ,000 one-time | Whole Organization | Comprehensive copyleft AST fuzzy fingerprint audit, snippet license sheriff certification, formal invariant verification, and executive forensic IP Cleanliness Certificate |
We believe in open-source sustainability with 0 platform fees. Support this project or purchase enterprise support directly:
- Polar Subscription & Sponsorship: https://polar.sh/orderstream
- Stellar Network (Native XLM / USDC):
- Public Key:
GABFQIK63R2NETJM7T673EAMZN4RJLLGP3OFUEJU5ZVTGWUKULZJNL6 - Memo (Required):
400566831
- Public Key:
- EVM (Base / Arbitrum / Ethereum USDT & USDC):
- Address:
0x5de2b62434754bfd39ef350a3a867ed3eced5074
- Address:
Set your license key via environment variable:
export ORDERSTREAM_LICENSE_KEY="ord_ent_your_license_key"