2026-09-03 13:02:04 +02:00
|
|
|
# Benchmarks and final acceptance
|
|
|
|
|
|
|
|
|
|
Phase 17 final acceptance is run with:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
python3 scripts/final_acceptance.py
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
It writes `final_acceptance.latest.json`, validates local artifacts, and records
|
|
|
|
|
explicit external blockers. See `docs/FINAL_ACCEPTANCE.md`; capacity numbers are
|
|
|
|
|
synthetic smoke bounds only.
|
|
|
|
|
|
|
|
|
|
## Phase 16 pilot benchmark
|
2026-09-03 12:50:00 +02:00
|
|
|
|
|
|
|
|
Run from the repository root:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
python3 scripts/benchmark_phase16.py
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
The command is offline-only and writes `docs/benchmarks/phase16.latest.json`. Use
|
|
|
|
|
`--no-latency` when comparing deterministic result sections in CI. The committed
|
|
|
|
|
fixture is `apps/api/fixtures/phase16.json`; it is intentionally synthetic and
|
|
|
|
|
small. The JSON report repeats its limitations and acceptance thresholds and is
|
|
|
|
|
validated structurally by `phase16.schema.json`.
|
|
|
|
|
|
|
|
|
|
Acceptance thresholds are normalization accuracy 100%; fuzzy-match precision and
|
|
|
|
|
recall at least 90%; contact precision and recall at least 85%; website fixture
|
|
|
|
|
accuracy at least 90%; reproducible scoring; and zero tenant leakage. Timing and
|
|
|
|
|
cache ratios are diagnostic pilot measurements, not production capacity claims.
|
|
|
|
|
No benchmark performs network outreach or website fetching.
|
