nsalerni commited on
Commit
4e0dba9
·
verified ·
1 Parent(s): b3b805e

docs: refresh benchmark scores (99.4% expanded quality)

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -30,12 +30,12 @@ Surgical refine on expanded-benchmark failures (browser commands, OOD retail/dev
30
  |------|----|----|---|
31
  | Core hard eval (117) | 100% | **100%** | — |
32
  | Core held-out (27) | 100% | **100%** | — |
33
- | Expanded hard (170) | 97.1% | **98.2%** | +1.1% |
34
  | Expanded held-out (39) | 97.4% | **100%** | +2.6% |
35
  | Generalization suite | 91.4% | **97.1%** | +5.7% |
36
- | p50 latency | ~1072ms | ~1066ms | ~same |
37
 
38
- **Zero regressions** vs v1 on the 170-case expanded set.
39
 
40
  ## Quick start (MLX, Apple Silicon)
41
 
 
30
  |------|----|----|---|
31
  | Core hard eval (117) | 100% | **100%** | — |
32
  | Core held-out (27) | 100% | **100%** | — |
33
+ | Expanded hard quality (170) | 98.2% | **99.4%** | +1.2% |
34
  | Expanded held-out (39) | 97.4% | **100%** | +2.6% |
35
  | Generalization suite | 91.4% | **97.1%** | +5.7% |
36
+ | Core p50 latency | ~1028ms | **~1002ms** | ~same |
37
 
38
+ Hard quality = task accuracy excluding latency SLA. v3 is the only variant that passes both production gates (100% core, ≥99% expanded quality).
39
 
40
  ## Quick start (MLX, Apple Silicon)
41