# Echo Benchmark Analyst-Style Set

Nine original, light editorial benchmark cards designed for Echo publication work. The visual language uses analytical dashboard conventions—white panels, vertical bars, compact tabs, and direct methodological notes—without copying another publisher's branding.

## Card order

1. `EchoAnalyst-01-Highlights.png` — comparable WER, whole-run speed, and API-fee context.
2. `EchoAnalyst-02-CommonWER.png` — Echo's directly comparable 100-clip public-audio track.
3. `EchoAnalyst-03-Difficulty.png` — clean versus harder public-audio slices.
4. `EchoAnalyst-04-Speed.png` — model-only and whole-run timings kept separate.
5. `EchoAnalyst-05-PublishedShort.png` — upstream short-form ASR context.
6. `EchoAnalyst-06-PublishedLong.png` — upstream long-form ASR context.
7. `EchoAnalyst-07-Cloud.png` — full AA-WER cloud context plus Echo's separately labeled public-subset reconstruction.
8. `EchoAnalyst-08-Meetings.png` — measured local meeting-intelligence gates.
9. `EchoAnalyst-09-Evidence.png` — evidence status and current release limitations.

## Publication rules

- Compare model results only when the dataset, subset, normalization, hardware, and timing boundary match.
- Echo's 100-clip common track is a sampled public-audio comparison, not a full benchmark-suite result.
- The generated Echo benchmark is a separate protocol and must not be mixed numerically with the common track.
- Published model-card and independent-lab scores are contextual evidence, not measurements of the Echo app.
- A local `$0 API fee` does not mean zero hardware, electricity, development, or ownership cost.
- Echo measured 6.19% on the complete released public half of AA-WER v2: 628
  VoxPopuli-Cleaned-AA samples and six Earnings22-Cleaned-AA parent calls.
- Call this the `AA-WER v2 public-subset reconstruction`, never an official
  AA-WER score. AA-AgentTalk is proprietary, represents 50% of the official
  score, and was not available. The full current AA custom normalizer is also
  unpublished.
- Do not claim model-weight fine-tuning. Echo's vocabulary and spoken-command layer is deterministic text processing.
- Do not describe the current build as production-proven: automatic-delivery evidence is incomplete and the personal-microphone protocol remains 0/10.

Read `BENCHMARK_TRUTH_CLAIMS.md` before using any card in a public article, carousel, or video.
