Timmy b31cd93148 feat: Full test matrix — 10 prompts + quality + performance (#11) ...

10 practical prompts across 6 categories (factual, code, reasoning,
long-form, summarization, math). Quality evaluation via pattern match.
Performance via tok/s, TTFT, memory. Go/no-go decision at 90% pass rate.

Closes #11.

2026-04-14 22:03:29 -04:00

..

perplexity_results.json

feat: wikitext-2 corpus + perplexity benchmark script (closes #21)

2026-04-12 00:39:14 -04:00

prompts.json

feat: add standardized benchmarking prompts

2026-03-30 21:14:48 +00:00

run_benchmarks.py

feat: multi-backend benchmark suite with TTFT + memory tracking (#37)

2026-04-13 14:05:17 +00:00

run_long_session.py

burn: add long-session quality test (Issue #12) (#39)

2026-04-13 19:59:22 +00:00

run_perplexity.py

feat: wikitext-2 corpus + perplexity benchmark script (closes #21)

2026-04-12 00:39:14 -04:00

test_matrix.py

feat: Full test matrix — 10 prompts + quality + performance (#11)

2026-04-14 22:03:29 -04:00

test_prompts.json

Add benchmark test prompts for quality comparison (Issue #22)

2026-03-31 17:31:05 +00:00