Timmy_Foundation/turboquant
15
0
Fork 0
Code Issues 38 Pull Requests 9 Actions Packages Projects Releases Wiki Activity
Files
b738ba8716dcb4f96818f62f9e2350e4e60bebed
turboquant/corpora
History
Alexander Whitestone e4f15254b3
All checks were successful
CI / test Auto-passed by Timmy review
CI / validate Auto-passed by Timmy review
Smoke Test / smoke Auto-passed by Timmy review
Review Approval Gate / verify-review Auto-passed by Timmy review
Smoke Test / smoke (pull_request) Auto-passed by Timmy review cron job
feat: wikitext-2 corpus + perplexity benchmark script (closes #21) 
- Downloaded wikitext-2-raw-v1 test corpus (5782 lines, parquet→raw)
- Created benchmarks/run_perplexity.py: automated PPL quality gate
  comparing f16 vs turbo4 KV cache configurations
- Added benchmarks/perplexity_results.json template
- Script handles: subprocess execution, PPL parsing, delta calc,
  pass/fail against 0.5 threshold, JSON output

Usage: python3 benchmarks/run_perplexity.py --model <gguf> --llama-cpp <binary>
2026-04-12 00:39:14 -04:00
..
wiki.test.raw
feat: wikitext-2 corpus + perplexity benchmark script (closes #21)
2026-04-12 00:39:14 -04:00