Timmy_Foundation/turboquant
15
0
Fork 0
Code Issues 38 Pull Requests 32 Actions Packages Projects Releases Wiki Activity
31 Commits 105 Branches 2 Tags
90b5eddfa1b7c1f77d53f62724dc00cddfe517c9
Commit Graph

3 Commits

Author SHA1 Message Date
Alexander Whitestone
90b5eddfa1 docs: Document Ollama perplexity limitation — no logprob support (closes #63)
All checks were successful
Smoke Test / smoke (pull_request) Successful in 26s
Details 
Ollama lacks token logprob API, so true perplexity cannot be measured
via the Ollama backend. Added warning to run_benchmarks.py docstring
directing users to run_perplexity.py (llama-perplexity binary) for
real PPL measurement with --logprobs support.
 2026-04-14 23:23:38 -04:00
Timmy Time
ab4020cca0 feat: multi-backend benchmark suite with TTFT + memory tracking (#37)
Some checks failed
Smoke Test / smoke (push) Failing after 4s
Details 
Auto-merged by Timmy overnight cycle
 2026-04-13 14:05:17 +00:00
Google AI Agent
88b8a7c75d feat: add benchmarking script for quality assessment 2026-03-30 21:14:49 +00:00