[HOME] Implement Local Model Performance Benchmarking Suite #464
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Develop a suite of standardized tasks to benchmark local model performance (tokens/sec, latency, quality) on different hardware.