Timmy (Step35)
d7cfc1db2c
chore: rename regression test file to pytest pattern test_*
Smoke Test / smoke (pull_request) Failing after 12s
2026-04-29 00:15:19 -04:00
Timmy (Step35)
2fca513e26
test: add tool call regression suite with CI gate (issue #96 )
...
Smoke Test / smoke (pull_request) Successful in 11s
Adds comprehensive regression test suite for TurboQuant-compressed models
to verify hermes tool calling functionality remains intact after quantization.
- New test: tests/tool_call_regression.py
* Schema contract tests for 5 core tools (read_file, web_search,
terminal, execute_code, delegate_task)
* Parallel tool calling validation
* Profile configuration validation (TurboQuant settings, server flags)
* Live integration tests (skipped unless TURBOQUANT_SERVER_URL set)
* Results matrix generator (benchmarks/tool-call-regression.md)
* Enforces 95% accuracy threshold via pytest assertion
- New results matrix: benchmarks/tool-call-regression.md
* Markdown table logging model/preset/accuracy/per-tool results
* Auto-updates when tests run with --generate-matrix
- CI gate: .gitea/workflows/smoke.yml
* Runs tool call regression suite on every push/PR
* Live tests will fail pipeline if accuracy drops below 95%
Closes #96
2026-04-29 00:13:35 -04:00
0338cf940a
Merge PR #150 : ci: build standalone CMake target and run ctest in smoke workflow ( #50 )
...
Smoke Test / smoke (push) Has been cancelled
Merged by automated sweep after diff review and verification. PR #150 : ci: build standalone CMake target and run ctest in smoke workflow (#50 )
2026-04-22 02:38:43 +00:00
f3f796fa64
Merge PR #142 : refactor: consolidate hardware optimizer with quant selector ( #92 )
...
Smoke Test / smoke (push) Has been cancelled
Merged by automated sweep after diff review and verification. PR #142 : refactor: consolidate hardware optimizer with quant selector (#92 )
2026-04-22 02:38:38 +00:00
6ab98d65f5
Merge PR #147 : fix(tests): quant_selector quality-order assertion ( #138 , #139 )
...
Smoke Test / smoke (push) Has been cancelled
Merged by automated sweep after diff review and verification. PR #147 : fix(tests): quant_selector quality-order assertion (#138 , #139 )
2026-04-22 02:38:33 +00:00
88a5c48402
ci: build standalone CMake target and run ctest in smoke workflow ( #50 )
Smoke Test / smoke (pull_request) Successful in 16s
2026-04-21 11:39:58 +00:00
Alexander Whitestone
f0f117cdd3
fix(tests): quant_selector quality-order assertion matches design intent ( #138 , #139 )
...
Smoke Test / smoke (pull_request) Successful in 37s
The test `test_levels_ordered_by_quality` asserted strictly descending
`bits_per_channel`, but `q4_0` (4.0 bits) is a non-TurboQuant fallback
placed last regardless of bit width. The design invariant is:
- TurboQuant levels (turbo4→turbo2): ordered by compression_ratio
ascending (more aggressive = more compression)
- Fallback levels (q4_0): placed after all TurboQuant levels as safe
defaults, not part of the quality progression
Changes:
- `test_levels_ordered_by_quality`: Now validates compression_ratio
ordering for TurboQuant levels only, not across fallbacks
- `test_fallback_quant_is_last`: New test ensuring non-TurboQuant
fallbacks always appear after TurboQuant levels
Closes #138
Closes #139 (duplicate)
2026-04-21 07:25:52 -04:00
Alexander Whitestone
a537511652
refactor: consolidate hardware optimizer with quant selector ( #92 )
Smoke Test / smoke (pull_request) Successful in 17s
2026-04-20 20:38:56 -04:00
Alexander Whitestone
cd18bd06be
ci: add markdown link check to smoke workflow ( #48 )
Smoke Test / smoke (pull_request) Successful in 14s
2026-04-17 01:43:21 -04:00
492c1cdcfd
Merge PR #90
...
Smoke Test / smoke (pull_request) Successful in 13s
Merged PR #90 : feat: integration test — turboquant compressed model
2026-04-17 01:52:09 +00:00
300918ee1e
test: quant selector tests ( #81 )
Smoke Test / smoke (pull_request) Successful in 12s
2026-04-15 15:04:41 +00:00
d2edbdadc2
test: add tool call integration tests ( #82 )
Smoke Test / smoke (pull_request) Successful in 11s
2026-04-15 14:53:47 +00:00
c009d8df77
test: add pytest conftest ( #82 )
2026-04-15 14:53:45 +00:00
Alexander Whitestone
8affe79489
cleanup: remove committed .pyc and redundant Python test, add .gitignore
Smoke Test / smoke (pull_request) Successful in 11s
2026-04-14 11:34:38 -04:00
Alexander Whitestone
319f57780d
feat: add standalone build system and roundtrip tests (Issue #17 )
...
- CMakeLists.txt: builds turboquant as static library
- TURBOQUANT_BUILD_TESTS option enables ctest roundtrip tests
- tests/roundtrip_test.cpp: validates zero-vector roundtrip and
gaussian cosine similarity (>=0.99)
- Makefile wrapper for convenience (build/test/clean targets)
- Addresses contributor feedback on spec-to-code gap and CI from #17
2026-04-14 11:34:38 -04:00
