Alexander Whitestone 8946f0fef2 feat: Auto-select TurboQuant preset based on available memory (#97) ...

turboquant/auto_select.py:
- Preset selection: turboquant_k8v4 (8+ GB overhead), turboquant_4bit_nc
  (4+ GB), turboquant_3bit_nc (2+ GB), q4_0 (fallback).
- SystemInfo.detect(): macOS (sysctl/vm_stat), Linux (/proc/meminfo +
  nvidia-smi), fallback (psutil).
- auto_select(): Full pipeline — detect hardware, check config override,
  select preset, populate env vars + server flags.
- Config file: $HERMES_HOME/turboquant.json with preset_override and
  context_length. save_config() merges with existing.
- SelectionResult: dataclass with to_dict(), env_vars, server_flags,
  warnings for low headroom / overcommitted memory.
- CLI: --model-size, --json, --shell, --list, --detect-only, --preset.
- format_env_commands(): Shell export output for quick deployment.

turboquant/__init__.py:
- Package init re-exporting public API.

tests/test_auto_select.py (35 tests):
- Preset selection: overhead thresholds, boundary conditions, zero model.
- vLLM requirement filtering.
- SelectionResult: to_dict, env_vars, server_flags.
- Preset definitions: required fields, quality order consistency.
- SystemInfo detection.
- Config: load, save, merge, missing file.
- Auto-select: override, config file override, mocked detection.
- Issue spec: exact threshold tests from #97.

Closes #97

2026-04-21 07:39:53 -04:00

..

conftest.py

test: add pytest conftest (#82)

2026-04-15 14:53:45 +00:00

roundtrip_test.cpp

feat: add standalone build system and roundtrip tests (Issue #17)

2026-04-14 11:34:38 -04:00

test_auto_select.py

feat: Auto-select TurboQuant preset based on available memory (#97)

2026-04-21 07:39:53 -04:00

test_quant_selector.py

test: quant selector tests (#81)

2026-04-15 15:04:41 +00:00

test_tool_call_integration.py

test: add tool call integration tests (#82)

2026-04-15 14:53:47 +00:00