1350b9b177
- Added comprehensive local model fine-tuning guide - Created benchmarking script for inference performance - Added training data collection script for merged PRs - Documented current stack (Ollama + llama.cpp + Hermes 4) - Provided quantization options and best practices - Included troubleshooting and monitoring guidance Addresses issue #486 recommendations: ✓ Documented local model stack for reproducibility ✓ Created benchmarking tools for inference latency ✓ Provided training data collection pipeline ✓ Documented quantization options for faster inference ✓ Included fine-tuning pipeline documentation
26 lines
384 B
Plaintext
26 lines
384 B
Plaintext
# Local Model Fine-Tuning Dependencies
|
|
|
|
# Core dependencies
|
|
requests>=2.31.0
|
|
numpy>=1.24.0
|
|
pandas>=2.0.0
|
|
|
|
# For benchmarking
|
|
matplotlib>=3.7.0
|
|
seaborn>=0.12.0
|
|
|
|
# For data processing
|
|
jsonlines>=3.1.0
|
|
tqdm>=4.65.0
|
|
|
|
# Optional: for advanced fine-tuning
|
|
# torch>=2.0.0
|
|
# transformers>=4.30.0
|
|
# peft>=0.4.0
|
|
# datasets>=2.14.0
|
|
|
|
# Development tools
|
|
pytest>=7.4.0
|
|
black>=23.0.0
|
|
flake8>=6.0.0
|