Files
nix/modules/nixos/services/llama-swap/config.nix
Evan Reichard 0dca9802e6 feat(llama-swap): increase context window and add GPU configuration
- Increase context window from 80k to 202,752 tokens
- Add repeat penalty parameter (1.0)
- Enable CUDA device for GPU acceleration
2026-01-29 21:18:34 -05:00

14 KiB