Files
nix/modules/nixos/services
Evan Reichard 328bb6e1db feat(llama-swap): add ik-llama-cpp package and Qwen3.6-27B MTP config
Add ikawrakow/ik_llama.cpp as a new package with CUDA/Vulkan support,
enabling MTP (Multi-Token Prediction) and IQ4_KS quantization. Wire it
into llama-swap with a new 'ik-qwen3.6-27b-iq4ks-thinking' model config
and 'iq36' alias. Also add a chat template download to the vLLM setup
script and include the binary on lin-va-desktop.
2026-05-12 16:19:34 -04:00
..
2025-04-21 00:56:53 +00:00
2025-04-21 00:56:53 +00:00
2025-09-19 14:37:17 -04:00
2025-09-23 19:23:35 -04:00
2025-04-21 00:56:53 +00:00
2026-01-23 18:32:10 -05:00
2025-12-26 20:51:59 -05:00
2025-09-22 19:05:18 -04:00
2025-09-07 15:20:47 -04:00
2025-04-21 00:56:53 +00:00