evan/nix
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

chore(llama-swap): tune presence penalty to 1.5 and remove repeat penalty

Browse Source
This commit is contained in:
Evan Reichard
2026-05-07 20:37:54 -04:00
parent d142c5ff7e
commit f3cc67b17d
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
modules/nixos/services/llama-swap/config.nix
View File

@@ -44,8 +44,7 @@ in
--top-p 0.95 \ --top-p 0.95 \
--top-k 20 \ --top-k 20 \
--min-p 0.0 \ --min-p 0.0 \
--presence-penalty 0.0 \ --presence-penalty 1.5 \
--repeat-penalty 1.0 \
-dev CUDA0 \ -dev CUDA0 \
-fit off \ -fit off \
--chat-template-kwargs "{\"preserve_thinking\": true}" --chat-template-kwargs "{\"preserve_thinking\": true}"