feat(llama-swap): sync vLLM configs from club-3090, add evan API key

Sync all three vLLM model configs from club-3090 master (ae4846f).
Update to Genesis v7.65 full PROD env set with new patches.
Update docker image to nightly-7a1eb8ac. Add torch_compile and
triton cache dirs. Add agent setup guide (AGENTS.md).

Add 'evan' API key to llama-swap sops secrets.
This commit is contained in:
2026-05-02 06:55:57 -04:00
parent ba30222962
commit 40114f438f
5 changed files with 257 additions and 66 deletions

View File

@@ -88,6 +88,11 @@ in
# Create Config
sops = {
secrets = {
"llama_swap_api_keys/evan" = {
sopsFile = lib.snowfall.fs.get-file "secrets/common/llama-swap.yaml";
};
};
secrets = {
"llama_swap_api_keys/pi" = {
sopsFile = lib.snowfall.fs.get-file "secrets/common/llama-swap.yaml";
@@ -101,6 +106,7 @@ in
recursiveUpdate cfg.config {
apiKeys = [
config.sops.placeholder."llama_swap_api_keys/pi"
config.sops.placeholder."llama_swap_api_keys/evan"
];
}
);