feat(llama-swap): sync vLLM configs from club-3090, add evan API key
Sync all three vLLM model configs from club-3090 master (ae4846f). Update to Genesis v7.65 full PROD env set with new patches. Update docker image to nightly-7a1eb8ac. Add torch_compile and triton cache dirs. Add agent setup guide (AGENTS.md). Add 'evan' API key to llama-swap sops secrets.
This commit is contained in:
@@ -88,6 +88,11 @@ in
|
||||
|
||||
# Create Config
|
||||
sops = {
|
||||
secrets = {
|
||||
"llama_swap_api_keys/evan" = {
|
||||
sopsFile = lib.snowfall.fs.get-file "secrets/common/llama-swap.yaml";
|
||||
};
|
||||
};
|
||||
secrets = {
|
||||
"llama_swap_api_keys/pi" = {
|
||||
sopsFile = lib.snowfall.fs.get-file "secrets/common/llama-swap.yaml";
|
||||
@@ -101,6 +106,7 @@ in
|
||||
recursiveUpdate cfg.config {
|
||||
apiKeys = [
|
||||
config.sops.placeholder."llama_swap_api_keys/pi"
|
||||
config.sops.placeholder."llama_swap_api_keys/evan"
|
||||
];
|
||||
}
|
||||
);
|
||||
|
||||
Reference in New Issue
Block a user