From cd6eea2a7bf367515980d26dcb078e848fdbf861 Mon Sep 17 00:00:00 2001 From: Evan Reichard Date: Thu, 5 Feb 2026 19:45:55 -0500 Subject: [PATCH] docs: add model rankings and observations - pi-qwen-coder-next-80b: Near one-shot success with UI advantages, minor routing issues - pi-glm4.7-flash: Dependency issues, legacy packages, average UI - pi-devstral-small-2: Runtime issues --- NOTES.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) create mode 100644 NOTES.md diff --git a/NOTES.md b/NOTES.md new file mode 100644 index 0000000..8ad511c --- /dev/null +++ b/NOTES.md @@ -0,0 +1,14 @@ +### Rankings + +1. eval/pi-qwen-coder-next-80b + - Almost one shot + - Nicest UI + - Invalid route (first fix commit) - very simple fix + - Not displaying content (second fix commit) - simple fix +2. eval/pi-glm4.7-flash + - FE wouldnt run on first try + - Had to downgrade a bunch of deps so it would run + - Used legacy packages + - UI is meh +3. eval/pi-devstral-small-2 + - Wouldnt run