10/19/2026
𝗕𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸𝗶𝗻𝗴 𝟵 𝘀𝗺𝗮𝗹𝗹 𝗺𝗼𝗱𝗲𝗹𝘀 𝗼𝗻 𝗮 𝟰𝗚𝗕 𝗹𝗮𝗽𝘁𝗼𝗽. 𝗘𝘃𝗲𝗿𝘆 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲𝗺 𝗳𝗮𝗶𝗹𝗲𝗱 𝘁𝗵𝗲 𝘀𝗮𝗺𝗲 𝘁𝗮𝘀𝗸.
PrismML's Ternary Bonsai 2 just landed on Ollama. PrismML claims 9x compression with up to 98.2% of tool-calling retained. A lot of my clients have 4GB of VRAM, so I tested it.
The setup: RTX 3050, Ollama, 15 agentic tasks across three tiers, each run three times. To score, a model had to pick the right tools, in the right order, and get the correct final value.
qwen3.5:4b took it with 28/30. bonsai-2:9b runs a 9B model in 3.18GB and placed third. The two MoE models went in opposite directions.
The interesting part is in the expert tier. One task was to transfer $400 from a savings account holding $250. Every model failed it on every run. They check the balance, note the shortage, and transfer anyway. -$150.
The models never inferred the refusal, and the task never stated one. A verifier reviewing the plan before ex*****on caught the missing "otherwise refuse." Once the refusal was stated, the 4B models handled it.
Check where your model is actually running. Ollama's auto-fit put half of Qwen on the CPU. Setting num_gpu and moving the display to the iGPU got it to 43–50 tokens per second.
When everything fails the same way, check your own spec first. A verifier is cheaper than a bigger model.