โมเดล 27B ย่อเหลือ 7.89 GB ชนะตัวเต็ม 54 GB ได้จริงไหม? เจาะ Saluki 27B

Chronological Source Flow
Back

AI Fusion Summary

Conway Research's Underdog team released Saluki 27B, a Qwen3.8-27B model compressed via IQ2 mix to 7.89 GB. It scored 88/120 in tool-calling tests, surpassing the 54 GB full model's score of 84. Separately, Qwen-Image-2.1 tests on a 48 GB Mac showed that enable_model_cpu_offload peaked at 18.5 GB. While encoding added no swap, denoising and VAE decode increased swap growth to 9.6 GB, reducing available memory to 27% during the process.