{"id":6078,"date":"2026-09-28T09:18:52","date_gmt":"2026-09-28T00:18:52","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/09\/28\/open-weight-models-weekly-2026-09-26\/"},"modified":"2026-09-28T11:10:49","modified_gmt":"2026-09-28T02:10:49","slug":"open-weight-models-weekly-2026-09-26","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/28\/open-weight-models-weekly-2026-09-26\/","title":{"rendered":"Open-Weight Models Weekly: The MiMo-V2.6 Family & Transformers GGUF Support"},"content":{"rendered":"

<\/p>\n

This Week in Numbers<\/h2>\n

Counted by Local Model Watch from the articles published this week.<\/em><\/p>\n

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
Item<\/th>\nCount<\/th>\n<\/tr>\n<\/thead>\n
Articles published<\/td>\n47<\/td>\n<\/tr>\n
\u3000New Models<\/td>\n12<\/td>\n<\/tr>\n
\u3000Engines and Tools<\/td>\n10<\/td>\n<\/tr>\n
\u3000Technical Reports<\/td>\n9<\/td>\n<\/tr>\n
\u3000Image, Video and Audio<\/td>\n7<\/td>\n<\/tr>\n
\u3000Companies and Funding<\/td>\n6<\/td>\n<\/tr>\n
\u3000Community<\/td>\n3<\/td>\n<\/tr>\n
New models covered<\/td>\n19<\/td>\n<\/tr>\n
\u3000fit in 8GB of VRAM (est.)<\/td>\n5<\/td>\n<\/tr>\n
\u3000fit in 12GB of VRAM (est.)<\/td>\n7<\/td>\n<\/tr>\n
\u3000fit in 16GB of VRAM (est.)<\/td>\n8<\/td>\n<\/tr>\n
\u3000fit in 24GB of VRAM (est.)<\/td>\n8<\/td>\n<\/tr>\n
\u3000parameters 4\u201315B<\/td>\n5<\/td>\n<\/tr>\n
\u3000parameters up to 4B<\/td>\n3<\/td>\n<\/tr>\n
\u3000parameters 15\u201340B<\/td>\n1<\/td>\n<\/tr>\n
\u3000parameters over 40B<\/td>\n1<\/td>\n<\/tr>\n
Converted builds appended to earlier articles<\/td>\n17 (MLX 3, GGUF 9, FP8 3, NVFP4 1, MXFP4 1)<\/td>\n<\/tr>\n
Most active publishers<\/td>\nnvidia developer (5), hugging face blog (3), xiaomimimo (3)<\/td>\n<\/tr>\n
Articles still marked unverified<\/td>\n2<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Trending models we did not cover separately<\/h3>\n

Hugging Face repositories that trended this week but did not get their own article. Listed for reference; we have not reviewed their model cards.<\/em><\/p>\n

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
Model<\/th>\nLikes<\/th>\nDownloads<\/th>\nWhy no article<\/th>\n<\/tr>\n<\/thead>\n
XiaomiMiMo\/MiMo-V2.6-Distill-Qwen-9B<\/a><\/td>\n522<\/td>\n8,839<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
XiaomiMiMo\/MiMo-V2.6-Flash-RL<\/a><\/td>\n491<\/td>\n25,661<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
Contrastive-LM\/CLM-v0.1-8B<\/a><\/td>\n408<\/td>\n766<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
pottokao\/Qwen-Image-2.1-Text-Encoder-Heretic-GGUF<\/a><\/td>\n299<\/td>\n145,246<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
apple\/LensVLM-9B<\/a><\/td>\n243<\/td>\n1,740<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
orcarouter\/OrcaSAQ-2-27B<\/a><\/td>\n169<\/td>\n1,330<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
ukisai\/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF<\/a><\/td>\n117<\/td>\n28,802<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
cua-ai\/cua-s1-forms<\/a><\/td>\n111<\/td>\n0<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
bottlecapai\/ThinkingCap-Qwen3.8-27B<\/a><\/td>\n110<\/td>\n609<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n
orcarouter\/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF<\/a><\/td>\n99<\/td>\n313<\/td>\npublisher not on our notable list<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Patch releases we did not cover separately<\/h3>\n

Releases of watched projects that were patch-level or had short notes. Each project’s page lists every version.<\/em><\/p>\n

\n\n\n\n\n\n\n\n\n\n\n\n\n
Project<\/th>\nVersion<\/th>\nRelease notes<\/th>\n<\/tr>\n<\/thead>\n
LostRuins\/koboldcpp<\/td>\nv1.122.1<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
ggml-org\/ggml<\/td>\nv0.25.1<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
ggml-org\/ggml<\/td>\nv0.25.3<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
ollama\/ollama<\/td>\nv0.34.4<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
turboderp-org\/exllamav3<\/td>\nv1.5.2<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
turboderp-org\/exllamav3<\/td>\nv1.5.3<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
unslothai\/unsloth<\/td>\nprebuilt-wheels-cu13<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n
unslothai\/unsloth<\/td>\nv0.1.815-beta<\/td>\nGitHub<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

<\/p>\n

Weekly Highlights<\/h2>\n

The most visible development this week was Xiaomi’s MiMo-V2.6 family arriving together. Alongside “MiMo-V2.6-Pro-RL”<\/a>, a 1.02T-parameter multimodal MoE model, ggml-org published GGUF builds in “MiMo-V2.6-Flash-RL-GGUF”<\/a> (about 141GB of memory required) and “MiMo-V2.6-Distill-Qwen-9B-GGUF”<\/a> (9.4B, 12GB+ VRAM), followed by MiMo-V2.6-MOPD<\/a> and “MiMo-V2.6-RL-oss”<\/a>, a reinforcement-learning environment for agents. With everything from a server-class flagship to a distilled model that fits in the 12GB tier landing in the same week, and GGUF builds from llama.cpp’s own organization available early, this matters to readers who want to try the models locally.<\/p>\n

On the inference infrastructure side, Hugging Face transformers added support for directly running GGUF models (Hugging Face transformers adds direct execution support for GGUF models<\/a>). Since the GGUF format, which has traditionally tended to be siloed within the llama.cpp ecosystem, has begun to seamlessly integrate with major Python frameworks, the scope for development and application is expanding significantly.<\/p>\n

Furthermore, the rise of lightweight decision-making models focused on specific tasks cannot be overlooked. Together AI announced “Tev1-4B-experimental”<\/a> and “Tev1-0.8B-experimental”<\/a>, which are designed to perform structured data decision-making with extremely small resource requirements starting from a minimum of 4GB VRAM. Rather than a pure focus on scaling up, a miniaturization and specialized approach for practical local execution has become a clear trend.<\/p>\n

Trends by Domain<\/h2>\n

Text Generation<\/h3>\n

In the text generation domain, the growing range of small models that run on a local PC or a single GPU stood out. Four of the models we covered this week fit within 4GB of VRAM, showing a strong focus on edge and local deployment.<\/p>\n

Particularly notable was the trend of small models specialized for decision-making and classification. In addition to “Tev1-4B-experimental”<\/a> and the 873M “Tev1-0.8B-experimental”<\/a>, the community also saw the release of “Kev”<\/a>, a derivative of Qwen3.5. Additionally, Together AI shared a method for building low-cost models based on Qwen3.5 4B (Together AI shares method to train and build Jev-style classification model for about $17 based on Qwen3.5 4B<\/a>). Echoing these developments, initiatives like the local runtime for decision models “Ollaya”<\/a> have emerged, though Ollaya contains unverified community-sourced information, and its future trajectory needs to be monitored carefully.<\/p>\n

As a language- and domain-specific model, Preferred Networks released “plamo-3-610m-fin-instruct”<\/a> (890M parameters, requiring 4GB+ VRAM), a Japanese finance-focused model that adds a practical option for lightweight Japanese LLMs.<\/p>\n

Meanwhile, in the server-class tier, large models combining MoE architectures with newer quantization formats kept coming, including “K2-Horizon-375B-A23B-NVFP4”<\/a> and “K2-Horizon-32B-NVFP4”<\/a> (both NVFP4) and the MiMo-V2.6-Pro-RL mentioned above.<\/p>\n

This week we also published our articles on the base models “Qwen3.8-27B”<\/a> and “DeepSeek-V4-Pro-0813”<\/a>, both released in August. We had already covered their derivatives, and neither is a new arrival this week.<\/p>\n

Image, Video and Audio<\/h3>\n

In the media generation domain, the rapid expansion of the Qwen-Image ecosystem and the diversification of task-specific architectures are progressing simultaneously.<\/p>\n

Regarding Qwen-Image-2.1, deployments included “Qwen-Image-2.1-Uncensored-GGUF”<\/a> (requiring 16GB+ VRAM), a GGUF quantized version easy to handle in ComfyUI, and “Qwen-Image-2.1-viggle-turbo”<\/a> (requiring 48GB+ VRAM) which performs high-speed generation in just 4 steps. Furthermore, specialization beyond mere general-purpose image generation is advancing, with the introduction of “Ming-Image”<\/a> as a model specialized in UI design generation.<\/p>\n

In the audio realm as well, it was a week where practical local models were established across visual and audio modalities, marked by Google DeepMind’s publication of the text-to-speech model “Gemini 3.8 Flash TTS”<\/a> and the release of “Audio8-ASR-Infinite”<\/a> (4.1B parameters, supporting streaming speech recognition, requiring 12GB+ VRAM).<\/p>\n

Engines and Tools<\/h3>\n

Updates to inference engines and development tools supporting model diversification also followed one after another. What they have in common is lightweight operation, high speed, and prompt model compatibility.<\/p>\n

In inference infrastructure, updates to C\/C++ libraries were prominent. Along with the release of “llama.cpp v0.5.0”<\/a>, its foundational ggml library also saw successive releases of “ggml v0.25.0”<\/a> and “ggml v0.25.2”<\/a>, strengthening FlashAttention, MoE, and optimizations for various backends. Additionally, the frontend tool “KoboldCpp v1.122”<\/a> added agent features, and the container-based model runner “ramalama v0.25.0”<\/a> has also incorporated the latest llama.cpp.<\/p>\n

In UI and framework environments, “ComfyUI v0.37.0”<\/a> implemented automatic fast-disk optimization and Qwen support, while “Unsloth”<\/a> added Qwen-Image-2.1 support and Agent Skills features. Furthermore, the WebUI environment “Open WebUI v0.11.4”<\/a> significantly reduced its Docker image size to around 175MB, representing a steady accumulation of overall improvements that reduce friction when building and operating local AI environments.<\/p>\n

<\/p>\n

Related Articles<\/h2>\n