{"id":19253,"date":"2026-11-18T13:11:43","date_gmt":"2026-11-18T04:11:43","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/11\/18\/tencent-hy4-flash-multimodal-moe-model\/"},"modified":"2026-11-18T13:16:37","modified_gmt":"2026-11-18T04:16:37","slug":"tencent-hy4-flash-multimodal-moe-model","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/18\/tencent-hy4-flash-multimodal-moe-model\/","title":{"rendered":"Tencent Releases Hy4 flash: A Cost-Effective Multimodal MoE Model"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/tencent\/Hy4-flash-base\">tencent\/Hy4-flash-base<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-tencent-en\/\">Tencent: models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-11-17<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>tencent-hy-license<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">safetensors<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>Tencent has released the &#8220;Hy4 flash&#8221; series, a multimodal Mixture-of-Experts (MoE) model. It comes in three variants: the instruct version <code>tencent\/Hy4-flash<\/code>, the FP8 quantized version <code>tencent\/Hy4-flash-FP8<\/code>, and the pre-trained-only version <code>tencent\/Hy4-flash-base<\/code>. According to the model card, it is the most cost-efficient model in the Hy series, taking text and image inputs and outputting text.<\/p>\n<p>It is recommended for everyday business tasks (deep search, document processing, slide creation, simple frontend demos, computer use). For complex tasks such as long-term software engineering, the higher-tier Hy4 is recommended.<\/p>\n<h2>Specifications<\/h2>\n<ul>\n<li>Architecture: Mixture-of-Experts (MoE). 220B total parameters (including 64B Engram parameters), with 12B active parameters per token.<\/li>\n<li>Table Breakdown: Total parameters (excluding Engram, ViT, and DFly2) 155.5B, Engram 63.5B, ViT 0.43B, DFly2 0.85B, with per-token active parameters of 11.3B (text) + 0.43B (image).<\/li>\n<li>Context Length: 1M (1,048,576 tokens).<\/li>\n<li>Backbone: 42 layers (1 dense layer + 41 MoE layers). Each MoE layer has 512 routed experts and 1 shared expert, activating 16 routed experts per token.<\/li>\n<li>Attention: Sparse attention and sliding window attention (SWA) arranged in an alternating 1:3 ratio.<\/li>\n<li>Supports speculative decoding via the built-in 5-layer drafter &#8220;DFly2&#8221; (0.85B).<\/li>\n<li>Vision Encoder: Modified SigLIP2-So400m-Patch16-Res512.<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>Below are the few-shot evaluations of the pre-trained model (Hy4 flash Base) published by the creators in the model card. These are not third-party verifications. Due to the number of columns, comparisons are limited to Hy4 Base, Hy3 preview Base, DeepSeek-V4-flash-Base, and DeepSeek-V4-Pro-Base, and rows for PIQA, Social IQa, KOR-Bench, C\u00b3, and multimodal items have been omitted. Items marked with \u2020 are noted in the card as macro-average accuracies for the corresponding text benchmarks.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Category<\/th>\n<th>Benchmark<\/th>\n<th style=\"text-align: center;\">#Shots<\/th>\n<th style=\"text-align: right;\">Hy4 flash Base<\/th>\n<th style=\"text-align: right;\">Hy4 Base<\/th>\n<th style=\"text-align: right;\">Hy3 preview Base<\/th>\n<th style=\"text-align: right;\">DeepSeek-V4-flash-Base<\/th>\n<th style=\"text-align: right;\">DeepSeek-V4-Pro-Base<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>Knowledge<\/strong><\/td>\n<td>MMLU\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">88.7<\/td>\n<td style=\"text-align: right;\">91.6<\/td>\n<td style=\"text-align: right;\">87.5<\/td>\n<td style=\"text-align: right;\">89.7<\/td>\n<td style=\"text-align: right;\">91.1<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>MMLU-Pro\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">71.1<\/td>\n<td style=\"text-align: right;\">73.9<\/td>\n<td style=\"text-align: right;\">65.8<\/td>\n<td style=\"text-align: right;\">68.6<\/td>\n<td style=\"text-align: right;\">73.4<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>MMLU-Redux\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">87.6<\/td>\n<td style=\"text-align: right;\">90.6<\/td>\n<td style=\"text-align: right;\">87.0<\/td>\n<td style=\"text-align: right;\">88.8<\/td>\n<td style=\"text-align: right;\">90.2<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>SuperGPQA\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">57.8<\/td>\n<td style=\"text-align: right;\">62.7<\/td>\n<td style=\"text-align: right;\">52.3<\/td>\n<td style=\"text-align: right;\">52.5<\/td>\n<td style=\"text-align: right;\">54.8<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>C-Eval\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">92.0<\/td>\n<td style=\"text-align: right;\">95.0<\/td>\n<td style=\"text-align: right;\">90.1<\/td>\n<td style=\"text-align: right;\">91.9<\/td>\n<td style=\"text-align: right;\">93.4<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>CMMLU\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">91.6<\/td>\n<td style=\"text-align: right;\">93.1<\/td>\n<td style=\"text-align: right;\">89.6<\/td>\n<td style=\"text-align: right;\">89.8<\/td>\n<td style=\"text-align: right;\">90.7<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>SimpleQA<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">37.5<\/td>\n<td style=\"text-align: right;\">57.2<\/td>\n<td style=\"text-align: right;\">26.4<\/td>\n<td style=\"text-align: right;\">31.3<\/td>\n<td style=\"text-align: right;\">52.1<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>Chinese-SimpleQA\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">74.6<\/td>\n<td style=\"text-align: right;\">83.9<\/td>\n<td style=\"text-align: right;\">69.6<\/td>\n<td style=\"text-align: right;\">71.9<\/td>\n<td style=\"text-align: right;\">76.6<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>AGIEval (English)\u2020<\/td>\n<td style=\"text-align: center;\">3<\/td>\n<td style=\"text-align: right;\">75.4<\/td>\n<td style=\"text-align: right;\">79.3<\/td>\n<td style=\"text-align: right;\">76.0<\/td>\n<td style=\"text-align: right;\">76.3<\/td>\n<td style=\"text-align: right;\">78.2<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>AGIEval (Chinese)\u2020<\/td>\n<td style=\"text-align: center;\">3<\/td>\n<td style=\"text-align: right;\">90.6<\/td>\n<td style=\"text-align: right;\">91.2<\/td>\n<td style=\"text-align: right;\">87.8<\/td>\n<td style=\"text-align: right;\">88.5<\/td>\n<td style=\"text-align: right;\">89.8<\/td>\n<\/tr>\n<tr>\n<td><strong>Reasoning<\/strong><\/td>\n<td>HellaSwag (3,000-item subset)<\/td>\n<td style=\"text-align: center;\">10<\/td>\n<td style=\"text-align: right;\">85.2<\/td>\n<td style=\"text-align: right;\">87.1<\/td>\n<td style=\"text-align: right;\">85.7<\/td>\n<td style=\"text-align: right;\">85.1<\/td>\n<td style=\"text-align: right;\">86.8<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>ARC-Challenge<\/td>\n<td style=\"text-align: center;\">0<\/td>\n<td style=\"text-align: right;\">95.0<\/td>\n<td style=\"text-align: right;\">97.3<\/td>\n<td style=\"text-align: right;\">96.0<\/td>\n<td style=\"text-align: right;\">97.3<\/td>\n<td style=\"text-align: right;\">97.0<\/td>\n<\/tr>\n<tr>\n<td><strong>Math<\/strong><\/td>\n<td>U-MATH<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">69.8<\/td>\n<td style=\"text-align: right;\">71.6<\/td>\n<td style=\"text-align: right;\">60.9<\/td>\n<td style=\"text-align: right;\">57.4<\/td>\n<td style=\"text-align: right;\">64.8<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>OCW Courses<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">64.0<\/td>\n<td style=\"text-align: right;\">66.7<\/td>\n<td style=\"text-align: right;\">62.6<\/td>\n<td style=\"text-align: right;\">63.3<\/td>\n<td style=\"text-align: right;\">68.2<\/td>\n<\/tr>\n<tr>\n<td><strong>Code<\/strong><\/td>\n<td>MBPP-plus<\/td>\n<td style=\"text-align: center;\">3<\/td>\n<td style=\"text-align: right;\">73.7<\/td>\n<td style=\"text-align: right;\">74.0<\/td>\n<td style=\"text-align: right;\">77.4<\/td>\n<td style=\"text-align: right;\">76.8<\/td>\n<td style=\"text-align: right;\">79.1<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>BigCodeBench (Full)<\/td>\n<td style=\"text-align: center;\">0<\/td>\n<td style=\"text-align: right;\">58.8<\/td>\n<td style=\"text-align: right;\">47.9<\/td>\n<td style=\"text-align: right;\">59.6<\/td>\n<td style=\"text-align: right;\">58.0<\/td>\n<td style=\"text-align: right;\">57.5<\/td>\n<\/tr>\n<tr>\n<td><strong>Multilingual<\/strong><\/td>\n<td>Belebele (5-language subset)\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">93.8<\/td>\n<td style=\"text-align: right;\">95.0<\/td>\n<td style=\"text-align: right;\">94.2<\/td>\n<td style=\"text-align: right;\">94.4<\/td>\n<td style=\"text-align: right;\">95.2<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>INCLUDE\u2020<\/td>\n<td style=\"text-align: center;\">5<\/td>\n<td style=\"text-align: right;\">82.8<\/td>\n<td style=\"text-align: right;\">88.1<\/td>\n<td style=\"text-align: right;\">84.3<\/td>\n<td style=\"text-align: right;\">84.0<\/td>\n<td style=\"text-align: right;\">84.3<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>In this table, Hy4 flash Base outperforms DeepSeek-V4-flash-Base (68.6, 52.5) on MMLU-Pro (71.1) and SuperGPQA (57.8). Its U-MATH score of 69.8 is also second only to Hy4 Base&#8217;s 71.6. On the other hand, its SimpleQA score is 37.5, falling well short of Hy4 Base (57.2) and DeepSeek-V4-Pro-Base (52.1). MBPP-plus is 73.7, lower than DeepSeek-V4-flash-Base (76.8) and Hy3 preview Base (77.4). BigCodeBench (Full) at 58.8 is a close match with Hy3 preview Base (59.6) and higher than Hy4 Base (47.9). The higher-tier Hy4 Base outperforms it in most knowledge categories. Additionally, the card notes that exposure to synthetic instruction data during intermediate training may cause few-shot evaluations to skew scores by failing to follow response formats.<\/p>\n<p>For real-world tasks, it scores 42.1 on the creators&#8217; internal benchmark WorkIndex (Hy4 preview is 39.7, Hy4 is 51.4). The average cost per task is 1\/13th of Hy4 preview and 1\/20th of Hy4. Blind evaluation satisfaction by 85 internal users was 2.79\/4, close to Claude Haiku 5.5&#8217;s 2.81\/4. These are measurements by the creators themselves.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>The model card recommends everyday business tasks. Specifically, deep search, document processing, slide creation, simple frontend demos, and computer use are listed. The internal benchmark WorkIndex is described as consisting of eight evaluation sets including slide creation\/editing, collaborative Markdown writing, document editing, spreadsheet repair, audio\/video processing, and visual understanding. It is designed with a focus on quality, output length, and latency for tasks close to actual work.<\/p>\n<p>Meanwhile, for complex tasks like long-term software engineering, the card recommends the higher-tier Hy4. Rather than positioning itself as &#8220;the strongest in a specific field,&#8221; it is oriented towards practicality, prioritizing cost and speed.<\/p>\n<p>It also supports image inputs (tags are <code>multimodal<\/code>, <code>image-text-to-text<\/code>). Examples in the card include image description generation. Since the context length is 1M tokens, it is also suited for handling long documents.<\/p>\n<p>Regarding efficiency, the card states the following (all claims are by the creators and have not been verified by third parties):<\/p>\n<ul>\n<li>The adoption of hybrid attention, LatentMoE, and Engram is reported to reduce the KV cache size to 1\/24th of Hy3 and 1\/6th of Hy4.<\/li>\n<li>Reinforcement learning is reported to reduce the average end-to-end output token count by 50%.<\/li>\n<li>The decoding speed combining megakernel, 4-bit quantization, and DFly2 is reported to exceed 150 tokens\/s.<\/li>\n<\/ul>\n<p>Inference modes are switched via <code>reasoning_effort<\/code>. Options include <code>\"high\"<\/code> (default, thinking enabled) and <code>\"no_think\"<\/code> (direct answer). Recommended sampling parameters are <code>temperature=0.9<\/code> and <code>top_p=1.0<\/code>.<\/p>\n<p><code>Hy4-flash-base<\/code> is a pre-trained-only base model and is not for chat. Conversation and reasoning examples apply to <code>Hy4-flash<\/code> and <code>Hy4-flash-FP8<\/code>. Fine-tuning pipelines and guides are also provided in each repository.<\/p>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 220.3B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>More than 492GB of VRAM (multi-GPU or CPU offload required)<\/td>\n<td>BF16<\/td>\n<td>410.3GB<\/td>\n<td>492.3GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><strong>Inference engine support<\/strong> (architecture name matched against each project&#8217;s own model registry in its source code, checked 2026-11-18): llama.cpp: not registered, vLLM: not registered, MLX (mlx-lm): not registered. &#8220;Not registered&#8221; means the name is absent from that registry today, not that the model cannot run.<\/p>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Not usable in Ollama, LM Studio and llama.cpp yet.<\/strong><\/p>\n<p>The publisher ships safetensors only, and llama.cpp&#8217;s registry does not list this architecture. llama.cpp would need to add support before these tools can run it. Today it can be run with transformers, using the memory figures in the table above.<\/p>\n<p><strong>License \u2014 <code>tencent-hy-license<\/code>:<\/strong> A custom license from the publisher. Check the original terms directly, including whether commercial use is permitted.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:lab --><\/p>\n<h2>Our Own Measurements<\/h2>\n<h3>Measurements We Did Not Take<\/h3>\n<p>We have not confirmed that this site meets the commercial-use terms of this model&#8217;s license (<code>tencent-hy-license<\/code>). Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).<\/p>\n<p><!-- \/lmw:lab --><\/p>\n<p><!-- lmw:peers --><\/p>\n<h2>Recent Models in the Same Size Class<\/h2>\n<p><em>Models with <\/em><em>over 40B<\/em><em> parameters that Local Model Watch covered recently, listed by code from our article log for comparison. VRAM tiers are this site&#8217;s estimates; licenses are as stated on the model cards.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Parameters<\/th>\n<th>Smallest VRAM tier<\/th>\n<th>License<\/th>\n<th>Our article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>nvidia\/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16<\/td>\n<td>124.5B<\/td>\n<td>80GB<\/td>\n<td>openmdw-1.1<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/nvidia-nemotron-3-5-super-vl-120b-a12b-bf16\/\">NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16: 80GB+ VRAM, GGUF Builds<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>deepseek-ai\/DeepSeek-V4.1-Flash-1017<\/td>\n<td>763.2B<\/td>\n<td>\u2014<\/td>\n<td>mit<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/deepseek-v4-1-flash-1017-released\/\">DeepSeek-V4.1-Flash-1017 Vision-Language Model: ~570GB Memory<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>Qwen\/Qwen3.8-Flash-Next<\/td>\n<td>180.0B<\/td>\n<td>\u2014<\/td>\n<td>qwen-community-1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/10\/05\/qwen-3-8-flash-next-released\/\">Qwen3.8-Flash-Next Multimodal MoE Model: ~402GB Memory<\/a> (2026-10-04)<\/td>\n<\/tr>\n<tr>\n<td>ggml-org\/GLM-5.3-Flash-GGUF<\/td>\n<td>321.3B<\/td>\n<td>\u2014<\/td>\n<td>other<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/10\/04\/glm-5-3-flash-gguf-released\/\">GLM-5.3-Flash-GGUF Vision-Language Model: ~150GB Memory<\/a> (2026-10-03)<\/td>\n<\/tr>\n<tr>\n<td>bartowski\/Intern-S2-397B-GGUF<\/td>\n<td>403.4B<\/td>\n<td>\u2014<\/td>\n<td>apache-2.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/15\/intern-s2-397b-gguf-released\/\">Intern-S2-397B-GGUF Vision-Language Model: ~102GB Memory<\/a> (2026-09-15)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><!-- \/lmw:peers --><\/p>\n<h2>How to Get It<\/h2>\n<p>Distributed in safetensors format. It is available on Hugging Face, ModelScope, and GitCode. No gating is set, and it can be downloaded on Hugging Face without agreeing to a license. The license is Tencent Hy License (noted as <code>license:other<\/code> on the card). Details of the terms of use could not be confirmed from the current materials. If you plan commercial use or similar, please check the license text in the repository.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Description<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code>tencent\/Hy4-flash<\/code><\/td>\n<td>Instruct version<\/td>\n<\/tr>\n<tr>\n<td><code>tencent\/Hy4-flash-FP8<\/code><\/td>\n<td>FP8 quantized instruct version<\/td>\n<\/tr>\n<tr>\n<td><code>tencent\/Hy4-flash-base<\/code><\/td>\n<td>Pre-trained base version<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>Here is an example download command:<\/p>\n<pre><code class=\"language-bash\">huggingface-cli download tencent\/Hy4-flash-FP8\n<\/code><\/pre>\n<p>A GGUF version is provided by AngelSlim as <code>AngelSlim\/Hy4-flash-GGUF<\/code>. The card positions this for &#8220;end-to-end testing&#8221; and not for production operations. Compatibility status with llama.cpp, Ollama, and LM Studio is unverified as it is not mentioned in the materials.<\/p>\n<h3>Transformers<\/h3>\n<p>Support for Hy4 flash is reported to be &#8220;merged soon&#8221; into the main branch of transformers. Until then, it must be installed from the following commit:<\/p>\n<pre><code class=\"language-bash\">pip install &quot;transformers[torch,vision] @ git+https:\/\/github.com\/huggingface\/transformers.git@refs\/pull\/50903\/head&quot;\n<\/code><\/pre>\n<h3>vLLM<\/h3>\n<p>For production serving, vLLM or SGLang is recommended. The official prebuilt image for vLLM is <code>vllm\/vllm-openai:hy4-flash<\/code>. The command from the card is as follows:<\/p>\n<pre><code class=\"language-bash\">docker run --gpus all \\\n  -p 8000:8000 \\\n  --ipc=host \\\n  -v ~\/.cache\/huggingface:\/root\/.cache\/huggingface \\\n  vllm\/vllm-openai:hy4-flash tencent\/Hy4-flash-FP8 \\\n    --tensor-parallel-size 8 \\\n    --speculative-config '{&quot;num_speculative_tokens&quot;:5,&quot;method&quot;:&quot;dfly&quot;}' \\\n    --attention-backend FLASHMLA_SPARSE \\\n    --tool-call-parser hy_v4 \\\n    --reasoning-parser hy_v4 \\\n    --enable-auto-tool-choice \\\n    --port 8000 \\\n    --served-model-name hy4-flash\n<\/code><\/pre>\n<h3>SGLang<\/h3>\n<p>The official SGLang image is <code>lmsysorg\/sglang:hy4-flash<\/code> (multi-architecture for x86 and Arm).<\/p>\n<pre><code class=\"language-bash\">docker pull lmsysorg\/sglang:hy4-flash\n\ndocker run --gpus all \\\n  -p 8000:8000 \\\n  --ipc=host \\\n  lmsysorg\/sglang:hy4-flash \\\n  sglang serve \\\n    --trust-remote-code \\\n    --model-path tencent\/Hy4-flash-FP8 \\\n    --tp 8 \\\n    --cuda-graph-backend-prefill disabled \\\n    --speculative-algorithm DFLY \\\n    --speculative-dfly-block-size 6 \\\n    --host 127.0.0.1 \\\n    --port 8000\n<\/code><\/pre>\n<p>Both examples specify <code>--tensor-parallel-size 8<\/code> (<code>--tp 8<\/code> in SGLang), assuming a multi-GPU configuration. Once the server starts, you can access it via an OpenAI-compatible API. Speculative decoding via DFly2 is enabled via startup options.<\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-qwen3-8-27b-dspine-b16\/\">Qwen3.8-27B-DSpine-b16 Draft Model for Speculative Decoding: 8GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-releases-dspine-parallel-draft-model\/\">Qwen3-8B-DSpine-b16: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/hy-memory-30b-a3b-2\/\">Hy-Memory-30B-A3B Text Generation Model: 12GB+ VRAM, GGUF Builds<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-youtu-parsing-omni\/\">Youtu-Parsing-Omni Omnimodal Analysis Model: 12GB+ VRAM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model does not fit even in 80GB; its smallest build needs about 492GB) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference, including models over 80GB<\/a><\/li>\n<li><strong>Formats this model is available in<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">Safetensors format guide and models<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-tencent-en\/\">Tencent: models, licenses and articles<\/a><\/li>\n<li><strong>Other models for the same task<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-by-task-en\/#task-vision\">Other vision-language models<\/a><\/li>\n<li><strong>How to read MMLU, MMLU-Pro, SuperGPQA<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-benchmarks-en\/\">Benchmark glossary<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/tencent\/Hy4-flash\">tencent\/Hy4-flash<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/tencent\/Hy4-flash-FP8\">tencent\/Hy4-flash-FP8<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/tencent\/Hy4-flash-base\">tencent\/Hy4-flash-base<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/AngelSlim\/Hy4-flash-GGUF\">AngelSlim\/Hy4-flash-GGUF<\/a><\/li>\n<li><a href=\"https:\/\/recipes.vllm.ai\/tencent\/Hy4-flash\">Hy4 flash vLLM Recipe<\/a><\/li>\n<li><a href=\"https:\/\/docs.sglang.io\/cookbook\/autoregressive\/Tencent\/Hy4-flash\">Hy4 flash SGLang Cookbook<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Tencent has released Hy4 flash, a multimodal MoE model focused on cost efficiency and everyday business tasks. Learn specs, performance, and usage.<\/p>\n","protected":false},"author":1,"featured_media":19252,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[5305,165,169,1172,1547,592,1952,896],"class_list":["post-19253","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-hy4-flash-en","tag-moe-en","tag-sglang-en","tag-tencent-en","tag-verified","tag-vllm-en","tag-vlm-en","tag--en"],"lang":"en","translations":{"en":19253,"ja":19251},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/19253","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=19253"}],"version-history":[{"count":1,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/19253\/revisions"}],"predecessor-version":[{"id":19309,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/19253\/revisions\/19309"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/19252"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=19253"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=19253"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=19253"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}