{"id":12159,"date":"2026-11-17T11:01:09","date_gmt":"2026-11-17T02:01:09","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=12159"},"modified":"2026-11-17T11:10:17","modified_gmt":"2026-11-17T02:10:17","slug":"tencent-releases-dspine-parallel-draft-model","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-releases-dspine-parallel-draft-model\/","title":{"rendered":"Qwen3-8B-DSpine-b16: 4GB+ VRAM"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/tencent\/Qwen3-8B-DSpine-b16\">tencent\/Qwen3-8B-DSpine-b16<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-tencent-en\/\">Tencent: models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-10-16<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>apache-2.0<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">safetensors<\/a><\/td>\n<\/tr>\n<tr>\n<td>Paper<\/td>\n<td><a href=\"https:\/\/arxiv.org\/abs\/2609.36173\">arXiv:2609.36173<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>Tencent has released &#8220;DSpine&#8221;, a parallel draft model designed for speculative decoding.<\/p>\n<p>In conventional parallel draft methods, each position selects tokens independently, leading to inconsistent continuation content and a shorter accepted prefix. DSpine uses gated adjacent injection at each layer of the backbone to write the prediction features of the immediate preceding position into each position. This makes it possible to unfold a chain of causal conditioning along the depth of the network while updating all positions in parallel.<\/p>\n<p>According to the analysis in the paper, existing methods already form recoverable predictions in shallow layers, but accurate neighbor information is not being propagated to subsequent tokens. DSpine utilizes a unified transfer space constructed from the target model&#8217;s output embeddings, integrating layer-by-layer injection and neighbor-prediction-based decoding to promote the formation of prediction features in shallow layers. For more details, refer to the paper <a href=\"https:\/\/arxiv.org\/abs\/2609.36173\">arXiv:2609.36173<\/a>.<\/p>\n<h2>Specifications<\/h2>\n<ul>\n<li>Architecture: DFlashDraftModel<\/li>\n<li>Model Type: qwen3<\/li>\n<li>Parameters: 8B<\/li>\n<li>Context Length: 8192<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>The comparison results of the acceptance length on Qwen3-8B published in the model card are as follows. Note that all comparison models were retrained using the same Open-PerfectBlend dataset with identical configurations.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Temp.<\/th>\n<th>Method<\/th>\n<th style=\"text-align: center;\">GSM8K<\/th>\n<th style=\"text-align: center;\">MATH-500<\/th>\n<th style=\"text-align: center;\">HumanEval<\/th>\n<th style=\"text-align: center;\">MBPP<\/th>\n<th style=\"text-align: center;\">LCB<\/th>\n<th style=\"text-align: center;\">MT-Bench<\/th>\n<th style=\"text-align: center;\">Arena-Hard<\/th>\n<th style=\"text-align: center;\">Avg.<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>T = 0<\/td>\n<td>DFlash\u2020<\/td>\n<td style=\"text-align: center;\">6.32<\/td>\n<td style=\"text-align: center;\">7.99<\/td>\n<td style=\"text-align: center;\">6.56<\/td>\n<td style=\"text-align: center;\">6.29<\/td>\n<td style=\"text-align: center;\">6.11<\/td>\n<td style=\"text-align: center;\">4.26<\/td>\n<td style=\"text-align: center;\">3.91<\/td>\n<td style=\"text-align: center;\">5.92<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>Domino\u2020<\/td>\n<td style=\"text-align: center;\">9.68<\/td>\n<td style=\"text-align: center;\">9.40<\/td>\n<td style=\"text-align: center;\">7.23<\/td>\n<td style=\"text-align: center;\">6.89<\/td>\n<td style=\"text-align: center;\">6.40<\/td>\n<td style=\"text-align: center;\">5.12<\/td>\n<td style=\"text-align: center;\">4.65<\/td>\n<td style=\"text-align: center;\">7.05<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>DSpark<\/td>\n<td style=\"text-align: center;\">10.00<\/td>\n<td style=\"text-align: center;\">9.88<\/td>\n<td style=\"text-align: center;\">7.78<\/td>\n<td style=\"text-align: center;\">7.35<\/td>\n<td style=\"text-align: center;\">6.81<\/td>\n<td style=\"text-align: center;\">5.39<\/td>\n<td style=\"text-align: center;\">4.87<\/td>\n<td style=\"text-align: center;\">7.44<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>DFlash2<\/td>\n<td style=\"text-align: center;\">10.06<\/td>\n<td style=\"text-align: center;\">10.04<\/td>\n<td style=\"text-align: center;\">7.99<\/td>\n<td style=\"text-align: center;\">7.33<\/td>\n<td style=\"text-align: center;\">6.96<\/td>\n<td style=\"text-align: center;\">5.40<\/td>\n<td style=\"text-align: center;\">5.06<\/td>\n<td style=\"text-align: center;\">7.55<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td><strong>DSpine<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>10.55<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>10.30<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>8.27<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>7.66<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>7.25<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>5.63<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>5.13<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>7.83<\/strong><\/td>\n<\/tr>\n<tr>\n<td>T = 1<\/td>\n<td>DFlash\u2020<\/td>\n<td style=\"text-align: center;\">5.75<\/td>\n<td style=\"text-align: center;\">6.51<\/td>\n<td style=\"text-align: center;\">5.52<\/td>\n<td style=\"text-align: center;\">5.23<\/td>\n<td style=\"text-align: center;\">4.53<\/td>\n<td style=\"text-align: center;\">3.77<\/td>\n<td style=\"text-align: center;\">3.25<\/td>\n<td style=\"text-align: center;\">4.94<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>Domino\u2020<\/td>\n<td style=\"text-align: center;\">8.01<\/td>\n<td style=\"text-align: center;\">7.13<\/td>\n<td style=\"text-align: center;\">5.89<\/td>\n<td style=\"text-align: center;\">5.56<\/td>\n<td style=\"text-align: center;\">4.59<\/td>\n<td style=\"text-align: center;\">4.36<\/td>\n<td style=\"text-align: center;\">3.61<\/td>\n<td style=\"text-align: center;\">5.59<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>DSpark<\/td>\n<td style=\"text-align: center;\">9.33<\/td>\n<td style=\"text-align: center;\">8.64<\/td>\n<td style=\"text-align: center;\">6.91<\/td>\n<td style=\"text-align: center;\">6.66<\/td>\n<td style=\"text-align: center;\">5.78<\/td>\n<td style=\"text-align: center;\">4.99<\/td>\n<td style=\"text-align: center;\">4.25<\/td>\n<td style=\"text-align: center;\">6.65<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td>DFlash2<\/td>\n<td style=\"text-align: center;\">9.07<\/td>\n<td style=\"text-align: center;\">8.42<\/td>\n<td style=\"text-align: center;\">6.99<\/td>\n<td style=\"text-align: center;\">6.43<\/td>\n<td style=\"text-align: center;\">5.67<\/td>\n<td style=\"text-align: center;\">4.90<\/td>\n<td style=\"text-align: center;\">4.25<\/td>\n<td style=\"text-align: center;\">6.53<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td><strong>DSpine<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>9.83<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>8.99<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>7.39<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>6.97<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>6.11<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>5.09<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>4.49<\/strong><\/td>\n<td style=\"text-align: center;\"><strong>6.98<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>According to the measurement results in the model card, DSpine records the highest acceptance length across all benchmark items in both T=0 and T=1 temperature settings. It outperforms the comparison models in mathematics capabilities measured by GSM8K and MATH-500, coding capabilities measured by HumanEval and MBPP, and Arena-Hard, an indicator of conversation quality. In particular, it can be seen that it consistently achieves higher figures compared to existing methods such as DFlash2 and DSpark. Additionally, according to the abstract of the paper, serving tests using SGLang report an average of 23.3% higher throughput compared to DFlash.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>DSpine is a draft model aimed at improving the efficiency of speculative decoding. Therefore, it is specialized for the purpose of accelerating the inference speed of target large language models.<\/p>\n<p>From the tags in the model card and the description in the paper, it excels at maximizing the &#8220;acceptance length&#8221; in the inference of models like the Qwen3 series. This is expected to bring out high performance while maintaining inference efficiency across a wide range of tasks such as mathematics (GSM8K, MATH-500), coding (HumanEval, MBPP), and dialogue tasks (Arena-Hard).<\/p>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 1.2B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>4GB (laptop iGPU \/ phone class)<\/td>\n<td>BF16<\/td>\n<td>2.3GB<\/td>\n<td>2.8GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><strong>Inference engine support<\/strong> (architecture name matched against each project&#8217;s own model registry in its source code, checked 2026-11-17): llama.cpp: registered, vLLM: registered, MLX (mlx-lm): registered.<\/p>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<h2>How to Get It<\/h2>\n<ul>\n<li>Distribution Format: safetensors<\/li>\n<li>Installation Command:<\/li>\n<\/ul>\n<pre><code class=\"language-bash\">git clone https:\/\/github.com\/tencent\/dspine.git\ncd dspine\npip install -e.\n<\/code><\/pre>\n<ul>\n<li>Supported Engine: SGLang<\/li>\n<\/ul>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/14\/tencent-simple-attention-sparsification-qwen3\/\">Simple-Attention-Sparsification Text Generation Model: 12GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-qwen3-8-27b-dspine-b16\/\">Qwen3.8-27B-DSpine-b16 Draft Model for Speculative Decoding: 8GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-releases-wevisone-vl-vision-language-models\/\">Tencent Releases WeVisOne-VL Vision Language Models<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/18\/tencent-releases-wevisdoc-document-parsing-models\/\">Tencent Releases WeVisDoc-2B and WeVisDoc-4B Document Parsing Models<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model runs from the 4GB tier) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-8gb-en\/\">Other models that run on a 8GB GPU<\/a><\/li>\n<li><strong>Formats this model is available in<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">Safetensors format guide and models<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-tencent-en\/\">Tencent: models, licenses and articles<\/a><\/li>\n<li><strong>How to read GSM8K, MATH, HumanEval<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-benchmarks-en\/\">Benchmark glossary<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/tencent\/Qwen3-8B-DSpine-b16\">https:\/\/huggingface.co\/tencent\/Qwen3-8B-DSpine-b16<\/a><\/li>\n<li><a href=\"https:\/\/arxiv.org\/abs\/2609.36173\">https:\/\/arxiv.org\/abs\/2609.36173<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Discover DSpine, a parallel draft model by Tencent for speculative decoding that enhances inference speed and acceptance length.<\/p>\n","protected":false},"author":1,"featured_media":12158,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[375,3639,209,169,3641,1172,1547],"class_list":["post-12159","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-qwen3-en","tag-qwen3-dspine-b16-en","tag-safetensors-en","tag-sglang-en","tag-speculative-decoding-en","tag-tencent-en","tag-verified"],"lang":"en","translations":{"en":12159,"ja":12157},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/12159","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=12159"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/12159\/revisions"}],"predecessor-version":[{"id":17843,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/12159\/revisions\/17843"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/12158"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=12159"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=12159"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=12159"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}