{"id":432,"date":"2026-09-10T22:15:10","date_gmt":"2026-09-10T13:15:10","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/09\/10\/yue2-3b-music-generation-model\/"},"modified":"2026-11-03T16:08:24","modified_gmt":"2026-11-03T07:08:24","slug":"yue2-3b-music-generation-model","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/10\/yue2-3b-music-generation-model\/","title":{"rendered":"YuE2-3B Music Generation Model for Lyrics and Style: 12GB+ VRAM"},"content":{"rendered":"<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">m-a-p\/YuE2-3B<\/a><\/td>\n<\/tr>\n<tr>\n<td>Family guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-m-a-p-yue2-en\/\">YuE2 guide (3 articles)<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-m-a-p-en\/\">M-A-P: models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-09-10<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>cc-by-nc-4.0<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">safetensors<\/a><\/td>\n<\/tr>\n<tr>\n<td>Paper<\/td>\n<td><a href=\"https:\/\/arxiv.org\/abs\/2503.08638\">arXiv:2503.08638<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>m-a-p has released &#8220;YuE2-3B&#8221;, an open music generation model that generates complete songs with vocals and accompaniment from lyrics and style prompts. It adopts a mechanism where an AR-NAR Mixture-of-Transformers backbone describes scores and semantic tokens, acoustic latent representations are generated via flow matching, and a VAE converts them into stereo audio.<\/p>\n<h2>Specifications<\/h2>\n<ul>\n<li>Architecture: AR-NAR Mixture-of-Transformers (YuE2ForCausalLM)<\/li>\n<li>Output Specification: 48 kHz stereo audio<\/li>\n<li>Supported Languages: Chinese (zh), English (en)<\/li>\n<li>License: cc-by-nc-4.0 (non-commercial use only)<\/li>\n<li>Number of Parameters: 3.6B<\/li>\n<\/ul>\n<h2>Performance and Quality<\/h2>\n<p>Evaluation results on WildSongBench and SHS100K are published in the model card.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th style=\"text-align: right;\">Musicality \u2191<\/th>\n<th style=\"text-align: right;\">SongBench Avg \u2191<\/th>\n<th style=\"text-align: right;\">MuLan \u2191<\/th>\n<th style=\"text-align: right;\">AllMusicCaps \u2191<\/th>\n<th style=\"text-align: right;\">Q3O \u2191<\/th>\n<th style=\"text-align: right;\">PER \u2193<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>YuE 1<\/td>\n<td style=\"text-align: right;\">4.0847<\/td>\n<td style=\"text-align: right;\">4.9165<\/td>\n<td style=\"text-align: right;\">0.2623<\/td>\n<td style=\"text-align: right;\">0.2882<\/td>\n<td style=\"text-align: right;\">3.7301<\/td>\n<td style=\"text-align: right;\">36.38%<\/td>\n<\/tr>\n<tr>\n<td>SongBloom<\/td>\n<td style=\"text-align: right;\">3.4493<\/td>\n<td style=\"text-align: right;\">4.2350<\/td>\n<td style=\"text-align: right;\">0.2697<\/td>\n<td style=\"text-align: right;\">0.1926<\/td>\n<td style=\"text-align: right;\">3.0287<\/td>\n<td style=\"text-align: right;\">19.19%<\/td>\n<\/tr>\n<tr>\n<td>LeVo 2<\/td>\n<td style=\"text-align: right;\">5.4590<\/td>\n<td style=\"text-align: right;\">6.3247<\/td>\n<td style=\"text-align: right;\">0.3542<\/td>\n<td style=\"text-align: right;\">0.2680<\/td>\n<td style=\"text-align: right;\">3.9458<\/td>\n<td style=\"text-align: right;\">26.12%<\/td>\n<\/tr>\n<tr>\n<td>ACE-Step 1.5<\/td>\n<td style=\"text-align: right;\">5.1588<\/td>\n<td style=\"text-align: right;\">6.0118<\/td>\n<td style=\"text-align: right;\">0.4372<\/td>\n<td style=\"text-align: right;\">0.3869<\/td>\n<td style=\"text-align: right;\">4.5809<\/td>\n<td style=\"text-align: right;\">7.46%<\/td>\n<\/tr>\n<tr>\n<td>HeartMuLa<\/td>\n<td style=\"text-align: right;\">5.4963<\/td>\n<td style=\"text-align: right;\">6.2483<\/td>\n<td style=\"text-align: right;\">0.3823<\/td>\n<td style=\"text-align: right;\">0.2786<\/td>\n<td style=\"text-align: right;\">3.4907<\/td>\n<td style=\"text-align: right;\">10.71%<\/td>\n<\/tr>\n<tr>\n<td>DiffRhythm 2<\/td>\n<td style=\"text-align: right;\">4.4775<\/td>\n<td style=\"text-align: right;\">5.2428<\/td>\n<td style=\"text-align: right;\">0.3782<\/td>\n<td style=\"text-align: right;\">0.3255<\/td>\n<td style=\"text-align: right;\">4.0870<\/td>\n<td style=\"text-align: right;\">18.41%<\/td>\n<\/tr>\n<tr>\n<td>Muse<\/td>\n<td style=\"text-align: right;\">5.1692<\/td>\n<td style=\"text-align: right;\">6.0349<\/td>\n<td style=\"text-align: right;\">0.3937<\/td>\n<td style=\"text-align: right;\">0.3466<\/td>\n<td style=\"text-align: right;\">4.4038<\/td>\n<td style=\"text-align: right;\">33.42%<\/td>\n<\/tr>\n<tr>\n<td>MiniMax Music 3<\/td>\n<td style=\"text-align: right;\">5.3482<\/td>\n<td style=\"text-align: right;\">6.2830<\/td>\n<td style=\"text-align: right;\">0.3928<\/td>\n<td style=\"text-align: right;\">0.3609<\/td>\n<td style=\"text-align: right;\">4.4362<\/td>\n<td style=\"text-align: right;\"><strong>6.27%<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/comfy-org-yue2-comfyui-release\/\">YuE2<\/a><\/strong><\/td>\n<td style=\"text-align: right;\">5.9075<\/td>\n<td style=\"text-align: right;\">6.7316<\/td>\n<td style=\"text-align: right;\"><strong>0.5068<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>0.4054<\/strong><\/td>\n<td style=\"text-align: right;\">4.6819<\/td>\n<td style=\"text-align: right;\">8.44%<\/td>\n<\/tr>\n<tr>\n<td><strong>YuE2 (best-of-8)<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.2666<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.9632<\/strong><\/td>\n<td style=\"text-align: right;\">0.5051<\/td>\n<td style=\"text-align: right;\">0.3980<\/td>\n<td style=\"text-align: right;\"><strong>4.7009<\/strong><\/td>\n<td style=\"text-align: right;\">9.79%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th style=\"text-align: right;\">Musicality \u2191<\/th>\n<th style=\"text-align: right;\">SongBench Avg \u2191<\/th>\n<th style=\"text-align: right;\">MuLan \u2191<\/th>\n<th style=\"text-align: right;\">AllMusicCaps \u2191<\/th>\n<th style=\"text-align: right;\">Q3O \u2191<\/th>\n<th style=\"text-align: right;\">PER \u2193<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Suno v5<\/td>\n<td style=\"text-align: right;\">5.9918<\/td>\n<td style=\"text-align: right;\">6.8721<\/td>\n<td style=\"text-align: right;\"><strong>0.5428<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>0.4353<\/strong><\/td>\n<td style=\"text-align: right;\">4.5907<\/td>\n<td style=\"text-align: right;\">8.10%<\/td>\n<\/tr>\n<tr>\n<td>Suno v4.5<\/td>\n<td style=\"text-align: right;\">5.8317<\/td>\n<td style=\"text-align: right;\">6.6995<\/td>\n<td style=\"text-align: right;\">0.5022<\/td>\n<td style=\"text-align: right;\">0.3873<\/td>\n<td style=\"text-align: right;\">4.4149<\/td>\n<td style=\"text-align: right;\"><strong>5.80%<\/strong><\/td>\n<\/tr>\n<tr>\n<td>Suno v5.5<\/td>\n<td style=\"text-align: right;\">5.8087<\/td>\n<td style=\"text-align: right;\">6.7150<\/td>\n<td style=\"text-align: right;\">0.5089<\/td>\n<td style=\"text-align: right;\">0.3917<\/td>\n<td style=\"text-align: right;\">4.5914<\/td>\n<td style=\"text-align: right;\">5.96%<\/td>\n<\/tr>\n<tr>\n<td>MiniMax Music 2.6<\/td>\n<td style=\"text-align: right;\">5.4437<\/td>\n<td style=\"text-align: right;\">6.3222<\/td>\n<td style=\"text-align: right;\">0.4251<\/td>\n<td style=\"text-align: right;\">0.3670<\/td>\n<td style=\"text-align: right;\">4.5688<\/td>\n<td style=\"text-align: right;\">24.55%<\/td>\n<\/tr>\n<tr>\n<td>Mureka 9<\/td>\n<td style=\"text-align: right;\">6.0488<\/td>\n<td style=\"text-align: right;\">6.9377<\/td>\n<td style=\"text-align: right;\">0.4394<\/td>\n<td style=\"text-align: right;\">0.4102<\/td>\n<td style=\"text-align: right;\">4.6368<\/td>\n<td style=\"text-align: right;\">11.69%<\/td>\n<\/tr>\n<tr>\n<td><strong><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/comfy-org-yue2-comfyui-release\/\">YuE2<\/a><\/strong><\/td>\n<td style=\"text-align: right;\">5.9075<\/td>\n<td style=\"text-align: right;\">6.7316<\/td>\n<td style=\"text-align: right;\">0.5068<\/td>\n<td style=\"text-align: right;\">0.4054<\/td>\n<td style=\"text-align: right;\">4.6819<\/td>\n<td style=\"text-align: right;\">8.44%<\/td>\n<\/tr>\n<tr>\n<td><strong>YuE2 (best-of-8)<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.2666<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.9632<\/strong><\/td>\n<td style=\"text-align: right;\">0.5051<\/td>\n<td style=\"text-align: right;\">0.3980<\/td>\n<td style=\"text-align: right;\"><strong>4.7009<\/strong><\/td>\n<td style=\"text-align: right;\">9.79%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>In WildSongBench evaluations, it is reported that YuE2 (best-of-8) achieved a SongBench average of 6.9632, the highest value among the compared open and proprietary models. On the other hand, it shows lower scores than some models in metrics such as PER (lower is better).<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<ul>\n<li>Text-to-song generation (complete music production via lyrics and style prompt input)<\/li>\n<li>Cover production of existing songs (reconstructing existing tracks into new styles)<\/li>\n<li>Editable scores (composition and editing by bringing melody and chords, melody only, or ABC scores)<\/li>\n<li>Agent-leveraged editing (reflecting musical feedback into revisions of scores, styles, and lyrics to render the next version)<\/li>\n<\/ul>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 3.6B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>12GB (RTX 4070 \/ 3060 12GB, etc.)<\/td>\n<td>BF16<\/td>\n<td>6.8GB<\/td>\n<td>8.1GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><strong>Inference engine support<\/strong> (architecture name matched against each project&#8217;s own model registry in its source code, checked 2026-11-03): llama.cpp: not registered, vLLM: not registered, MLX (mlx-lm): not registered. &#8220;Not registered&#8221; means the name is absent from that registry today, not that the model cannot run.<\/p>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p>The publisher distributes this model as safetensors.<\/p>\n<p><strong>License \u2014 <code>cc-by-nc-4.0<\/code> (Commercial use prohibited):<\/strong> <strong>Commercial use is prohibited<\/strong> (NC = NonCommercial). Internal business use can also count as commercial, so avoid this license for work use.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats and the license field. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:lab --><\/p>\n<h2>Our Own Measurements<\/h2>\n<h3>Measurements We Did Not Take<\/h3>\n<p>This model&#8217;s license (<code>cc-by-nc-4.0<\/code>) does not permit commercial use. Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).<\/p>\n<p><!-- \/lmw:lab --><\/p>\n<p><!-- lmw:files --><\/p>\n<h2>Distributed Files<\/h2>\n<p><em>Weight files published in <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\/tree\/main\">m-a-p\/YuE2-3B<\/a>, listed by this site from the Hugging Face API. Sizes are the actual file sizes.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>File<\/th>\n<th>Size<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code>model.safetensors<\/code><\/td>\n<td>7.26GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><!-- \/lmw:files --><\/p>\n<h2>How to Get It<\/h2>\n<ul>\n<li>Distribution Format: safetensors<\/li>\n<li>Source and Related Repository: <code>m-a-p\/YuE2-3B<\/code> on Hugging Face<\/li>\n<\/ul>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/15\/mothersuperior-yue2-realaudio-toolkit\/\">yue2-mothersuperior-realaudio-tokenizer-v4: 12GB+ VRAM, File List<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/comfy-org-yue2-comfyui-release\/\">YuE2: 12GB+ VRAM, ComfyUI Paths<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model runs from the 12GB tier) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-12gb-en\/\">Other models that run on a 12GB GPU<\/a><\/li>\n<li><strong>Explore the same model family<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-m-a-p-yue2-en\/\">YuE2 family overview (3 articles)<\/a><\/li>\n<li><strong>Formats this model is available in<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">Safetensors format guide and models<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-m-a-p-en\/\">M-A-P: models, licenses and articles<\/a><\/li>\n<li><strong>Other models for the same task<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-by-task-en\/#task-audio\">Other audio models<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">https:\/\/huggingface.co\/m-a-p\/YuE2-3B<\/a><\/li>\n<\/ul>\n<p><!-- lmw:updates --><\/p>\n<h2>Update History<\/h2>\n<ul>\n<li>2026-09-24: Rebuilt the article: Added a &#8220;can you run it locally?&#8221; verdict from the distribution formats, converted builds, engine registries, license terms and measured compression<\/li>\n<li>2026-09-25: Changed the title to show what the article covers (VRAM requirements, file list, etc.).<\/li>\n<\/ul>\n<p><!-- \/lmw:updates --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>m-a-p releases YuE2-3B, an open music generation model using AR-NAR Mixture-of-Transformers to generate 48kHz stereo audio.<\/p>\n","protected":false},"author":1,"featured_media":4147,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[203],"tags":[316,840,842,844,117,234,846],"class_list":["post-432","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-image-video-and-audio","tag-hugging-face-en","tag-m-a-p-en","tag-mixture-of-transformers-en","tag-yue2-3b-en","tag--en"],"lang":"en","translations":{"en":432,"ja":430},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/432","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=432"}],"version-history":[{"count":73,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/432\/revisions"}],"predecessor-version":[{"id":14823,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/432\/revisions\/14823"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/4147"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=432"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=432"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=432"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}