{"id":432,"date":"2026-09-10T22:15:10","date_gmt":"2026-09-10T13:15:10","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/09\/10\/yue2-3b-music-generation-model\/"},"modified":"2026-09-18T21:41:58","modified_gmt":"2026-09-18T12:41:58","slug":"yue2-3b-music-generation-model","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/10\/yue2-3b-music-generation-model\/","title":{"rendered":"YuE2-3B Music Generation Model Released for Lyrics &#038; Styles"},"content":{"rendered":"<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">m-a-p\/YuE2-3B<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-09-10<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>cc-by-nc-4.0<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td>safetensors<\/td>\n<\/tr>\n<tr>\n<td>Paper<\/td>\n<td><a href=\"https:\/\/arxiv.org\/abs\/2503.08638\">arXiv:2503.08638<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code at collection time. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<p><em>Sample outputs are available on the <a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">model card<\/a>.<\/em><\/p>\n<h2>Overview<\/h2>\n<p>m-a-p has released &#8220;YuE2-3B&#8221;, an open music generation model that generates complete songs with vocals and accompaniment from lyrics and style prompts. It adopts a mechanism where an AR-NAR Mixture-of-Transformers backbone describes scores and semantic tokens, acoustic latent representations are generated via flow matching, and a VAE converts them into stereo audio.<\/p>\n<h2>Specifications<\/h2>\n<ul>\n<li>Architecture: AR-NAR Mixture-of-Transformers (YuE2ForCausalLM)<\/li>\n<li>Output Specification: 48 kHz stereo audio<\/li>\n<li>Supported Languages: Chinese (zh), English (en)<\/li>\n<li>License: cc-by-nc-4.0 (non-commercial use only)<\/li>\n<li>Number of Parameters: 3.6B<\/li>\n<\/ul>\n<h2>Performance and Quality<\/h2>\n<p>Evaluation results on WildSongBench and SHS100K are published in the model card.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th style=\"text-align: right;\">Musicality \u2191<\/th>\n<th style=\"text-align: right;\">SongBench Avg \u2191<\/th>\n<th style=\"text-align: right;\">MuLan \u2191<\/th>\n<th style=\"text-align: right;\">AllMusicCaps \u2191<\/th>\n<th style=\"text-align: right;\">Q3O \u2191<\/th>\n<th style=\"text-align: right;\">PER \u2193<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>YuE 1<\/td>\n<td style=\"text-align: right;\">4.0847<\/td>\n<td style=\"text-align: right;\">4.9165<\/td>\n<td style=\"text-align: right;\">0.2623<\/td>\n<td style=\"text-align: right;\">0.2882<\/td>\n<td style=\"text-align: right;\">3.7301<\/td>\n<td style=\"text-align: right;\">36.38%<\/td>\n<\/tr>\n<tr>\n<td>SongBloom<\/td>\n<td style=\"text-align: right;\">3.4493<\/td>\n<td style=\"text-align: right;\">4.2350<\/td>\n<td style=\"text-align: right;\">0.2697<\/td>\n<td style=\"text-align: right;\">0.1926<\/td>\n<td style=\"text-align: right;\">3.0287<\/td>\n<td style=\"text-align: right;\">19.19%<\/td>\n<\/tr>\n<tr>\n<td>LeVo 2<\/td>\n<td style=\"text-align: right;\">5.4590<\/td>\n<td style=\"text-align: right;\">6.3247<\/td>\n<td style=\"text-align: right;\">0.3542<\/td>\n<td style=\"text-align: right;\">0.2680<\/td>\n<td style=\"text-align: right;\">3.9458<\/td>\n<td style=\"text-align: right;\">26.12%<\/td>\n<\/tr>\n<tr>\n<td>ACE-Step 1.5<\/td>\n<td style=\"text-align: right;\">5.1588<\/td>\n<td style=\"text-align: right;\">6.0118<\/td>\n<td style=\"text-align: right;\">0.4372<\/td>\n<td style=\"text-align: right;\">0.3869<\/td>\n<td style=\"text-align: right;\">4.5809<\/td>\n<td style=\"text-align: right;\">7.46%<\/td>\n<\/tr>\n<tr>\n<td>HeartMuLa<\/td>\n<td style=\"text-align: right;\">5.4963<\/td>\n<td style=\"text-align: right;\">6.2483<\/td>\n<td style=\"text-align: right;\">0.3823<\/td>\n<td style=\"text-align: right;\">0.2786<\/td>\n<td style=\"text-align: right;\">3.4907<\/td>\n<td style=\"text-align: right;\">10.71%<\/td>\n<\/tr>\n<tr>\n<td>DiffRhythm 2<\/td>\n<td style=\"text-align: right;\">4.4775<\/td>\n<td style=\"text-align: right;\">5.2428<\/td>\n<td style=\"text-align: right;\">0.3782<\/td>\n<td style=\"text-align: right;\">0.3255<\/td>\n<td style=\"text-align: right;\">4.0870<\/td>\n<td style=\"text-align: right;\">18.41%<\/td>\n<\/tr>\n<tr>\n<td>Muse<\/td>\n<td style=\"text-align: right;\">5.1692<\/td>\n<td style=\"text-align: right;\">6.0349<\/td>\n<td style=\"text-align: right;\">0.3937<\/td>\n<td style=\"text-align: right;\">0.3466<\/td>\n<td style=\"text-align: right;\">4.4038<\/td>\n<td style=\"text-align: right;\">33.42%<\/td>\n<\/tr>\n<tr>\n<td>MiniMax Music 3<\/td>\n<td style=\"text-align: right;\">5.3482<\/td>\n<td style=\"text-align: right;\">6.2830<\/td>\n<td style=\"text-align: right;\">0.3928<\/td>\n<td style=\"text-align: right;\">0.3609<\/td>\n<td style=\"text-align: right;\">4.4362<\/td>\n<td style=\"text-align: right;\"><strong>6.27%<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/comfy-org-yue2-comfyui-release\/\">YuE2<\/a><\/strong><\/td>\n<td style=\"text-align: right;\">5.9075<\/td>\n<td style=\"text-align: right;\">6.7316<\/td>\n<td style=\"text-align: right;\"><strong>0.5068<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>0.4054<\/strong><\/td>\n<td style=\"text-align: right;\">4.6819<\/td>\n<td style=\"text-align: right;\">8.44%<\/td>\n<\/tr>\n<tr>\n<td><strong>YuE2 (best-of-8)<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.2666<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.9632<\/strong><\/td>\n<td style=\"text-align: right;\">0.5051<\/td>\n<td style=\"text-align: right;\">0.3980<\/td>\n<td style=\"text-align: right;\"><strong>4.7009<\/strong><\/td>\n<td style=\"text-align: right;\">9.79%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th style=\"text-align: right;\">Musicality \u2191<\/th>\n<th style=\"text-align: right;\">SongBench Avg \u2191<\/th>\n<th style=\"text-align: right;\">MuLan \u2191<\/th>\n<th style=\"text-align: right;\">AllMusicCaps \u2191<\/th>\n<th style=\"text-align: right;\">Q3O \u2191<\/th>\n<th style=\"text-align: right;\">PER \u2193<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Suno v5<\/td>\n<td style=\"text-align: right;\">5.9918<\/td>\n<td style=\"text-align: right;\">6.8721<\/td>\n<td style=\"text-align: right;\"><strong>0.5428<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>0.4353<\/strong><\/td>\n<td style=\"text-align: right;\">4.5907<\/td>\n<td style=\"text-align: right;\">8.10%<\/td>\n<\/tr>\n<tr>\n<td>Suno v4.5<\/td>\n<td style=\"text-align: right;\">5.8317<\/td>\n<td style=\"text-align: right;\">6.6995<\/td>\n<td style=\"text-align: right;\">0.5022<\/td>\n<td style=\"text-align: right;\">0.3873<\/td>\n<td style=\"text-align: right;\">4.4149<\/td>\n<td style=\"text-align: right;\"><strong>5.80%<\/strong><\/td>\n<\/tr>\n<tr>\n<td>Suno v5.5<\/td>\n<td style=\"text-align: right;\">5.8087<\/td>\n<td style=\"text-align: right;\">6.7150<\/td>\n<td style=\"text-align: right;\">0.5089<\/td>\n<td style=\"text-align: right;\">0.3917<\/td>\n<td style=\"text-align: right;\">4.5914<\/td>\n<td style=\"text-align: right;\">5.96%<\/td>\n<\/tr>\n<tr>\n<td>MiniMax Music 2.6<\/td>\n<td style=\"text-align: right;\">5.4437<\/td>\n<td style=\"text-align: right;\">6.3222<\/td>\n<td style=\"text-align: right;\">0.4251<\/td>\n<td style=\"text-align: right;\">0.3670<\/td>\n<td style=\"text-align: right;\">4.5688<\/td>\n<td style=\"text-align: right;\">24.55%<\/td>\n<\/tr>\n<tr>\n<td>Mureka 9<\/td>\n<td style=\"text-align: right;\">6.0488<\/td>\n<td style=\"text-align: right;\">6.9377<\/td>\n<td style=\"text-align: right;\">0.4394<\/td>\n<td style=\"text-align: right;\">0.4102<\/td>\n<td style=\"text-align: right;\">4.6368<\/td>\n<td style=\"text-align: right;\">11.69%<\/td>\n<\/tr>\n<tr>\n<td><strong><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/comfy-org-yue2-comfyui-release\/\">YuE2<\/a><\/strong><\/td>\n<td style=\"text-align: right;\">5.9075<\/td>\n<td style=\"text-align: right;\">6.7316<\/td>\n<td style=\"text-align: right;\">0.5068<\/td>\n<td style=\"text-align: right;\">0.4054<\/td>\n<td style=\"text-align: right;\">4.6819<\/td>\n<td style=\"text-align: right;\">8.44%<\/td>\n<\/tr>\n<tr>\n<td><strong>YuE2 (best-of-8)<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.2666<\/strong><\/td>\n<td style=\"text-align: right;\"><strong>6.9632<\/strong><\/td>\n<td style=\"text-align: right;\">0.5051<\/td>\n<td style=\"text-align: right;\">0.3980<\/td>\n<td style=\"text-align: right;\"><strong>4.7009<\/strong><\/td>\n<td style=\"text-align: right;\">9.79%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>In WildSongBench evaluations, it is reported that YuE2 (best-of-8) achieved a SongBench average of 6.9632, the highest value among the compared open and proprietary models. On the other hand, it shows lower scores than some models in metrics such as PER (lower is better).<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<ul>\n<li>Text-to-song generation (complete music production via lyrics and style prompt input)<\/li>\n<li>Cover production of existing songs (reconstructing existing tracks into new styles)<\/li>\n<li>Editable scores (composition and editing by bringing melody and chords, melody only, or ABC scores)<\/li>\n<li>Agent-leveraged editing (reflecting musical feedback into revisions of scores, styles, and lyrics to render the next version)<\/li>\n<\/ul>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 3.6B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>12GB (RTX 4070 \/ 3060 12GB, etc.)<\/td>\n<td>BF16<\/td>\n<td>6.8GB<\/td>\n<td>8.1GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><strong>Inference engine support<\/strong> (architecture name matched against each project&#8217;s own model registry in its source code, checked 2026-09-18): llama.cpp: not registered, vLLM: not registered, MLX (mlx-lm): not registered. &#8220;Not registered&#8221; means the name is absent from that registry today, not that the model cannot run.<\/p>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<h2>How to Get It<\/h2>\n<ul>\n<li>Distribution Format: safetensors<\/li>\n<li>Source and Related Repository: <code>m-a-p\/YuE2-3B<\/code> on Hugging Face<\/li>\n<\/ul>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/15\/mothersuperior-yue2-realaudio-toolkit\/\">Mothersuperior Releases Real Audio Toolkit for YuE2-3B<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/comfy-org-yue2-comfyui-release\/\">Comfy-Org Releases YuE2 for ComfyUI: Open Music Generation<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/m-a-p\/YuE2-3B\">https:\/\/huggingface.co\/m-a-p\/YuE2-3B<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>m-a-p releases YuE2-3B, an open music generation model using AR-NAR Mixture-of-Transformers to generate 48kHz stereo audio.<\/p>\n","protected":false},"author":1,"featured_media":431,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[203],"tags":[316,840,842,844,117,234,846],"class_list":["post-432","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-image-video-and-audio","tag-hugging-face-en","tag-m-a-p-en","tag-mixture-of-transformers-en","tag-yue2-3b-en","tag--en"],"lang":"en","translations":{"en":432,"ja":430},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/432","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=432"}],"version-history":[{"count":10,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/432\/revisions"}],"predecessor-version":[{"id":1744,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/432\/revisions\/1744"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/431"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=432"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=432"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=432"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}