{"id":16374,"date":"2026-11-17T11:04:37","date_gmt":"2026-11-17T02:04:37","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=16374"},"modified":"2026-11-17T11:04:39","modified_gmt":"2026-11-17T02:04:39","slug":"comfy-org-releases-world-model-pan2-for-comfyui","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/comfy-org-releases-world-model-pan2-for-comfyui\/","title":{"rendered":"PAN2 World Model for Simulating Physical Changes: ComfyUI Paths"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/Comfy-Org\/PAN2\">Comfy-Org\/PAN2<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-ifm-en\/\">IFM (MBZUAI): models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-11-15<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>apache-2.0<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">safetensors<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>Comfy-Org has released repackaged model files for the world model &#8220;PAN2&#8221; designed for use within the ComfyUI environment. The base model is &#8220;IFM\/PAN2&#8221;, developed by the Institute of Foundation Models (IFM) at MBZUAI.<\/p>\n<p>This model accepts text or images (starting frames) as input, predicts how the world will change based on specified actions, and outputs videos of up to 20 seconds. It is designed as a general-purpose world model that supports &#8220;simulative reasoning&#8221;\u2014simulating the results of potential actions before executing them to make optimal choices.<\/p>\n<h2>Specifications<\/h2>\n<p>The specifications of the base model &#8220;IFM\/PAN2&#8221; and the files organized for ComfyUI are as follows:<\/p>\n<ul>\n<li>Parameter Count and Architecture: Employs a 29B (approximately 29.2 billion) parameter MMDiT (Multimodal Diffusion Transformer) as its perceptual reasoning backbone. The overall architecture is based on the Generative Latent Prediction (GLP) framework, which combines &#8220;conceptual reasoning&#8221; using large language models with &#8220;perceptual reasoning&#8221; using latent diffusion models. Qwen3.5-9B is combined as the text encoder, and Wan 2.2 as the VAE decoder.<\/li>\n<li>Inputs and Supported Tasks: Supports Text-to-Video (T2V) and Image-to-Video (I2V). Inputs include structured world-state captions (event descriptions along a timeline) and, for I2V, a starting frame image.<\/li>\n<li>Output Specifications: Resolution is 704\u00d71248 pixels with a 24 fps frame rate. The model outputs videos of 241 frames (about 10 seconds) by default when no duration is specified, up to a maximum of 481 frames (about 20 seconds).<\/li>\n<li>Recommended Sampling Settings: Specified settings include 50 steps, a flow shift of 9, and a Classifier-free guidance (CFG) scale uniformly set to 2.5 on every step. A standard seed value of 123 and BF16 transformer precision are recommended. When running I2V, temporal latent 0 uses the positive prediction without guidance.<\/li>\n<li>License Conditions: Governed by the Apache-2.0 license. Out-of-scope uses explicitly include impersonating real people, creating deepfakes, spreading misinformation, generating sexually explicit or violent content for minors, infringing on intellectual property rights, and unverified integration into decision-making systems affecting human life or safety. Additionally, the publishers strongly recommend using &#8220;pan2-guardrail&#8221;, which combines &#8220;Qwen3Guard-Gen-4B&#8221; for pre-inspecting requests with &#8220;Q16&#8221; for post-inspecting generated video frames.<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>The checkpoint specifications and workflow configuration published in the model card for the base model &#8220;IFM\/PAN2&#8221; are as follows:<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Checkpoint<\/th>\n<th>Supported Tasks<\/th>\n<th>Input Conditions<\/th>\n<th>Output<\/th>\n<th>Precision<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>PAN 2 diffusion backbone (<code>IFM\/PAN2<\/code>)<\/td>\n<td>Text-to-video (<code>t2v<\/code>), Image-to-video (<code>i2v<\/code>)<\/td>\n<td>Structured world-state caption; optional first frame<\/td>\n<td>Video via the VAE decoder, 704&#215;1248 at 24 fps, up to 20 s<\/td>\n<td>BF16<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>Additionally, the recommended control settings for operating the simulator in a local environment are indicated as follows:<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Control<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Steps \/ flow shift<\/td>\n<td>50 \/ 9<\/td>\n<\/tr>\n<tr>\n<td>Classifier-free guidance<\/td>\n<td>2.5 on every step<\/td>\n<\/tr>\n<tr>\n<td>Resolution \/ frame rate<\/td>\n<td>704 x 1248 at 24 fps<\/td>\n<\/tr>\n<tr>\n<td>Frames<\/td>\n<td>241 (about 10 s) for entries without a duration; up to 481 (20 s)<\/td>\n<\/tr>\n<tr>\n<td>Seed<\/td>\n<td>123<\/td>\n<\/tr>\n<tr>\n<td>Precision<\/td>\n<td>bf16 transformer<\/td>\n<\/tr>\n<tr>\n<td>I2V<\/td>\n<td>temporal latent 0 uses the positive prediction without guidance<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>As an overall workflow, processing occurs in two stages: a &#8220;conceptual reasoning stage&#8221; that converts natural language prompts into structured state description JSON via prompt-rewriting skills, and a &#8220;perceptual pipeline stage&#8221; that generates video based on those structured descriptions.<\/p>\n<p>According to quality and safety evaluations reported by the publishers, internal testing using Kimi K3 for conceptual reasoning showed that using the recommended guardrails significantly reduced the rate of unsafe videos generated from harmful T2V requests from 33.9% down to 1.5%, while no unsafe outputs were observed for I2V. On the other hand, a trade-off was reported in which false-positive blocks occurred for harmless normal requests at 11.5% for T2V and 3.3% for I2V.<\/p>\n<p>Additionally, the model card lists the following quality and functional limitations noted by the publishers:<\/p>\n<ul>\n<li>Long-Term Planning Failures: In long-term planning simulations, about two-thirds of plans experience events where at least one step fails to execute.<\/li>\n<li>Prompt Dependency: Sensitive to the phrasing of prompts describing observations and actions, requiring manual prompt tuning for examples outside the training data.<\/li>\n<li>Consistency Degradation Over Time: Because generation relies on up to one starting frame and text per clip, subject appearance tends to drift during prolonged interactions.<\/li>\n<li>Physical Shortcuts: Cases have been observed where simulation progresses by bypassing physical constraints, such as pasta appearing inside a colander before being drained.<\/li>\n<\/ul>\n<h2>Strengths and Use Cases<\/h2>\n<p>The base model &#8220;IFM\/PAN2&#8221; focuses primarily on utilization as a &#8220;world model&#8221; that predicts changes in the state of the world based on input conditions and action instructions, unlike typical video generation models. Specifically, the following areas are envisioned:<\/p>\n<ul>\n<li>Action Simulation in Agents and Robotics: Suited for research and development of &#8220;simulative reasoning&#8221;, where autonomous agents or robots simulate the results of multiple action candidates as videos on PAN2 before deciding which action to execute, choosing the one that yields the best results.<\/li>\n<li>Verification of Physical and Causal Reasoning: Suitable for verifying and researching simulation capabilities regarding physical changes, object interactions, and causal relationships over time.<\/li>\n<li>Creative Production and Video Generation for Education and Evaluation: Beyond simple Text-to-Video, it supports Image-to-Video where a still image is specified as the starting frame, capable of generating coherent video simulations spanning up to 20 seconds (704\u00d71248, 24 fps).<\/li>\n<\/ul>\n<p>For video generation, the model is designed to easily reproduce higher-precision physical behaviors and scene developments by inputting structured world-state descriptions along a timeline, such as time-specified actions linked to actors and camera work.<\/p>\n<p>The Comfy-Org version released this time repackages these base model features for easy handling within ComfyUI, a node-based image and video generation environment. Alongside the original BF16 weights, files including an INT8 quantized version (<code>pan2_int8_convrot.safetensors<\/code>) and a corresponding quantized text encoder (<code>qwen3.5_9b_int8_convrot.safetensors<\/code>) are bundled together, shaped for easy experimentation within personal PC or local server workflows.<\/p>\n<p><!-- lmw:files --><\/p>\n<h2>Distributed Files<\/h2>\n<p><em>Weight files published in <a href=\"https:\/\/huggingface.co\/Comfy-Org\/PAN2\/tree\/main\">Comfy-Org\/PAN2<\/a>, listed by this site from the Hugging Face API. Sizes are the actual file sizes.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>File<\/th>\n<th>Size<\/th>\n<th>ComfyUI folder<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code>diffusion_models\/pan2_bf16.safetensors<\/code><\/td>\n<td>67.37GB<\/td>\n<td><code>models\/diffusion_models\/<\/code><\/td>\n<\/tr>\n<tr>\n<td><code>diffusion_models\/pan2_int8_convrot.safetensors<\/code><\/td>\n<td>26.68GB<\/td>\n<td><code>models\/diffusion_models\/<\/code><\/td>\n<\/tr>\n<tr>\n<td><code>text_encoders\/qwen3.5_9b_bf16.safetensors<\/code><\/td>\n<td>19.31GB<\/td>\n<td><code>models\/text_encoders\/<\/code><\/td>\n<\/tr>\n<tr>\n<td><code>text_encoders\/qwen3.5_9b_int8_convrot.safetensors<\/code><\/td>\n<td>9.75GB<\/td>\n<td><code>models\/text_encoders\/<\/code><\/td>\n<\/tr>\n<tr>\n<td><code>vae\/wan2.2_vae.safetensors<\/code><\/td>\n<td>1.41GB<\/td>\n<td><code>models\/vae\/<\/code><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>The ComfyUI folder is shown only where the repository&#8217;s layout mirrors ComfyUI&#8217;s <code>models\/<\/code> directory.<\/em><\/p>\n<p><!-- \/lmw:files --><\/p>\n<h2>How to Get It<\/h2>\n<p>These model files are available on the Hugging Face Comfy-Org repository in safetensors format. Since no access restrictions (gated model) are set, anyone can download them directly without completing prior agreement procedures for terms of use.<\/p>\n<p>When using them in ComfyUI, place the downloaded files according to the following directory structure:<\/p>\n<pre><code>\ud83d\udcc2 ComfyUI\/\n\u251c\u2500\u2500 \ud83d\udcc2 models\/\n\u2502   \u251c\u2500\u2500 \ud83d\udcc2 diffusion_models\/\n\u2502   \u2502   \u251c\u2500\u2500 pan2_bf16.safetensors\n\u2502   \u2502   \u2514\u2500\u2500 pan2_int8_convrot.safetensors\n\u2502   \u251c\u2500\u2500 \ud83d\udcc2 text_encoders\/\n\u2502   \u2502   \u2514\u2500\u2500 qwen3.5_9b_int8_convrot.safetensors\n\u2502   \u251c\u2500\u2500 \ud83d\udcc2 vae\/\n\u2502   \u2502   \u2514\u2500\u2500 wan2.2_vae.safetensors\n<\/code><\/pre>\n<ul>\n<li>Diffusion Model: Place <code>pan2_bf16.safetensors<\/code> or the quantized version <code>pan2_int8_convrot.safetensors<\/code> in the <code>ComfyUI\/models\/diffusion_models\/<\/code> directory.<\/li>\n<li>Text Encoder: Place <code>qwen3.5_9b_int8_convrot.safetensors<\/code> in the <code>ComfyUI\/models\/text_encoders\/<\/code> directory.<\/li>\n<li>VAE Decoder: Place <code>wan2.2_vae.safetensors<\/code> in the <code>ComfyUI\/models\/vae\/<\/code> directory.<\/li>\n<\/ul>\n<p>Note that the base model &#8220;IFM\/PAN2&#8221; is also compatible with usage via Diffusers pipelines and vLLM, in addition to ComfyUI.<\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p>The publisher distributes this model as safetensors.<\/p>\n<p><strong>License \u2014 <code>apache-2.0<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats and the license field. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/comfy-org-minimax-h3-image-released\/\">MiniMax-H3-Image 16-Megapixel Image Generation Model: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/comfy-org-idol-comfyui-release\/\">Idol 3D Gaussian Splatting Generation Model: ComfyUI Paths<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/comfy-org-ming-3-0-tts-2\/\">Ming-3.0-TTS Multilingual TTS Model: 24GB+ VRAM, ComfyUI Paths<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/comfy-org-fibo-2-0-comfyui\/\">Fibo-2.0 Image Generation and Editing Diffusion Model: 32GB+ VRAM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Engines that run this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-comfyui-en\/\">ComfyUI<\/a><\/li>\n<li><strong>Formats this model is available in<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">Safetensors format guide and models<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-ifm-en\/\">IFM (MBZUAI): models, licenses and articles<\/a><\/li>\n<li><strong>Other models for the same task<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-by-task-en\/#task-image\">Other image generation models<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li>Comfy-Org\/PAN2: <a href=\"https:\/\/huggingface.co\/Comfy-Org\/PAN2\">https:\/\/huggingface.co\/Comfy-Org\/PAN2<\/a><\/li>\n<li>IFM\/PAN2: <a href=\"https:\/\/huggingface.co\/IFM\/PAN2\">https:\/\/huggingface.co\/IFM\/PAN2<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Comfy-Org has released the world model PAN2 repackaged for ComfyUI. Learn about its specs, hardware requirements, and how to get it.<\/p>\n","protected":false},"author":1,"featured_media":16373,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[203],"tags":[1142,677,2051,5059,996,1547,5061,753],"class_list":["post-16374","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-image-video-and-audio","tag-comfy-org-en","tag-comfyui-en","tag-ifm-en","tag-pan2-en","tag-qwen3-5-en","tag-verified","tag-wan-en","tag--en"],"lang":"en","translations":{"en":16374,"ja":16372},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/16374","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=16374"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/16374\/revisions"}],"predecessor-version":[{"id":17198,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/16374\/revisions\/17198"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/16373"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=16374"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=16374"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=16374"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}