Model details
模型介绍 中文整理 Emu3: Next-Token Prediction is All You Need
Emu3 Team, BAAI
Model use case Emu3是一个开源多模态模型，通过next-token prediction任务进行训练。通过将图像和文本标记化为离散空间，Emu3在多模态序列混合数据上从头训练单个transformer。它是基于transformer架构的自回归语言模型。
主要能力
图像生成：Emu3能够根据文本输入生成高质量图像，只需预测下一个视觉token。支持灵活的分辨率和风格。
视觉语言理解：Emu3展现出强大的视觉语言理解能力，能够感知物理世界并提供连贯的文本响应。该能力不依赖CLIP和预训练的大型语言模型。
视频生成：Emu3通过预测视频序列中的下一个token来生成视频，与Sora等视频扩散模型不同。给定一段视频作为上下文，Emu3可以自然地扩展视频，预测接下来会发生什么。
性能表现：Emu3在生成和感知任务中优于多个成熟的任务特定模型超越了SDXL、LLaVA-1.6和OpenSora-1.6等旗舰开源模型，同时无需使用扩散模型或组合架构。
输入输出
输入：文本提示、图像、视频
输出：生成的图像、视频或文本响应
运行要求 需要transformers >= 4.48.0
建议使用GPU设备运行
建议使用Flash-Attention 2进一步加速生成
基本用法 以下是在GPU设备上以float16精度运行生成的示例脚本（需安装transformers库）。
限制 模型的具体限制信息未在原文中提供。
License 相关信息请参阅原始GitHub仓库。
资源
论文或更多资源：https://github.com/baaivision/Emu3
优先采用原作者提供的中文模型卡片；仅有英文说明时由闲社AI翻译整理。重要参数、许可证和商用范围请以原文为准。
你将获得什么 完整仓库方式包含该固定版本中的权重、配置、分词器及说明文件；指定版本方式只下载所选文件或整组分片。多模态模型的投影文件、配置等依赖，请按作者说明配齐。
完整仓库可能包含多个权重格式，因此需要的磁盘空间可能大于单一格式的模型大小。下载文件不等于完成模型部署。
使用前须知 运行环境 运行模型需要的设备、工具与依赖，以原作者说明为准。
授权范围 是否允许商用、修改和分发，请查看模型许可证。
闲社提供资料与镜像下载方法，不代表已运行模型或完成安全审计。下载的代码应先检查，再执行。
Problem with the information or download? Sign in to submit feedback.
Pinned version · Multiple download options
Emu3-Gen-hf model download Download the full repository or choose a version or file.
Choose a download source China mirror (recommended) Hugging Face official 已根据访问地区推荐 Hugging Face 官方线路，你可以手动切换。
Choose what to download
Full repository · All files Selected version / file Need just one GGUF precision? Load the file manifest and choose a version. Direct file links do not require Python; the command below can download multiple shards together.
Load available versions and files
Quantization / file Load the manifest to choose This reads the pinned version's file manifest; no model weights are downloaded.
Choose your operating system Windows · PowerShell Linux / macOS · Terminal For command-line downloads, follow these steps to get the full repository or selected files. Direct file links do not need these steps.
1 Open a terminal window Create and open a folder for the model. In the folder's address bar, enter powershell and press Enter.
If Python is not installed, get it from the official Python website . In the terminal, enter python --version; continue when a version number appears.
2 First time? Install the download tool Copy this command, paste it into the terminal, press Enter and wait for installation to finish.
python -m pip install --upgrade huggingface_hubCopy install command Already installed? Continue to step 3.
3 Run the download command Select the button below, paste into the same terminal and press Enter. The tool downloads all files included in the current command.
Copy full download command Copying does not start a download. Paste and run the command on your device.
Where are the downloaded files? Open the folder you chose. Look for the models folder. When progress stops and the terminal returns to its prompt without errors, check that all files are present. 'Copied' does not mean 'downloaded'.
No response or an error? python not found: Install Python and reopen the terminal. On Windows, follow the installer's instructions to enable command-line access.
hf not found: Confirm that step 2 succeeded, then reopen the terminal. If needed, add Python's Scripts folder to your user PATH. Do not repeatedly download scripts.
Network interrupted: Stay in the same folder and run the same command again. The tool checks existing files.
Permission or disk error: Choose a writable folder with enough free space. Do not disable system security protection.
View the full download command 请开启浏览器脚本，或使用默认 Windows 教程并展开命令手动复制执行。
