Setup
On first use, read setup.md.
When to Use
User needs to generate, edit, or scale AI videos with current models and APIs.
Use this skill to choose the right current model stack, write stronger motion prompts, and run reliable async video pipelines.
Architecture
User preferences persist in ~/video-generation/. See memory-template.md for setup.
CODEBLOCK0
Quick Reference
| Topic | File |
|---|
| Initial setup | INLINECODE3 |
| Memory template |
memory-template.md |
| Migration guide |
migration.md |
| Model snapshot |
benchmarks.md |
| Async API patterns |
api-patterns.md |
| OpenAI Sora 2 |
openai-sora.md |
| Google Veo 3.x |
google-veo.md |
| Runway Gen-4 |
runway.md |
| Luma Ray |
luma.md |
| ByteDance Seedance |
seedance.md |
| Kling |
kling.md |
| Vidu |
vidu.md |
| Pika via Fal |
pika.md |
| MiniMax Hailuo |
minimax-hailuo.md |
| Replicate routing |
replicate.md |
| Open-source local models |
open-source-video.md |
| Distribution playbook |
promotion.md |
Core Rules
1. Resolve model aliases before API calls
Map community names to real API model IDs first.
Examples: sora-2, sora-2-pro, veo-3.0-generate-001, gen4_turbo, gen4_aleph.
2. Route by task, not brand preference
| Task | First choice | Backup |
|---|
| Premium prompt-only generation | INLINECODE25 | INLINECODE26 |
| Fast drafts at lower cost |
veo-3.1-fast-generate-001 |
gen4_turbo |
| Long-form cinematic shots |
gen4_aleph |
ray-2 |
| Strong image-to-video control |
veo-3.0-generate-001 |
gen4_turbo |
| Multi-shot narrative consistency | Seedance family |
hailuo-2.3 |
| Local privacy-first workflows | Wan2.2 / HunyuanVideo | CogVideoX |
3. Draft cheap, finish expensive
Start with low duration and lower tier, validate motion and composition, then rerender winners with premium models or longer durations.
4. Design prompts as shot instructions
Always include subject, action, camera motion, lens style, lighting, and scene timing.
For references and start/end frames, keep continuity constraints explicit.
5. Assume async and failure by default
Every provider pipeline must support queued jobs, polling/backoff, retries, cancellation, and signed-URL download before expiry.
6. Keep a fallback chain
If the preferred model is blocked or overloaded:
1) same provider lower tier, 2) equivalent cross-provider model, 3) open model/local run.
Common Traps
- - Using nickname-only model labels in code -> avoidable API failures
- Pushing 8-10 second generations before validating a 3-5 second draft -> wasted credits
- Cropping after generation instead of generating native ratio -> lower composition quality
- Ignoring prompt enhancement toggles -> tone drift across providers
- Reusing expired output URLs -> broken export workflows
- Treating all providers as synchronous -> stalled jobs and bad timeout handling
External Endpoints
| Provider | Endpoint | Data Sent | Purpose |
|---|
| OpenAI | INLINECODE34 | Prompt text, optional input images/video refs | Sora 2 video generation |
| Google Vertex AI |
aiplatform.googleapis.com | Prompt text, optional image input, generation params | Veo 3.x generation |
| Runway |
api.dev.runwayml.com | Prompt text, optional input media | Gen-4 generation and image-to-video |
| Luma |
api.lumalabs.ai | Prompt text, optional keyframes/start-end images | Ray generation |
| Fal |
queue.fal.run | Prompt text, optional input media | Pika and Hailuo hosted APIs |
| Replicate |
api.replicate.com | Prompt text, optional input media | Multi-model routing and experimentation |
| Vidu |
api.vidu.com | Prompt text, optional start/end/reference images | Vidu text/image/reference video APIs |
| Tencent MPS |
mps.tencentcloudapi.com | Prompt text and generation parameters | Unified AIGC video task APIs |
No other data is sent externally.
Security & Privacy
Data that leaves your machine:
- - Prompt text
- Optional reference images or clips
- Requested rendering parameters (duration, resolution, aspect ratio)
Data that stays local:
- - Provider preferences in INLINECODE42
- Optional local job history in INLINECODE43
This skill does NOT:
- - Store API keys in project files
- Upload media outside requested provider calls
- Delete local assets unless the user asks
Trust
This skill can send prompts and media references to third-party AI providers.
Only install if you trust those providers with your content.
Related Skills
Install with
clawhub install <slug> if user confirms:
- -
image-generation - Build still concepts and keyframes before video generation - INLINECODE46 - Prepare clean references, masks, and style frames
- INLINECODE47 - Post-process generated clips and final exports
- INLINECODE48 - Add subtitle and text overlay workflows
- INLINECODE49 - Compose, transcode, and package production outputs
Feedback
- - If useful: INLINECODE50
- Stay updated: INLINECODE51
设置
首次使用时,请阅读 setup.md。
使用时机
用户需要使用当前模型和API生成、编辑或缩放AI视频时。
使用此技能选择合适的最新模型栈,编写更强的运动提示词,并运行可靠的异步视频流水线。
架构
用户偏好设置保存在 ~/video-generation/ 目录中。配置方法请参见 memory-template.md。
text
~/video-generation/
├── memory.md # 首选提供商、模型路由、可复用的镜头配方
└── history.md # 可选的任务运行日志,包含任务、成本和输出
快速参考
memory-template.md |
| 迁移指南 | migration.md |
| 模型快照 | benchmarks.md |
| 异步API模式 | api-patterns.md |
| OpenAI Sora 2 | openai-sora.md |
| Google Veo 3.x | google-veo.md |
| Runway Gen-4 | runway.md |
| Luma Ray | luma.md |
| 字节跳动 Seedance | seedance.md |
| Kling | kling.md |
| Vidu | vidu.md |
| 通过Fal使用Pika | pika.md |
| MiniMax Hailuo | minimax-hailuo.md |
| Replicate路由 | replicate.md |
| 开源本地模型 | open-source-video.md |
| 分发策略手册 | promotion.md |
核心规则
1. 在API调用前解析模型别名
首先将社区名称映射为真实的API模型ID。
示例:sora-2、sora-2-pro、veo-3.0-generate-001、gen4turbo、gen4aleph。
2. 按任务路由,而非品牌偏好
| 任务 | 首选 | 备选 |
|---|
| 仅凭提示词生成高质量视频 | sora-2-pro | veo-3.1-generate-001 |
| 低成本快速草稿 |
veo-3.1-fast-generate-001 | gen4_turbo |
| 长时长电影级镜头 | gen4_aleph | ray-2 |
| 强图像到视频控制 | veo-3.0-generate-001 | gen4_turbo |
| 多镜头叙事一致性 | Seedance系列 | hailuo-2.3 |
| 本地隐私优先工作流 | Wan2.2 / HunyuanVideo | CogVideoX |
3. 先草稿,后精修
从低时长和低层级开始,验证运动和构图,然后使用高级模型或更长的时长重新渲染优胜者。
4. 将提示词设计为镜头指令
始终包含主体、动作、摄像机运动、镜头风格、光照和场景时间。
对于参考帧和起始/结束帧,保持连续性约束明确。
5. 默认假设异步和故障
每个提供商流水线必须支持排队任务、轮询/退避、重试、取消以及在过期前下载带签名的URL。
6. 保留备用链路
如果首选模型被封锁或过载:
1) 同一提供商的低层级模型,2) 等效的跨提供商模型,3) 开源模型/本地运行。
常见陷阱
- - 在代码中仅使用昵称式模型标签 -> 可避免的API故障
- 在验证3-5秒草稿前直接生成8-10秒视频 -> 浪费积分
- 生成后裁剪而非使用原生比例生成 -> 构图质量降低
- 忽略提示词增强开关 -> 不同提供商间语气不一致
- 重复使用已过期的输出URL -> 导出工作流中断
- 将所有提供商视为同步 -> 任务停滞和超时处理不当
外部端点
| 提供商 | 端点 | 发送的数据 | 用途 |
|---|
| OpenAI | api.openai.com | 提示文本,可选的输入图像/视频参考 | Sora 2视频生成 |
| Google Vertex AI |
aiplatform.googleapis.com | 提示文本,可选的图像输入,生成参数 | Veo 3.x生成 |
| Runway | api.dev.runwayml.com | 提示文本,可选的输入媒体 | Gen-4生成和图像到视频 |
| Luma | api.lumalabs.ai | 提示文本,可选的关键帧/起始-结束图像 | Ray生成 |
| Fal | queue.fal.run | 提示文本,可选的输入媒体 | Pika和Hailuo托管API |
| Replicate | api.replicate.com | 提示文本,可选的输入媒体 | 多模型路由和实验 |
| Vidu | api.vidu.com | 提示文本,可选的起始/结束/参考图像 | Vidu文本/图像/参考视频API |
| 腾讯MPS | mps.tencentcloudapi.com | 提示文本和生成参数 | 统一AIGC视频任务API |
不会向外部发送其他数据。
安全与隐私
离开您机器的数据:
- - 提示文本
- 可选的参考图像或片段
- 请求的渲染参数(时长、分辨率、宽高比)
保留在本地的数据:
- - ~/video-generation/memory.md 中的提供商偏好设置
- ~/video-generation/history.md 中可选的本地任务历史记录
此技能不会:
- - 在项目文件中存储API密钥
- 在请求的提供商调用之外上传媒体
- 删除本地资产,除非用户要求
信任
此技能可以将提示词和媒体参考发送给第三方AI提供商。
只有在您信任这些提供商处理您的内容时才安装。
相关技能
如果用户确认,使用 clawhub install
安装:
- - image-generation - 在视频生成前构建静态概念和关键帧
- image-edit - 准备干净的参考图、遮罩和风格帧
- video-edit - 后处理生成的片段和最终导出
- video-captions - 添加字幕和文本叠加工作流
- ffmpeg - 合成、转码和打包制作输出
反馈
- - 如果觉得有用:clawhub star video-generation
- 保持更新:clawhub sync