Model Healthcheck Skill
When the user requests a model test, follow these steps:
Steps
- 1. Get all model list
Use
gateway config.get to read the current config and extract all
provider/model combinations from
models.providers.
- 2. Test all models concurrently
For each model, use
sessions_spawn to run a test:
- task: "Reply with exactly: model ok. Only reply these two words."
- model: the corresponding provider/model-id
- runTimeoutSeconds: 30
- cleanup: "delete"
Fire all tests concurrently (multiple sessions_spawn calls at once), do not test sequentially.
- 3. Collect results and summarize
Wait for all tests to complete, then summarize as a list:
- provider/model-id — ✅ OK / ❌ Failed (Xs) — error message if any
Fields:
- Status: normal reply = ✅, timeout or error = ❌
- Duration: time from spawn to result
- Error: if failed, show the specific error (API error, timeout, auth failure, etc.)
- 4. Output results
Send the summary to the user, with a final tally:
- Total models tested: X
- Passed: X
- Failed: X (list failed model names and reasons)
Notes
- - Skip the model currently in use (no need to test yourself)
- If the user specifies a particular model, only test that one
- Feishu/WhatsApp and similar platforms don't support markdown tables — use list format instead
模型健康检查技能
当用户请求进行模型测试时,请按以下步骤操作:
步骤
- 1. 获取所有模型列表
使用 gateway config.get 读取当前配置,从 models.providers 中提取所有 provider/model 组合。
- 2. 并发测试所有模型
对每个模型,使用 sessions_spawn 运行测试:
- 任务:请仅回复:model ok。只回复这两个词。
- 模型:对应的 provider/model-id
- runTimeoutSeconds:30
- cleanup:delete
同时发起所有测试(一次性多次调用 sessions_spawn),不要顺序测试。
- 3. 收集结果并汇总
等待所有测试完成,然后汇总为列表:
- provider/model-id — ✅ 通过 / ❌ 失败 (Xs) — 错误信息(如有)
字段:
- 状态:正常回复 = ✅,超时或错误 = ❌
- 耗时:从发起测试到获取结果的时间
- 错误:如果失败,显示具体错误(API错误、超时、认证失败等)
- 4. 输出结果
将汇总结果发送给用户,并附上最终统计:
- 测试模型总数:X
- 通过:X
- 失败:X(列出失败模型名称及原因)
注意事项
- - 跳过当前正在使用的模型(无需测试自身)
- 如果用户指定了特定模型,仅测试该模型
- 飞书/WhatsApp等平台不支持Markdown表格——请使用列表格式