Loom Workflow Analyzer

Transforms Loom recordings into structured, automatable workflows.

Quick Start

CODEBLOCK0

Pipeline

1. 1. Download - Fetches Loom video via yt-dlp
2. Smart Extract - Captures frames at scene changes + transcript timing
3. Transcribe - Whisper transcription with word-level timestamps
4. Analyze - Multimodal AI analysis (requires vision model)
5. Generate - Creates Lobster workflow with approval gates

Smart Frame Extraction

Frames are captured when:

• - Scene changes - Significant visual change (ffmpeg scene detection)
• Speech starts - New narration segment begins
• Combined - Speech + visual change = high-value moment
• Gap fill - Max 10s without a frame

Analysis Output

The analyzer produces:

• - workflow-analysis.json - Structured workflow definition
• INLINECODE1 - Human-readable summary
• INLINECODE2 - Executable Lobster workflow file

Ambiguity Detection

The analyzer flags:

• - Unclear mouse movements
• Implicit knowledge ("the usual process")
• Decision points ("depending on...")
• Missing credentials/context
• Tool dependencies

Vision Analysis Step

After extraction, use the generated prompt with a vision model:

CODEBLOCK1

Save the JSON response to workflow-analysis.json, then:

CODEBLOCK2

Lobster Integration

Generated workflows use:

• - approve gates for destructive/external actions
• INLINECODE5 for classification/decision steps
• Resume tokens for interrupted workflows
• JSON piping between steps

Requirements

• - yt-dlp - Video download
• INLINECODE7 - Frame extraction + scene detection
• INLINECODE8 - Audio transcription
• Vision-capable LLM for analysis step

Multilingual Support

Works with any language - Whisper auto-detects and transcribes.
Analysis should be prompted in the video's language for best results.