DS-160 Auto-fill Skill

This skill automates the filling of US nonimmigrant visa DS-160 forms by combining:

• - CDP (Chrome DevTools Protocol) for fast element location
• CSV data source for user information
• LLM assistance for complex cases (captcha, missing elements)
• Session persistence for resume capability
• Chinese to English translation for user input

Quick Start

Starting a New Application

1. 1. Provide CSV data: User must provide a CSV file with their personal information (use ds160-user-info.csv as template)

1. 2. Open DS-160 website: Use browser tool to open https://ceac.state.gov/genniv/ with profile INLINECODE3

1. 3. Initialize session: Load and execute scripts/ds160-filler.js to parse mappings and CSV

1. 4. Start filling: Begin with the home page, handle captcha with LLM, then proceed page by page

Resuming an Application

1. 1. Load existing session: Check ds160/ds160-session.json for saved Application ID

1. 2. Open application: Use the saved Application ID to resume on DS-160 website

1. 3. Continue filling: Load CSV from saved location and continue from last page

Core Workflow

Step 1: Prepare Data

Always check if session exists first:
CODEBLOCK0

New application mode:

• - Ask user for CSV file path or content
• Save CSV to ds160/ds160-user-info.csv using write tool
• Initialize session data in ds160/ds160-session.json:

Resume mode:

• - Load CSV from INLINECODE9
• Load session from INLINECODE10
• Report current progress to user

Step 2: Initialize Browser

CODEBLOCK2

Step 3: Fill Current Page

For each page in sequence:

1. 1. Snapshot page to understand current state:

1. 2. Load mappings from INLINECODE11

1. 3. Execute fill logic using browser act with evaluate:

1. 4. Handle results:

Step 4: Handle Special Cases

Captcha:

• - Take screenshot of captcha area
• Use image tool to analyze captcha
• Fill captcha code via browser evaluate

Missing element:

• - Call LLM with page snapshot
• Ask LLM to locate element and provide alternative selector
• Retry fill operation

Translation needed:

• - Call LLM with field context and Chinese value
• Ask LLM to translate to appropriate English value
• Update CSV and retry fill operation

Missing user data:

• - Identify which field is missing
• Report to user with field name and description
• Important: Save current page using browser evaluate before pausing
• Wait for user to provide data

Step 5: Save Progress & Continue

After completing a page:

1. 1. Update session data:

1. 2. Save to file: INLINECODE14

1. 3. Report progress to user:

1. 4. Click "Continue" button to proceed to next page

Data Structures

CSV Format

The CSV must have these columns:

1. 1. 页面 - Page name
2. INLINECODE16 - Field identifier (matches YAML name field)
3. INLINECODE18 - English description
4. INLINECODE19 - Chinese description
5. INLINECODE20 - Required? (是/否)
6. INLINECODE21 - Example value
7. INLINECODE22 - User-provided value (this is what gets filled)

Important: Users can provide values in Chinese. The script includes a built-in translation dictionary for common fields (gender, marital status, countries, etc.). For fields not in the dictionary, LLM will be called for translation automatically.

YAML Structure

Each page in ds160-elements.yaml contains:

• - page_id: Unique page identifier
• INLINECODE25: Human-readable page name
• INLINECODE26: Page URL pattern
• INLINECODE27: Array of form elements with:

Error Handling

Element Not Found

Symptoms: fillPage returns INLINECODE37

Action:

1. 1. Take page snapshot
2. Call LLM with:

1. 3. Retry with LLM-suggested selector

Translation Needed

Symptoms: fillPage returns INLINECODE39

Action:

1. 1. Call LLM with translation context:

1. 2. Update CSV with translated value
2. Retry fill operation with translated value

Example LLM prompt for translation:
CODEBLOCK6

Data Missing

Symptoms: fillPage returns INLINECODE41

Action:

1. 1. CRITICAL: Save current page before pausing:

   // Find and click "Save" button
   browser_act: {
     request: { kind: "click", ref: "save_button" }
   }
   

1. 2. Report missing field to user:

1. 3. Update CSV with new data using write tool
2. Resume filling

Captcha

Symptoms: Captcha image detected on page

Action:

1. 1. Take screenshot of captcha area
2. Use image tool:

   image: {
     image: "/path/to/captcha.png",
     prompt: "What is the code shown in this captcha? Return only the code characters."
   }
   

1. 3. Fill captcha field via browser evaluate
2. Submit form

Page Sequence

The pages are filled in this order:

1. 1. home - Start application, select location, handle captcha
2. securityquestion - Confirm Application ID, set security question
3. personal1 - Personal information (name, gender, DOB)
4. personal2 - Nationality, other nationalities, IDs
5. travel - Travel purpose, dates, who is paying
6. travelcompanions - People traveling with you
7. previousustravel - Previous US visits
8. addressphone - Current address and phone
9. passport - Passport information
10. uscontact - US point of contact
11. familyrelatives - Family information
12. workeducation - Work and education history
13. security_background - Security questions

Progress Reporting

Report to user after each page:

CODEBLOCK9

Include in every report:

• - Application ID (once obtained)
• Security question and answer (once generated)
• Current progress (X/Y pages)
• Next page name

LLM Integration

When to Call LLM

1. 1. Captcha detection: Always use LLM to read captcha
2. Element not found: When multiple locator strategies fail
3. Translation needed: When user provides Chinese value not in built-in dictionary
4. Complex elements: For elements that require understanding context
5. Validation errors: When form submission fails with unclear reason

LLM Prompts

For element location:
CODEBLOCK10

For captcha:
CODEBLOCK11

Translation Dictionary

The script includes a built-in translation dictionary for common Chinese values. This covers:

Gender:

• - 男/男性 → MALE
• 女/女性 → FEMALE

Marital Status:

• - 已婚 → MARRIED
• 未婚 → SINGLE
• 离异 → DIVORCED
• 丧偶 → WIDOWED
• 合法分居 → LEGALLY SEPARATED
• 事实婚姻 → COMMON LAW MARRIAGE
• 民事结合 → CIVIL UNION/DOMESTIC PARTNERSHIP

Yes/No:

• - 是/有/是，有 → Yes
• 否/没有/否，没有 → No

Countries:

• - 中国 → CHINA
• 美国 → USA
• 英国 → UNITED KINGDOM
• 日本 → JAPAN
• 韩国 → KOREA, SOUTH

Visa Types:

• - 旅游/商务/商务/旅游 → B1/B2
• 学生 → F1
• 访问学者 → J1
• 工作 → H1B

Payment:

• - 自己/自费 → SELF
• 公司 → OTHER COMPANY
• 其他人 → OTHER PERSON

Relationship (US Point of Contact):

• - 朋友 → Friend
• 亲戚 → Relative
• 同事 → Colleague
• 配偶 → Spouse
• 同学 → Classmate
• 其他 → Other

Other Values:

• - 不适用/不，不适用 → Does Not Apply

For values not in this dictionary, LLM will be automatically called for translation.

Session Persistence

Session file location: INLINECODE44

Session data structure:
CODEBLOCK12

When to save session:

• - After completing each page
• Before pausing for user input
• After receiving Application ID
• After setting security question/answer

Browser Automation Notes

Always use openclaw profile to maintain session across pages.

Use browser act with evaluate for form filling:

• - More reliable than individual click/type actions
• Can execute complex JavaScript
• Better error handling

Use browser snapshot before each page:

• - Check page state
• Identify dynamic elements
• Verify page loaded correctly

Testing Checklist

Before using this skill with real data:

• - [ ] Test element location on each page type
• [ ] Verify CSV parsing with sample data
• [ ] Test captcha handling with LLM
• [ ] Verify session save/load functionality
• [ ] Test resume from middle of application
• [ ] Verify "Save" button clicking works before pauses
• [ ] Test with various element types (text, select, radio, checkbox)
• [ ] Verify progress reporting format
• [ ] Test Chinese to English translation

Example Usage

User says: "Help me fill DS-160 form with my data in this.csv"

Agent workflow:

1. 1. Load SKILL.md (this file)
2. Check for existing session
3. Save CSV to ds160/ds160-user-info.csv
4. Initialize session
5. Open browser to DS-160
6. Fill page by page
7. Report progress after each page
8. Handle errors with LLM or user input
9. Save progress and continue

User says: "Continue filling my DS-160 form"

Agent workflow:

1. 1. Load SKILL.md
2. Load existing session
3. Open browser to DS-160 with Application ID
4. Load CSV from saved location
5. Continue from last page
6. Report progress
7. Complete remaining pages

Files Reference

• - scripts/ds160-filler.js - Core automation logic (run via browser evaluate)
• references/ds160-elements.yaml - Element mappings (read-only)
• references/ds160-user-info.csv - User data template (copy to workspace)
• ds160/ds160-session.json - Session persistence (auto-created)
• ds160/ds160-user-info.csv - Active user data (auto-created)

Important Notes

• - NEVER submit the final form - this is for automation/testing only
• Always save before pausing - prevents data loss
• Report progress frequently - at least every page
• Keep Application ID secure - it's sensitive information
• Use fake data for testing - don't use real personal info
• Chinese input is supported - use built-in dictionary or LLM for translation