Free Search Aggregator

Reliable, provider-diverse web search for OpenClaw with high uptime + low operator overhead.

Why use this skill

• - 12 search providers, 6 requiring no API key at all
• Automatic failover: if one provider fails, the next is tried instantly
• Quota-aware: tracks daily usage, warns at 80%, skips exhausted providers
• Task search mode for multi-angle research queries
• Built-in storage lifecycle (cache / index / report), no workspace clutter
• Self-healing: health-based smart routing automatically promotes reliable providers
• Quality optimization: relevance scoring, fuzzy dedup, domain diversity, re-ranking
• Auto-discovery: probes candidate search engines and SearXNG instances for new sources
• Self-diagnostic: doctor and setup commands for zero-friction onboarding

Provider Overview

Total daily quota (all keys configured): 8400+ requests/day

Credential model (important)

• - No mandatory API key — DuckDuckGo + Bing RSS + Mojeek + Wikipedia work out of the box.
• API-key providers fail gracefully if key is missing (AuthError → skip, no quota consumed, no latency):

Core capabilities

1. Search failover

brave → exa → tavily → duckduckgo → bing_html → mojeek → serper → searchapi → google_cse → baidu → wikipedia

2. Task-level multi-query search

• - Expands one goal into multiple targeted queries
• Aggregates + deduplicates results
• Prefix presets:

3. Quota intelligence

• - Per-provider daily tracking
• Real quota retrieval where supported (Tavily, SearchAPI, Brave via probe)
• Auto concurrency reduction at 80% quota saturation

4. Provider health monitoring

• - Tracks success rate, latency, and error types per provider over time
• Computes health scores (success 50%, latency 30%, freshness 20%)
• Smart ordering: auto-promotes healthy providers, demotes degraded ones
• View dashboard: INLINECODE28

5. Result quality optimization

• - Relevance scoring (query-title-snippet token overlap)
• Enhanced dedup: URL + title similarity (Jaccard threshold)
• Domain diversity: limits same-domain results (default max 3)
• Automatic filtering of low-quality results (short titles, missing URLs)

6. Source auto-discovery

• - Probes all configured providers for availability
• Scans candidate search engines (Marginalia, Wiby, public SearXNG instances)
• Validates response format, latency, and result quality
• Generates recommendations for new sources to integrate
• Run: INLINECODE29

7. Managed persistence

• - INLINECODE30
• INLINECODE31
• INLINECODE32

Quick commands

CODEBLOCK1

Provider setup guides

Bing RSS (bing_html) — No key needed

Mojeek — No key needed (API key optional)

1. 1. Register at https://www.mojeek.com/services/search/api/
2. Set MOJEEK_API_KEY → automatically switches to JSON API mode

Wikipedia — No key needed

Exa.ai — API key required

1. 1. Register at https://exa.ai/
2. Set INLINECODE38
3. Free tier: 1000 searches/month (~33/day)

Google Custom Search — API key + CX required

1. 1. Get API key: https://developers.google.com/custom-search/v1/introduction
2. Create search engine: https://programmablesearchengine.google.com/
3. Set GOOGLE_API_KEY and INLINECODE40
4. Free tier: 100 queries/day

Baidu Qianfan — API key required

1. 1. Register at https://cloud.baidu.com/
2. Set INLINECODE41
3. Best for Chinese-language content

SearXNG — Self-hosted instance required

docker run -d -p 8080:8080 searxng/searxng

searxng:
  endpoint: http://localhost:8080
  enabled: true

Post-install self-check

CODEBLOCK5

Output contract (stable)

• - Search: query, provider, results[], meta.attempted, INLINECODE47
• Task search: task, queries[], grouped_results[], merged_results[], INLINECODE52
• Quota: date, providers[], totals; with --real: INLINECODE57

Operator notes

• - Default mode: workers=1 — conservative for cost control
• Use @dual / @deep only for research tasks
• INLINECODE61 and YaCy are enabled: false by default (self-hosted only)
• INLINECODE64 is optional — provider gracefully falls back to HTML scraping
• Provider health data stored in INLINECODE65
• Discovery results stored in INLINECODE66
• Run python -m free_search doctor after setup to verify everything works
• Run python -m free_search discover periodically to find new search sources