VeriGlow Agent Map
VeriGlow Agent Map is a registry of Agent-readable documentation for websites. Each "map" tells you exactly how to extract structured data from a specific web page — including hidden APIs, request parameters, response schemas, browser automation recipes, and real-world agent reports.
When to Use This Skill
Use Agent Map when you need to:
- - Get structured data from a website (financial data, government data, e-commerce, etc.)
- Discover hidden/internal APIs behind a web page
- Automate browser interactions with a specific site
- Check if other agents have successfully used a data source
How to Query Agent Map
To look up a map for any URL, visit:
CODEBLOCK0
For example, to find the map for https://www.sse.com.cn/market/bonddata/overview/day/:
CODEBLOCK1
You can also fetch the page content programmatically:
CODEBLOCK2
What a Map Contains
Each Agent Map page has three sections:
1. Available Data
Documents every data function the page exposes:
- - API endpoint (method, URL, parameters)
- Request example (curl command you can run directly)
- Response schema (column names, types, examples)
- Caveats (rate limits, IP restrictions, data freshness)
2. Page Internals
For browser automation fallback:
- - JS controller objects and trigger methods
- DOM selectors for data tables and input fields
- Rendering method (server-side vs client-side)
- Auth and anti-scraping status
- Complete action steps (Playwright/Puppeteer recipe)
3. Agent Reports
Real-world usage reports from agents who have called this data source:
- - Success/failure status and response times
- Edge cases discovered (half-day trading, IP blocks, etc.)
- Recommended workarounds
Example: SSE Bond Trading Data
Here is a complete example of using an Agent Map to get Shanghai Stock Exchange bond trading data.
Direct API Call (Preferred)
CODEBLOCK3
Parameters:
| Name | Type | Required | Description |
|---|
| searchDate | string | Yes | Query date in YYYY-MM-DD format |
| jsonCallBack |
string | No | JSONP callback name. Omit for pure JSON. |
Returns: JSON with 17 rows × 4 columns:
| Column | Type | Example | Description |
|---|
| 债券品种 | string | 国债 | Bond type category |
| 成交笔数 |
number | 15,234 | Number of trades |
| 成交面额(亿元) | number | 2,068.77 | Face value traded (100M RMB) |
| 成交金额(亿元) | number | 2,087.45 | Trading amount (100M RMB) |
Bond types (17 categories): 国债, 地方政府债, 企业债, 公司债, 可转换债, 可分离债, 资产支持证券, 国际机构债, 政策性金融债, 同业存单, and more.
Caveats:
- - Non-trading days (weekends, holidays) return all-zero rows
- Data availability: T+1, updated ~1 hour after market close (15:30 CST)
- Overseas IP may get 403 — use a CN-based proxy if needed
Browser Automation Fallback
If the direct API is blocked, use these action steps:
CODEBLOCK4
Best Practices
- 1. Always prefer direct API calls over browser automation — they are faster and more reliable
- Check the Agent Reports section before calling a new data source — other agents may have documented edge cases
- Respect rate limits — if a map documents rate limiting, throttle your requests accordingly
- Handle IP restrictions — some Chinese government/financial data sources block overseas IPs; use a CN proxy when noted
- Verify data freshness — check the "Data availability" note for each source (e.g., T+1 means data is from the previous trading day)
Available Maps (59 data sources)
Currently indexed: 55 Shanghai Stock Exchange pages + 4 international APIs.
Shanghai Stock Exchange (上海证券交易所) — 55 maps
Stock Data (股票数据):
www.sse.com.cn/market/stockdata/statistic/ | 1 |
|
Stock Weekly Overview |
www.sse.com.cn/market/stockdata/overview/weekly/ | 1 |
|
Stock Monthly Overview |
www.sse.com.cn/market/stockdata/overview/monthly/ | 1 |
|
IPO First-Day Performance |
www.sse.com.cn/market/stockdata/firstday/ | 1 |
|
IPO (Initial Public Offering) |
www.sse.com.cn/market/stockdata/raise/ipo/ | 1 |
|
Secondary Offering |
www.sse.com.cn/market/stockdata/raise/additional/ | 1 |
|
Rights Issue |
www.sse.com.cn/market/stockdata/raise/allotment/ | 1 |
|
Share Capital Overview |
www.sse.com.cn/market/stockdata/structure/overview/ | 3 |
|
Share Capital Ranking |
www.sse.com.cn/market/stockdata/structure/rank/ | 1 |
|
Cash Dividends |
www.sse.com.cn/market/stockdata/dividends/dividend/ | 1 |
|
Bonus Shares |
www.sse.com.cn/market/stockdata/dividends/bonus/ | 1 |
|
Shanghai Market P/E Ratio |
www.sse.com.cn/market/stockdata/price/sh/ | 1 |
|
Main Board Market Cap Ranking |
www.sse.com.cn/market/stockdata/marketvalue/main/ | 1 |
|
STAR Market Market Cap Ranking |
www.sse.com.cn/market/stockdata/marketvalue/star/ | 1 |
|
Main Board Trading Activity |
www.sse.com.cn/market/stockdata/activity/main/ | 1 |
|
STAR Market Trading Activity |
www.sse.com.cn/market/stockdata/activity/star/ | 1 |
|
Preferred Share Statistics |
www.sse.com.cn/market/stockdata/pshare/ | 1 |
Index Data (指数):
www.sse.com.cn/market/sseindex/indexlist/basic/ | 4 |
|
Index Quotation |
www.sse.com.cn/market/sseindex/quotation/ | 1 |
Fund Data (基金数据):
www.sse.com.cn/market/funddata/overview/weekly/ | 1 |
|
Fund Monthly Overview |
www.sse.com.cn/market/funddata/overview/monthly/ | 1 |
|
Fund Annual Overview |
www.sse.com.cn/market/funddata/overview/yearly/ | 1 |
|
Public REITs Scale |
www.sse.com.cn/market/funddata/volumn/reits/ | 1 |
|
LOF Scale |
www.sse.com.cn/market/funddata/volumn/lofvolumn/ | 2 |
|
Graded LOF Fund Scale |
www.sse.com.cn/market/funddata/volumn/fjlofvolumn/ | 1 |
Bond Data (债券数据):
www.sse.com.cn/market/bonddata/overview/weekly/ | 1 |
|
Bond Monthly Overview |
www.sse.com.cn/market/bonddata/overview/monthly/ | 1 |
|
Bond Annual Overview |
www.sse.com.cn/market/bonddata/overview/yearly/ | 1 |
|
Bond Statistics |
www.sse.com.cn/market/bonddata/statistic/ | 1 |
|
Convertible Bond Trading |
www.sse.com.cn/market/bonddata/dxkzzcj/ | 1 |
|
Exchangeable Bond Conversion |
www.sse.com.cn/market/bonddata/exchangeable/ | 2 |
|
Bond Yield Statistics |
www.sse.com.cn/market/bonddata/profit/ | 1 |
|
Bond Clean & Dirty Price |
www.sse.com.cn/market/bonddata/netfull/ | 1 |
|
Active Bond Varieties |
www.sse.com.cn/market/bonddata/livelybond/ | 1 |
Other Data (其他数据):
www.sse.com.cn/market/othersdata/margin/detail/ | 2 |
|
Securities Lending Overview |
www.sse.com.cn/market/othersdata/refinancing/lend/ | 1 |
|
Strategic Placement Lending (Main) |
www.sse.com.cn/market/othersdata/zlpskcjxx/main/ | 1 |
|
Strategic Placement Lending (STAR) |
www.sse.com.cn/market/othersdata/zlpskcjxx/star/ | 1 |
|
Asset Management Share Transfer |
www.sse.com.cn/market/othersdata/asset/ | 1 |
|
Member List |
www.sse.com.cn/market/othersdata/memberdata/memberlist/ | 1 |
| ...and 10 more member/business qualification pages | | |
International APIs — 4 maps
open-meteo.com/en/docs/ | 1 |
|
Hacker News Top Stories |
news.ycombinator.com/ | 2 |
More maps are being added continuously. Visit veri-glow.com to browse all 59 maps or request a new one.
VeriGlow Agent Map
VeriGlow Agent Map 是一个网站的可代理读取文档注册表。每张地图都能准确告诉你如何从特定网页提取结构化数据——包括隐藏API、请求参数、响应模式、浏览器自动化配方以及真实世界的代理报告。
何时使用此技能
在以下情况下使用 Agent Map:
- - 从网站获取结构化数据(金融数据、政府数据、电子商务等)
- 发现网页背后的隐藏/内部API
- 自动化与特定网站的浏览器交互
- 检查其他代理是否已成功使用某个数据源
如何查询 Agent Map
要查找任何URL的地图,请访问:
https://veri-glow.com/{不带协议的-目标-url}
例如,要查找 https://www.sse.com.cn/market/bonddata/overview/day/ 的地图:
https://veri-glow.com/www.sse.com.cn/market/bonddata/overview/day/
你也可以通过编程方式获取页面内容:
bash
curl https://veri-glow.com/www.sse.com.cn/market/bonddata/overview/day/
地图包含的内容
每张 Agent Map 页面包含三个部分:
1. 可用数据
记录页面暴露的每个数据函数:
- - API端点(方法、URL、参数)
- 请求示例(可直接运行的curl命令)
- 响应模式(列名、类型、示例)
- 注意事项(速率限制、IP限制、数据新鲜度)
2. 页面内部结构
用于浏览器自动化回退:
- - JS控制器对象和触发方法
- DOM选择器用于数据表和输入字段
- 渲染方式(服务器端 vs 客户端)
- 认证和反爬虫状态
- 完整操作步骤(Playwright/Puppeteer配方)
3. 代理报告
调用过此数据源的代理的真实使用报告:
- - 成功/失败状态和响应时间
- 发现的边缘情况(半日交易、IP封锁等)
- 推荐的解决方案
示例:上交所债券交易数据
以下是使用 Agent Map 获取上海证券交易所债券交易数据的完整示例。
直接API调用(推荐)
bash
curl https://www.sse.com.cn/js/common/sseBond498Fixed.js?searchDate=2025-02-11
参数:
| 名称 | 类型 | 必填 | 描述 |
|---|
| searchDate | string | 是 | 查询日期,格式为 YYYY-MM-DD |
| jsonCallBack |
string | 否 | JSONP回调名称。省略则返回纯JSON。 |
返回: JSON格式,17行 × 4列:
| 列名 | 类型 | 示例 | 描述 |
|---|
| 债券品种 | string | 国债 | 债券类型分类 |
| 成交笔数 |
number | 15,234 | 交易笔数 |
| 成交面额(亿元) | number | 2,068.77 | 成交面额(亿元人民币) |
| 成交金额(亿元) | number | 2,087.45 | 成交金额(亿元人民币) |
债券类型(17类): 国债、地方政府债、企业债、公司债、可转换债、可分离债、资产支持证券、国际机构债、政策性金融债、同业存单等。
注意事项:
- - 非交易日(周末、节假日)返回全零行
- 数据可用性:T+1,收盘后约1小时更新(北京时间15:30)
- 海外IP可能返回403——如有需要请使用中国代理
浏览器自动化回退
如果直接API被屏蔽,请使用以下操作步骤:
javascript
// 步骤1:设置日期
document.querySelector(.js_date input).value = 2025-02-11
// 步骤2:触发查询(等待3秒以获取AJAX响应)
overviewDay.setOverviewDayParams()
// 步骤3:提取表格
const table = document.querySelector(.table-responsive table)
const headers = [...table.querySelectorAll(thead th)].map(th => th.textContent.trim())
const rows = [...table.querySelectorAll(tbody tr)].map(tr =>
[...tr.querySelectorAll(td)].map(td => td.textContent.trim())
)
最佳实践
- 1. 始终优先使用直接API调用而非浏览器自动化——它们更快更可靠
- 在调用新数据源前检查代理报告部分——其他代理可能已记录边缘情况
- 遵守速率限制——如果地图记录了速率限制,请相应调整请求频率
- 处理IP限制——一些中国政府/金融数据源会屏蔽海外IP;如有标注请使用中国代理
- 验证数据新鲜度——检查每个数据源的数据可用性说明(例如,T+1表示数据来自前一个交易日)
可用地图(59个数据源)
当前索引:55个上海证券交易所页面 + 4个国际API。
上海证券交易所 — 55张地图
股票数据:
| 数据源 | URL | 功能数 |
|---|
| 市场概览 | www.sse.com.cn/market/view/ | 1 |
| 统计概览 |
www.sse.com.cn/market/stockdata/statistic/ | 1 |
|
股票周度概览 | www.sse.com.cn/market/stockdata/overview/weekly/ | 1 |
|
股票月度概览 | www.sse.com.cn/market/stockdata/overview/monthly/ | 1 |
|
IPO首日表现 | www.sse.com.cn/market/stockdata/firstday/ | 1 |
|
IPO(首次公开发行) | www.sse.com.cn/market/stockdata/raise/ipo/ | 1 |
|
增发 | www.sse.com.cn/market/stockdata/raise/additional/ | 1 |
|
配股 | www.sse.com.cn/market/stockdata/raise/allotment/ | 1 |
|
股本概览 | www.sse.com.cn/market/stockdata/structure/overview/ | 3 |
|
股本排名 | www.sse.com.cn/market/stockdata/structure/rank/ | 1 |
|
现金分红 | www.sse.com.cn/market/stockdata/dividends/dividend/ | 1 |
|
送股 | www.sse.com.cn/market/stockdata/dividends/bonus/ | 1 |
|
沪市市盈率 | www.sse.com.cn/market/stockdata/price/sh/ | 1 |
|
主板市值排名 | www.sse.com.cn/market/stockdata/marketvalue/main/ | 1 |
|
科创板市值排名 | www.sse.com.cn/market/stockdata/marketvalue/star/ | 1 |
|
主板交易活跃度 | www.sse.com.cn/market/stockdata/activity/main/ | 1 |
|
科创板交易活跃度 | www.sse.com.cn/market/stockdata/activity/star/ | 1 |
| [优先股统计](https://veri-glow.com/www