Information
# Open Agent RL Dataset: High Quality AI Agent | Tool Use & Function Calls | Reinforcement Learning Datasets
DeepNLP website provides **high quality, genuinue, online users' request** of Agent & RL datasets to help LLM foundation/SFT/Post Train to get more capable models at function call, tool use and planning. The datasets are collected and sampled
from users' requests on our various clients (Web/App/Mini App) and [Open OneKey Agent Router](https://www.deepnlp.org/agent/onekey-mcp-router) and [Open OneKey MCP Router](https://www.deepnlp.org/agent/onekey-mcp-router). Some datasets requires credit to deduct and you can easily gain more credit by activities such as commenting and discussion and uploading your own datasets to the communities (https://www.deepnlp.org/workspace/billing).
Visit Our AI Store Dataset Tab to Select [Dataset](https://www.deepnlp.org/store/dataset).
**Disclaimer**: Safe privacy preserving or personalized information are marked and filtered out.
## 1. Dataset Features
**Genuinue Users' Queries**: Most of the high quality datasets are collected from query logs of our live AI Agents, such as [MCP Tool Use Agent](https://agent.deepnlp.org/agent/mcp_tool_use), [Open OneKey Agent Router](https://www.deepnlp.org/agent/onekey-mcp-router) and [Open OneKey MCP Router](https://www.deepnlp.org/agent/onekey-mcp-router).
**Function Call and MCP Servers Support**: The datasets covers wide range of MCP servers from the Open MCP Marketplace() and Playgrounds.
**Users Action and Humans' Feedback**: Users' actual feedbacks are crucial in improving the AI Agents training process. We collects users' genuine actions, such as **ACCEPT/REJECT** in confirming the function call results, **Upvote/Downvote** action of the final responses, and many other users' feedback on clickable elements.
**Various Domains and Tasks**: We covers 40+ categories of AI agents' tool use scenarios, ranging from information seeking (AI search, map search, etc) to autonomous AI agents browser use, computer use, Data Analysis, Excel Spreadsheet and Powerpoint creation and generation, etc.
**Example AI Agent Dataset Dialogues**
| Domain | Related MCP Server| Demo |
| ---- | ---- | ---- |
| Office File Agent | Excel Spreadsheet, Powerpoint, PDF, etc | [Example](https://agent.deepnlp.org/agent/mcp_tool_use/share/ee640008-6bc1-4c3a-832b-2557f985b540) [MCP]() |
| AI Search/Deep Research | Bing/Google Custom/Perplexity/Tavily/Firecrawl | [Demo](https://agent.deepnlp.org/agent/mcp_tool_use?server=tavily-ai/tavily-mcp) [MCP]() |
| Map Trip Planning | GoogleMap, Amap(Gaode), BaiduMap, etc. | [Example](https://agent.deepnlp.org/agent/mcp_tool_use/share/8ab0b25c-b72d-4cae-9c86-a852df8c6541) [MCP](https://agent.deepnlp.org/agent/mcp_tool_use?server=amap-mcp/amap-mcp-%E9%AB%98%E5%BE%B7%E5%9C%B0%E5%9B%BE-mcp) [Use MCP]() |
| Browser Usage | Playwright, Puppeteer, etc. | [Demo](https://agent.deepnlp.org/agent/mcp_tool_use?server=puppeteer/puppeteer) [MCP]() |
| Chart,Graph,Image | everart,mcp-server-charts(AntV),canva-mcp | [Demo](https://agent.deepnlp.org/agent/mcp_tool_use/share/93d94694-e673-49d3-b805-820c4ef842bd) [MCP]() |
## 2. Dataset Introduction
We provide main below types of AI agents datasets in List of Messages Json Formats and scalar data such as rewards, etc.
| Dataset Name | Description | User Feedback | Example Dataset Download | Full DataSet Download |
|----------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| ---- |-------|-----------------------------------------------------------------------------------------------------------------|
| Tool Use Multi-Turn Dialogue | The tool use multi-turn dialogue dataset is in the list of messages formats, Useful for AI Search/Deep Research/Map/Financial Data/etc | YES | 50 instances, [Download](https://www.deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-tool-use-dialogue-open-dataset-example) | 1k, [Download](https://www.deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-tool-use-dialogue-open-dataset) |
| Function Calling Tool Use | The dataset contains **messages** and **available tools** as input and output the choosen **tool_call** result indicating which tool to use and the arguments. The datasets are collected from calling SOTA LLM such as GPT, OpenAI o-series, Claude, Qwen, Kimi, etc. | No | 50 instances, [Download](https://deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-function-calling-open-dataset-example) | 1k, [Download](https://deepnlp.org/store/ai-agent/ai-agent/pub-deepnlp/agent-function-calling-open-dataset) |
| Reinforcement Learning | Sessions of user and assistant' multi-dialogues, rewards from users' feedback in this session, such click of confirmation (Accept/Reject), Upvote, Downvote on the responses, etc. | YES | 50 instances, [Download](https://deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-reinforcement-learning-open-dataset-example) | 1k, [Download](https://deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-reinforcement-learning-open-dataset) |
### Dataset 2 Function Calling Tool Use Dataset
The functions call tool use datasets contains both the List of **messages** (Users' original query) and **Available Tools** (List of Json) and **Tool Call Results** produced by SOTA LLM.
For example, the LLM chooses **puppeteer_navigate** tool from 7 other tools of MCP Server puppeteer. And set the parameters as **\{\"url\": \"https://www.baidu.com\"\}**
**Dataset Description**
| KEY | Description |
|--------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| trace_id | Identify each unique new user request or API calling |
| session_id | The identifier of each dialogue, which consists of multiple turns of dialogues and every user input produces a new trace_id |
| data | The Json Object of Each Function Call |
| data.function_calls.messages | List of messages in \{"role":"", "content":""\} formats. |
| data.function_calls.tools | List of available tools, including the schema of tools name, description and parameters |
| data.function_calls.tool_calls | Dict of tool_id, function, arguments |
| tool_calls_results | Note: Tool Call Result are tool running actual output, which can be found in the list of dialogue message in Dataset 1, but not needed for training function call models training dataset |
Format
\`\`\`
\{
"model": "claude-opus-4",
"session_id": "37e83ca0-d0d4-4204-b3e6-95be51bf57a6",
"trace_id": "5c6a8e17-e121-4786-955d-0a716ed733ae",
"function_calls": [\{
"messages": [],
"tools": [],
"tool_calls": \{
"id": "",
"function": \{"arguments":"", "name":""\},
"type": ""
\}
\},
\{
"messages": [],
"tools": [],
"tool_calls": \{
"id": "",
"function": \{"arguments":"", "name":""\},
"type": ""
\}
\}
]
\}
\`\`\`
Data Example of Puppeteer Navigate Open Website.
\`\`\`
\{
"trace_id": "72d51b6e-8c48-42ee-bfc9-05209d1444c8",
"session_id": "7ca7e84c-cee5-4ddd-be1e-748df2be481e",
"model": "claude-opus-4",
"data": \{
"function_calls": [\{
"messages": [\{
"role": "user",
"content": "Visit website baidu.com and take a screenshot"
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_f02ba9ee6b344dd0af9041",
"type": "tool_use",
"function": \{
"name": "puppeteer_navigate",
"arguments": "\{\"url\": \"https://www.baidu.com\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_f02ba9ee6b344dd0af9041",
"name": "puppeteer_navigate",
"content": ""
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_c1e8658beda04f6881e8eb",
"type": "tool_use",
"function": \{
"name": "puppeteer_screenshot",
"arguments": "\{\"name\": \"baidu_homepage\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_c1e8658beda04f6881e8eb",
"name": "puppeteer_screenshot",
"content": ""
\}],
"tools": [\{
"type": "function",
"function": \{
"name": "puppeteer_navigate",
"description": "Navigate to a URL",
"parameters": \{
"type": "object",
"properties": \{
"url": \{
"type": "string",
"description": "URL to navigate to"
\},
"launchOptions": \{
"type": "object",
"description": "PuppeteerJS LaunchOptions. Default null. If changed and not null, browser restarts. Example: \{ headless: true, args: ['--no-sandbox'] \}"
\},
"allowDangerous": \{
"type": "boolean",
"description": "Allow dangerous LaunchOptions that reduce security. When false, dangerous args like --no-sandbox will throw errors. Default false."
\}
\},
"required": ["url"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_screenshot",
"description": "Take a screenshot of the current page or a specific element",
"parameters": \{
"type": "object",
"properties": \{
"name": \{
"type": "string",
"description": "Name for the screenshot"
\},
"selector": \{
"type": "string",
"description": "CSS selector for element to screenshot"
\},
"width": \{
"type": "number",
"description": "Width in pixels (default: 800)"
\},
"height": \{
"type": "number",
"description": "Height in pixels (default: 600)"
\},
"encoded": \{
"type": "boolean",
"description": "If true, capture the screenshot as a base64-encoded data URI (as text) instead of binary image content. Default false."
\}
\},
"required": ["name"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_click",
"description": "Click an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to click"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_fill",
"description": "Fill out an input field",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for input field"
\},
"value": \{
"type": "string",
"description": "Value to fill"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_select",
"description": "Select an element on the page with Select tag",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to select"
\},
"value": \{
"type": "string",
"description": "Value to select"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_hover",
"description": "Hover an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to hover"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_evaluate",
"description": "Execute JavaScript in the browser console",
"parameters": \{
"type": "object",
"properties": \{
"script": \{
"type": "string",
"description": "JavaScript code to execute"
\}
\},
"required": ["script"]
\}
\}
\}],
"tool_calls": \{
"id": "call_f02ba9ee6b344dd0af9041",
"function": \{
"arguments": "\{\"url\": \"https://www.baidu.com\"\}",
"name": "puppeteer_navigate"
\},
"type": "function"
\}
\}, \{
"messages": [\{
"role": "user",
"content": "Visit website baidu.com and take a screenshot"
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_f02ba9ee6b344dd0af9041",
"type": "tool_use",
"function": \{
"name": "puppeteer_navigate",
"arguments": "\{\"url\": \"https://www.baidu.com\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_f02ba9ee6b344dd0af9041",
"name": "puppeteer_navigate",
"content": ""
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_c1e8658beda04f6881e8eb",
"type": "tool_use",
"function": \{
"name": "puppeteer_screenshot",
"arguments": "\{\"name\": \"baidu_homepage\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_c1e8658beda04f6881e8eb",
"name": "puppeteer_screenshot",
"content": ""
\}],
"tools": [\{
"type": "function",
"function": \{
"name": "puppeteer_navigate",
"description": "Navigate to a URL",
"parameters": \{
"type": "object",
"properties": \{
"url": \{
"type": "string",
"description": "URL to navigate to"
\},
"launchOptions": \{
"type": "object",
"description": "PuppeteerJS LaunchOptions. Default null. If changed and not null, browser restarts. Example: \{ headless: true, args: ['--no-sandbox'] \}"
\},
"allowDangerous": \{
"type": "boolean",
"description": "Allow dangerous LaunchOptions that reduce security. When false, dangerous args like --no-sandbox will throw errors. Default false."
\}
\},
"required": ["url"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_screenshot",
"description": "Take a screenshot of the current page or a specific element",
"parameters": \{
"type": "object",
"properties": \{
"name": \{
"type": "string",
"description": "Name for the screenshot"
\},
"selector": \{
"type": "string",
"description": "CSS selector for element to screenshot"
\},
"width": \{
"type": "number",
"description": "Width in pixels (default: 800)"
\},
"height": \{
"type": "number",
"description": "Height in pixels (default: 600)"
\},
"encoded": \{
"type": "boolean",
"description": "If true, capture the screenshot as a base64-encoded data URI (as text) instead of binary image content. Default false."
\}
\},
"required": ["name"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_click",
"description": "Click an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to click"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_fill",
"description": "Fill out an input field",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for input field"
\},
"value": \{
"type": "string",
"description": "Value to fill"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_select",
"description": "Select an element on the page with Select tag",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to select"
\},
"value": \{
"type": "string",
"description": "Value to select"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_hover",
"description": "Hover an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to hover"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_evaluate",
"description": "Execute JavaScript in the browser console",
"parameters": \{
"type": "object",
"properties": \{
"script": \{
"type": "string",
"description": "JavaScript code to execute"
\}
\},
"required": ["script"]
\}
\}
\}],
"tool_calls": \{
"id": "call_c1e8658beda04f6881e8eb",
"function": \{
"arguments": "\{\"name\": \"baidu_homepage\"\}",
"name": "puppeteer_screenshot"
\},
"type": "function"
\}
\}]
\},
\}
\`\`\`
## 1. Dataset Features
**Genuinue Users' Queries**: Most of the high quality datasets are collected from query logs of our live AI Agents, such as [MCP Tool Use Agent](https://agent.deepnlp.org/agent/mcp_tool_use), [Open OneKey Agent Router](https://www.deepnlp.org/agent/onekey-mcp-router) and [Open OneKey MCP Router](https://www.deepnlp.org/agent/onekey-mcp-router).
**Function Call and MCP Servers Support**: The datasets covers wide range of MCP servers from the Open MCP Marketplace() and Playgrounds.
**Users Action and Humans' Feedback**: Users' actual feedbacks are crucial in improving the AI Agents training process. We collects users' genuine actions, such as **ACCEPT/REJECT** in confirming the function call results, **Upvote/Downvote** action of the final responses, and many other users' feedback on clickable elements.
**Various Domains and Tasks**: We covers 40+ categories of AI agents' tool use scenarios, ranging from information seeking (AI search, map search, etc) to autonomous AI agents browser use, computer use, Data Analysis, Excel Spreadsheet and Powerpoint creation and generation, etc.
**Example AI Agent Dataset Dialogues**
| Domain | Related MCP Server| Demo |
| ---- | ---- | ---- |
| Office File Agent | Excel Spreadsheet, Powerpoint, PDF, etc | [Example](https://agent.deepnlp.org/agent/mcp_tool_use/share/ee640008-6bc1-4c3a-832b-2557f985b540) [MCP]() |
| AI Search/Deep Research | Bing/Google Custom/Perplexity/Tavily/Firecrawl | [Demo](https://agent.deepnlp.org/agent/mcp_tool_use?server=tavily-ai/tavily-mcp) [MCP]() |
| Map Trip Planning | GoogleMap, Amap(Gaode), BaiduMap, etc. | [Example](https://agent.deepnlp.org/agent/mcp_tool_use/share/8ab0b25c-b72d-4cae-9c86-a852df8c6541) [MCP](https://agent.deepnlp.org/agent/mcp_tool_use?server=amap-mcp/amap-mcp-%E9%AB%98%E5%BE%B7%E5%9C%B0%E5%9B%BE-mcp) [Use MCP]() |
| Browser Usage | Playwright, Puppeteer, etc. | [Demo](https://agent.deepnlp.org/agent/mcp_tool_use?server=puppeteer/puppeteer) [MCP]() |
| Chart,Graph,Image | everart,mcp-server-charts(AntV),canva-mcp | [Demo](https://agent.deepnlp.org/agent/mcp_tool_use/share/93d94694-e673-49d3-b805-820c4ef842bd) [MCP]() |
## 2. Dataset Introduction
We provide main below types of AI agents datasets in List of Messages Json Formats and scalar data such as rewards, etc.
| Dataset Name | Description | User Feedback | Example Dataset Download | Full DataSet Download |
|----------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| ---- |-------|-----------------------------------------------------------------------------------------------------------------|
| Tool Use Multi-Turn Dialogue | The tool use multi-turn dialogue dataset is in the list of messages formats, Useful for AI Search/Deep Research/Map/Financial Data/etc | YES | 50 instances, [Download](https://www.deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-tool-use-dialogue-open-dataset-example) | 1k, [Download](https://www.deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-tool-use-dialogue-open-dataset) |
| Function Calling Tool Use | The dataset contains **messages** and **available tools** as input and output the choosen **tool_call** result indicating which tool to use and the arguments. The datasets are collected from calling SOTA LLM such as GPT, OpenAI o-series, Claude, Qwen, Kimi, etc. | No | 50 instances, [Download](https://deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-function-calling-open-dataset-example) | 1k, [Download](https://deepnlp.org/store/ai-agent/ai-agent/pub-deepnlp/agent-function-calling-open-dataset) |
| Reinforcement Learning | Sessions of user and assistant' multi-dialogues, rewards from users' feedback in this session, such click of confirmation (Accept/Reject), Upvote, Downvote on the responses, etc. | YES | 50 instances, [Download](https://deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-reinforcement-learning-open-dataset-example) | 1k, [Download](https://deepnlp.org/store/dataset/dataset/pub-deepnlp/agent-reinforcement-learning-open-dataset) |
### Dataset 2 Function Calling Tool Use Dataset
The functions call tool use datasets contains both the List of **messages** (Users' original query) and **Available Tools** (List of Json) and **Tool Call Results** produced by SOTA LLM.
For example, the LLM chooses **puppeteer_navigate** tool from 7 other tools of MCP Server puppeteer. And set the parameters as **\{\"url\": \"https://www.baidu.com\"\}**
**Dataset Description**
| KEY | Description |
|--------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| trace_id | Identify each unique new user request or API calling |
| session_id | The identifier of each dialogue, which consists of multiple turns of dialogues and every user input produces a new trace_id |
| data | The Json Object of Each Function Call |
| data.function_calls.messages | List of messages in \{"role":"", "content":""\} formats. |
| data.function_calls.tools | List of available tools, including the schema of tools name, description and parameters |
| data.function_calls.tool_calls | Dict of tool_id, function, arguments |
| tool_calls_results | Note: Tool Call Result are tool running actual output, which can be found in the list of dialogue message in Dataset 1, but not needed for training function call models training dataset |
Format
\`\`\`
\{
"model": "claude-opus-4",
"session_id": "37e83ca0-d0d4-4204-b3e6-95be51bf57a6",
"trace_id": "5c6a8e17-e121-4786-955d-0a716ed733ae",
"function_calls": [\{
"messages": [],
"tools": [],
"tool_calls": \{
"id": "",
"function": \{"arguments":"", "name":""\},
"type": ""
\}
\},
\{
"messages": [],
"tools": [],
"tool_calls": \{
"id": "",
"function": \{"arguments":"", "name":""\},
"type": ""
\}
\}
]
\}
\`\`\`
Data Example of Puppeteer Navigate Open Website.
\`\`\`
\{
"trace_id": "72d51b6e-8c48-42ee-bfc9-05209d1444c8",
"session_id": "7ca7e84c-cee5-4ddd-be1e-748df2be481e",
"model": "claude-opus-4",
"data": \{
"function_calls": [\{
"messages": [\{
"role": "user",
"content": "Visit website baidu.com and take a screenshot"
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_f02ba9ee6b344dd0af9041",
"type": "tool_use",
"function": \{
"name": "puppeteer_navigate",
"arguments": "\{\"url\": \"https://www.baidu.com\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_f02ba9ee6b344dd0af9041",
"name": "puppeteer_navigate",
"content": ""
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_c1e8658beda04f6881e8eb",
"type": "tool_use",
"function": \{
"name": "puppeteer_screenshot",
"arguments": "\{\"name\": \"baidu_homepage\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_c1e8658beda04f6881e8eb",
"name": "puppeteer_screenshot",
"content": ""
\}],
"tools": [\{
"type": "function",
"function": \{
"name": "puppeteer_navigate",
"description": "Navigate to a URL",
"parameters": \{
"type": "object",
"properties": \{
"url": \{
"type": "string",
"description": "URL to navigate to"
\},
"launchOptions": \{
"type": "object",
"description": "PuppeteerJS LaunchOptions. Default null. If changed and not null, browser restarts. Example: \{ headless: true, args: ['--no-sandbox'] \}"
\},
"allowDangerous": \{
"type": "boolean",
"description": "Allow dangerous LaunchOptions that reduce security. When false, dangerous args like --no-sandbox will throw errors. Default false."
\}
\},
"required": ["url"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_screenshot",
"description": "Take a screenshot of the current page or a specific element",
"parameters": \{
"type": "object",
"properties": \{
"name": \{
"type": "string",
"description": "Name for the screenshot"
\},
"selector": \{
"type": "string",
"description": "CSS selector for element to screenshot"
\},
"width": \{
"type": "number",
"description": "Width in pixels (default: 800)"
\},
"height": \{
"type": "number",
"description": "Height in pixels (default: 600)"
\},
"encoded": \{
"type": "boolean",
"description": "If true, capture the screenshot as a base64-encoded data URI (as text) instead of binary image content. Default false."
\}
\},
"required": ["name"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_click",
"description": "Click an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to click"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_fill",
"description": "Fill out an input field",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for input field"
\},
"value": \{
"type": "string",
"description": "Value to fill"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_select",
"description": "Select an element on the page with Select tag",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to select"
\},
"value": \{
"type": "string",
"description": "Value to select"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_hover",
"description": "Hover an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to hover"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_evaluate",
"description": "Execute JavaScript in the browser console",
"parameters": \{
"type": "object",
"properties": \{
"script": \{
"type": "string",
"description": "JavaScript code to execute"
\}
\},
"required": ["script"]
\}
\}
\}],
"tool_calls": \{
"id": "call_f02ba9ee6b344dd0af9041",
"function": \{
"arguments": "\{\"url\": \"https://www.baidu.com\"\}",
"name": "puppeteer_navigate"
\},
"type": "function"
\}
\}, \{
"messages": [\{
"role": "user",
"content": "Visit website baidu.com and take a screenshot"
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_f02ba9ee6b344dd0af9041",
"type": "tool_use",
"function": \{
"name": "puppeteer_navigate",
"arguments": "\{\"url\": \"https://www.baidu.com\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_f02ba9ee6b344dd0af9041",
"name": "puppeteer_navigate",
"content": ""
\}, \{
"role": "assistant",
"content": "",
"tool_calls": [\{
"id": "call_c1e8658beda04f6881e8eb",
"type": "tool_use",
"function": \{
"name": "puppeteer_screenshot",
"arguments": "\{\"name\": \"baidu_homepage\"\}"
\}
\}]
\}, \{
"role": "tool",
"tool_call_id": "call_c1e8658beda04f6881e8eb",
"name": "puppeteer_screenshot",
"content": ""
\}],
"tools": [\{
"type": "function",
"function": \{
"name": "puppeteer_navigate",
"description": "Navigate to a URL",
"parameters": \{
"type": "object",
"properties": \{
"url": \{
"type": "string",
"description": "URL to navigate to"
\},
"launchOptions": \{
"type": "object",
"description": "PuppeteerJS LaunchOptions. Default null. If changed and not null, browser restarts. Example: \{ headless: true, args: ['--no-sandbox'] \}"
\},
"allowDangerous": \{
"type": "boolean",
"description": "Allow dangerous LaunchOptions that reduce security. When false, dangerous args like --no-sandbox will throw errors. Default false."
\}
\},
"required": ["url"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_screenshot",
"description": "Take a screenshot of the current page or a specific element",
"parameters": \{
"type": "object",
"properties": \{
"name": \{
"type": "string",
"description": "Name for the screenshot"
\},
"selector": \{
"type": "string",
"description": "CSS selector for element to screenshot"
\},
"width": \{
"type": "number",
"description": "Width in pixels (default: 800)"
\},
"height": \{
"type": "number",
"description": "Height in pixels (default: 600)"
\},
"encoded": \{
"type": "boolean",
"description": "If true, capture the screenshot as a base64-encoded data URI (as text) instead of binary image content. Default false."
\}
\},
"required": ["name"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_click",
"description": "Click an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to click"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_fill",
"description": "Fill out an input field",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for input field"
\},
"value": \{
"type": "string",
"description": "Value to fill"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_select",
"description": "Select an element on the page with Select tag",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to select"
\},
"value": \{
"type": "string",
"description": "Value to select"
\}
\},
"required": ["selector", "value"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_hover",
"description": "Hover an element on the page",
"parameters": \{
"type": "object",
"properties": \{
"selector": \{
"type": "string",
"description": "CSS selector for element to hover"
\}
\},
"required": ["selector"]
\}
\}
\}, \{
"type": "function",
"function": \{
"name": "puppeteer_evaluate",
"description": "Execute JavaScript in the browser console",
"parameters": \{
"type": "object",
"properties": \{
"script": \{
"type": "string",
"description": "JavaScript code to execute"
\}
\},
"required": ["script"]
\}
\}
\}],
"tool_calls": \{
"id": "call_c1e8658beda04f6881e8eb",
"function": \{
"arguments": "\{\"name\": \"baidu_homepage\"\}",
"name": "puppeteer_screenshot"
\},
"type": "function"
\}
\}]
\},
\}
\`\`\`