ScrapeData Prompt

This prompt is a pre-defined prompt with a detailed description to an AI agent on how to use the WDS MCP Server to scrape necessary data from a web resource in JSON format. It instructs AI agents on how to discover data pages on a web resource, define necessary data based on several scraped pages, and configure WDS to scrape data from the entire web resource in a structure required for analysis according to a task.

How to call

In different IDEs, the command might be different. So here are commands for well-known IDEs:

IDE Command
Visual Studio Code /mcp.wds.scrape-data

Arguments

Name Type Description
urls String Optional. A comma-separated string of initial crawling entry point URLs. If not specified, the Playground URL is used
mainTask String Optional. A task. If not specified, the Example Task is used

Example Task

Example task demonstrates how varied tasks can be for this prompt. Since all examples in this documentation use Playground, the example task is tailored for the playground context:

It's a magician's items store. Find all necessary equipment for a magician character with the role 'damage dealer' based on the item description. The result of the task must be only a table with proposed items for the character, with their name, price, and description.

Example Task Output

Context diagram

Please rotate your device to landscape mode

This documentation is specifically designed with a wider layout to provide a better reading experience for code examples, tables, and diagrams.
Rotating your device horizontally ensures you can see everything clearly without excessive scrolling or resizing.

Return to Web Data Source Home