MCP Server

MCP Server is a platform that empowers agentic AI systems to autonomously crawl, discover, and extract data from web resources. It offers a suite of tools and prompts for scalable web crawling, advanced data scraping, and flexible workflow automation. The server is designed for easy integration, enabling agents to efficiently gather both structured and unstructured data for analytics, reporting, and other purposes.

WDS API Server

WDS API Server provides the core functionality, including the WDS MCP Server.

WDS MCP Server

When the WDS API Server is up and running, the WDS MCP Server can be connected to IDEs:

Visual Studio Code

Here is an official instruction on how to connect MCP servers to Visual Studio Code. Use the following values to connect WDS MCP Server:

Parameter Value Description
Name wds A name to find the WDS MCP Server among other connected MCP servers
Type http WDS MCP Server is connected using the HTTP protocol
URL http://[host:port]/mcp A WDS MCP Server URL. If WDS API Server is deployed locally in Docker, the URL appears to be http://localhost:2807/mcp

Please rotate your device to landscape mode

This documentation is specifically designed with a wider layout to provide a better reading experience for code examples, tables, and diagrams.
Rotating your device horizontally ensures you can see everything clearly without excessive scrolling or resizing.

Return to Web Data Source Home