Release v2.0
Notes
This release introduces MCP Server, a significant enhancement to Web Data Source (WDS) that enables direct integration with AI Agents.
With MCP Server, AI agents can now delegate complex crawling and scraping tasks to WDS, enabling faster, more efficient data acquisition with minimal overhead. This advancement significantly enhances agent autonomy, reduces response times, and delivers a higher-quality user experience across the board.
Please review the documentation for the components below for more information about their uses and how this works.
Added
Modified
- JobRestart renamed to Restart
- DownloadErrorHandlingPolicy renamed to DownloadErrorHandling
- Playground URL changed from http://playground.svc to http://playground to align it with service naming in Kubernetes
Removed
Nothing
Known Issues
| Issue | Mitigation |
|---|---|
| Core Services use the libtarry Grpc.Core of version 2.46.6 (the latest one) that has the following vulnerability GHSA-9hxf-ppjv-w6rq | WDS doesn’t expose gRPC endpoints so none of them is available outside an internal network that is used for inter-services communication. This issue is going to be fixed (GitHub issue CVE-2023-4785: Backport #33656 to 1.46.x to fix gRPC Core) and then a new WDS version will be released with the issue fix |