Give Your Web Data Pipeline a Schedule.
Product catalogs change. Internal documentation evolves. A useful collection workflow needs to run repeatedly.
With Traversal Scheduling in Web Data Source (WDS), you can turn a saved crawling and extraction configuration into a recurring collection:
- Define which pages to follow and which fields to extract.
- Set a schedule for automatic Traversal runs.
- Retrieve each run’s structured results for downstream reporting or automation.
For a supplier catalog, that could mean collecting product names, prices, and descriptions on a regular schedule - then making those records available to your procurement analysis workflow.
You retain control: disable scheduled starts when needed and keep manual runs available.
Scheduling is available starting with the Business plan and requires a multi-service deployment.
Explore WDS Traversal Scheduling
