Cross Domain Access

🌐 CrossDomainAccess — Control Exactly Where Your Crawls Are Allowed to Go

When your data pipelines depend on predictable, compliant, and secure crawling behavior, controlling domain boundaries becomes essential.
CrossDomainAccess in WDS lets you define whether your crawler stays on the main domain, includes subdomains, or can reach out to any external domain — giving you full control over scope and security.

Choose the policy that fits your environment:
Main Domain — restrict navigation strictly to the primary domain
Sub Domain — include trusted internal subdomains
Any Domain — allow full cross-domain exploration when needed

This flexibility is designed for modern, security-driven infrastructures and blends seamlessly with WDS’s core strengths:
✔ Air-gapped compatible
✔ Isolated environment deployment
✔ Secure data extraction
✔ Zero-Trust architecture
✔ No internet dependency
✔ Private network crawling
✔ Data sovereignty compliance
✔ Enterprise-grade security
✔ Controlled access environment

Explore full documentation