Download Error Handling

💡 Keep Your Crawls Resilient with DownloadErrorHandling

Network issues shouldn’t stop your data flow. With DownloadErrorHandling, WDS gives you full control over how the crawler reacts to transient download errors — keeping your pipelines stable and uninterrupted.

Choose your strategy:
➡️ Skip — move on and keep crawling
🔁 Retry — try again with custom delay and retry limits

Because reliable crawling isn’t about avoiding errors — it’s about handling them intelligently.

Reliable crawling • Controlled recovery • Enterprise-grade resilience

Built for:
🛰️ Air-gapped compatibility
🔒 Isolated environment deployment
🧠 Secure data extraction
🧩 Zero-Trust architecture
🌐 Private network crawling
📜 Data sovereignty compliance
🏢 Enterprise-grade security

See the documentation