Cookies Config
πͺ CookiesConfig β Bringing Legacy Compatibility to Modern Crawling
Many older or legacy web applications still rely heavily on session cookies to keep users authenticated and preserve navigation states between requests.
With CookiesConfig, WDS crawler speaks their language β ensuring smooth data extraction from systems where cookies remain the backbone of session management.
What it does: Controls cookie persistence between requests to maintain sessions or state across navigations.
UseCookies: Bool β Save and reuse cookies between requests.
Why itβs valuable:
β
Enables crawling of older systems using traditional cookie-based sessions
β
Maintains state across navigation in classic intranet and enterprise apps
β
Reduces re-authentication overhead
β
Increases crawl success rate for legacy web environments
Combined with WDSβs air-gapped compatibility, isolated environment deployment, and Zero-Trust architecture, this feature ensures secure data extraction even from private or legacy systems β while maintaining data sovereignty compliance and enterprise-grade security.
π Learn more
