Your crawling is automated. Is your data retention?
Daily crawling is great for tracking changes. Until hundreds of old runs accumulate, consuming storage long after they’ve stopped being useful.
WDS v3.1 introduces TraversalConfig.MaxRuns.
One setting. A configurable limit on retained run history.
Set MaxRuns = 10 to maintain a rolling history of the latest 10 runs.
The benefits?
✓ Recent snapshots for comparison
✓ Controlled storage growth
✓ Less manual cleanup
Keep the history that matters. Not every run that ever happened.
