Crawl Tool
The Crawl tool is used to get all links from a webpage according to a selector and create download tasks for them for further processing with notifications on retries.
Arguments
| Name | Type | Description |
|---|---|---|
| task | DownloadTask | Required. A task from the previous Start or Crawl tool response |
| selector | String | Required. A valid CSS or XPATH selector. |
| attributeName | String | Optional. Attribute name to get data from. Use val to get inner text. Default value: href |
DownloadTask
| Name | Type | Description |
|---|---|---|
| Id | String | Required. Task Id |
| Url | String | Required. Page URL |
Return Type
Array of DownloadTask