Fetch

Downloads one absolute URL with the named job’s crawler settings and returns page content when ready, or a task content URL while pending

Endpoint

POST /api/v3/jobs/{jobName}/fetch

Path Parameters

Name Type Description
jobName string Required. Unique job name within the tenant. Reuse the same value to manage job config, start crawls, fetch URLs, inspect tasks and Traversal runs, and query indexed data

Request Body

Required application/json string. Absolute HTTP or HTTPS URL to fetch as a single page under the named job. This does not start link crawling

Responses

200 (Ok)

Returns string containing the page content.

202 (Accepted)

Returns no body with a task content URL in Location. Retry after the number of seconds in Retry-After (currently 1) until the content is ready.

400 (Bad Request)

Invalid request parameters. Refer to the response text for more information

403 (Forbidden)

Access restricted. Refer to the response text for more information

404 (Not Found)

Job not found

422 (Unprocessable Content)

There is an issue with processing the page content. Refer to the response text for more information

Please rotate your device to landscape mode

This documentation is specifically designed with a wider layout to provide a better reading experience for code examples, tables, and diagrams.
Rotating your device horizontally ensures you can see everything clearly without excessive scrolling or resizing.

Return to Web Data Source Home