Dapi Service
This is a service that provides a REST API that is used by
This service is not open-source but its image is publicly accessible on DockerHub
Configuration
The following environment variables are used to configure this service:
| Name | Description |
|---|---|
| DB_CONNECTION_STRING | Required MongoDB connection string |
| DATAKEEPER_ORIGIN | Required The origin of the datakeeper service |
| SCRAPER_ORIGIN | Required The origin of the scraper service |
| IDEALER_ORIGIN | Required The origin of the idealer service |
| JOB_TYPES | Required Available job types for job configs |
| LICENSE_KEY | Required. A license key. See Plans |
| GLOBAL_EXCEPTION_RESPONSE_DELAY_MS | Optional. If a server error occurred, how much time should be waited before responding with an HTTP error? This makes sense because some clients can’t wait before repeating requests on their side, so this is done on the server side. Default value is 1 second |
| MIN_LOG_LEVEL | Optional. Minimal log level. Default value is Information |
JobTypes
Job types.
Possible values restrictions and the default value for all jobs can be configured in the Dapi or Solidstack services.
Additionally, the Crawler service should be correctly configured to handle jobs of different types.
| Name | Description |
|---|---|
| Internet | Crawl data from internet sources via request gateways (Proxy addresses, Host IP addresses, etc.) |
| Intranet | Crawl data from intranet sources with no limits |