Datakeeper Service

This is a service that provides other serives with data

This service is not open-source but its image is publicly accessible on DockerHub

Configuration

The following environment variables are used to configure this service:

Name Description
DB_CONNECTION_STRING Required MongoDB connection string with database name
CACHE_CONNECTION_STRING Optional. An S3 compatible service connection string. If this is not specified, web pages are cached in the main MongoDB.
IDEALER_ORIGIN Required The origin of the idealer service
MIN_LOG_LEVEL Optional. Minimal log level. Default value is INFO

Caching

By default web pages are cached in the system DB (MongoDB). This behavior can be changed by providing the service with a CACHE_CONNECTION_STRING. The following providers are supposted:

MongoDB

To cache web pages on a MongoDB instance other than the one used as the system database, initialize CACHE_CONNECTION_STRING with a valid MongoDB connection string with database name.

S3 compatible services

To cache web pages on an S3 compatible service, initialize CACHE_CONNECTION_STRING with a connection string of the following format:
s3://<key>:<secret>@<host>:<port(optional)>/<bucket>?ssl=(true|false)

Please rotate your device to landscape mode

This documentation is specifically designed with a wider layout to provide a better reading experience for code examples, tables, and diagrams.
Rotating your device horizontally ensures you can see everything clearly without excessive scrolling or resizing.

Return to Web Data Source Home