Datachain solution components

Datachain Core is made available as a docker container, enabling simple single-server deployments, right up to highly available multi-server architectures.

Below we present the images of the DataChain © solution, along with the associated information for each image (particularly in terms of disk access).

Prerequisites

Sufficient resources to run the dockers, as described in the Prerequisites chapter. running dockers.

A valid deployment key to log into the Adobis docker registry, in order to retrieve the DataChain © docker images.

Web module - Image dc/web_ui

Description

Contains the Web server that provides the HTML pages for the DataChain application.

Size

~220MB

Volumes

No volumes

Backend module - Image dc/backend

Description

Contains the application’s business modules and APIs.

Size

~430MB

Volumes

No volumes

Spark module - Image dc/spark

Description

Carries the calculation module (embedded spark driver) which is the distributed computing context. This module can interface with a Spark cluster (not supplied with the solution).

Size

~680MB

Volumes
Path Utility Mandatory

Postgresql Datachain module - Image dc/pg

Description

Postgres database containing the configuration of processing pipelines (developed via the Datachain interface), as well as settings, tasks executed and in progress.

Size

~145MB

Volumes
Path Utility Mandatory

/var/lib/postgresql/data

Data storage

Yes

Postgresql Exposure Module - Image dc/pg_expose

Description

Exposure module database: exposes data resulting from processing pipelines via a Rest API.

Size

~145MB

Volumes
Path Utility Mandatory

/var/lib/postgresql/data

Data storage

Yes

Migration module - Image dc/pg_migration

Description

Responsible for executing PostgreSQL-related patch updates. It also performs a dump before each execution.

Size

~350MB

Volumes
Path Utility Mandatory

/data/pg_dump

Database dump storage directory (can be disabled)

yes

Authentication module - Image dc/keycloak

Description

Authentication brick, based on keycloak

Size

~650MB

Volumes

No volumes

Postgres authentication module - Image dc/pg_keycloak

Description

Keycloak application database

Size

~145MB

Volumes
Path Utility Mandatory

/var/lib/postgresql/data

Data storage

Yes

Cache module/queues - Image dc/redis

Description

Redis standard image: ensures asynchronous message exchange between modules

Size

~30MB

Volumes

Only potential Redis standard volumes