DataPull sandbox
This paragraph describes an example of infrastructure that implements the
DataPull
protocol.
It is implemented as a Docker Container containing the following services:
- Airflow
- Jupyter notebook
- Postgres
-
MongoDB
-
It is a separated code base from CK and it shares only a few base library (e.g.,
helpers
) -
It is a scaled down version of CK production infrastructure (e.g., managed Airflow is replaced by a local Airflow instance)