self-hosted/dockerfiles
1
0
Fork 0
mirror of https://github.com/vimagick/dockerfiles.git synced 2024-12-25 02:04:06 +02:00
Code Issues Releases Activity
e751780a7d
dockerfiles/airflow
History
kev 152a8f2a43 update kafka-manager
2018-07-26 14:37:32 +08:00
..
docker-compose-master.yml update kafka-manager 2018-07-26 14:37:32 +08:00
docker-compose-worker.yml add airflow 2018-07-25 17:57:33 +08:00
README.md update airflow 2018-07-25 18:37:35 +08:00

README.md

airflow

How It Works

                   +---------+
              +--> | Worker1 |
 redis        |    +---------+
 postgres     |
+--------+    |    +---------+
| Master | <--+--> | Worker2 |
+--------+    |    +---------+
 webserver    |
 scheduler    |    +---------+
 flower       +--> | Worker3 |
                   +---------+

Quick Start

# On Master
$ docker-compose up -d
$ chmod 777 data/airflow/dags
$ docker-compose exec webserver cp -r /usr/local/lib/python3.6/site-packages/airflow/example_dags dags

# On Workers
$ docker-compose up -d
$ chmod 777 data/airflow/dags
$ docker-compose exec worker cp -r /usr/local/lib/python3.6/site-packages/airflow/example_dags dags