mirror of
https://github.com/vimagick/dockerfiles.git
synced 2024-12-25 02:04:06 +02:00
.. | ||
docker-compose-master.yml | ||
docker-compose-worker.yml | ||
README.md |
airflow
How It Works
+---------+
+--> | Worker1 |
redis | +---------+
postgres |
+--------+ | +---------+
| Master | <--+--> | Worker2 |
+--------+ | +---------+
webserver |
scheduler | +---------+
flower +--> | Worker3 |
+---------+
Quick Start
# On Master
$ docker-compose up -d
$ chmod 777 data/airflow/dags
$ docker-compose exec webserver cp -r /usr/local/lib/python3.6/site-packages/airflow/example_dags dags
# On Workers
$ docker-compose up -d
$ chmod 777 data/airflow/dags
$ docker-compose exec worker cp -r /usr/local/lib/python3.6/site-packages/airflow/example_dags dags