2018-07-25 17:57:33 +08:00
|
|
|
airflow
|
|
|
|
=======
|
2018-07-25 18:37:35 +08:00
|
|
|
|
2019-09-28 18:58:18 +08:00
|
|
|

|
|
|
|
|
2018-07-25 18:37:35 +08:00
|
|
|
## How It Works
|
|
|
|
|
|
|
|
```
|
|
|
|
+---------+
|
|
|
|
+--> | Worker1 |
|
|
|
|
redis | +---------+
|
|
|
|
postgres |
|
|
|
|
+--------+ | +---------+
|
|
|
|
| Master | <--+--> | Worker2 |
|
|
|
|
+--------+ | +---------+
|
|
|
|
webserver |
|
|
|
|
scheduler | +---------+
|
|
|
|
flower +--> | Worker3 |
|
|
|
|
+---------+
|
|
|
|
```
|
|
|
|
|
|
|
|
## Quick Start
|
|
|
|
|
|
|
|
```bash
|
2019-09-28 18:58:18 +08:00
|
|
|
$ python -c 'from cryptography.fernet import Fernet; print(Fernet.generate_key().decode())'
|
|
|
|
4XHGZH0dZ40iOv6z5cyfrXVg5qg3s_d06A7BFfbSsqA=
|
|
|
|
|
|
|
|
$ docker stack deploy -c docker-stack.yaml airflow
|
|
|
|
$ docker service update --replicas-max-per-node=1 airflow_worker
|
|
|
|
$ docker service update --replicas 3 airflow_worker
|
|
|
|
|
|
|
|
$ curl http://localhost:8080/
|
|
|
|
$ curl http://localhost:5555/
|
2018-07-25 18:37:35 +08:00
|
|
|
```
|
2019-09-28 18:58:18 +08:00
|
|
|
|
|
|
|
> :warning: This docker image was built with a static `FERNET_KEY` environment variable.
|
|
|
|
> You should set another value to it in `docker-stack.yaml`.
|