self-hosted/dockerfiles
1
0
Fork 0
mirror of https://github.com/vimagick/dockerfiles.git synced 2024-12-02 09:21:53 +02:00
Code Issues Releases Activity
554009dd9d
dockerfiles/logstash
History
kev 39546fe58f add filebeat-arm download link
2017-12-27 09:12:48 +08:00
..
data add logstash 2017-12-26 21:22:11 +08:00
docker-compose.yml add logstash 2017-12-26 21:22:11 +08:00
README.md add filebeat-arm download link 2017-12-27 09:12:48 +08:00

README.md

logstash

How It Works

log files ---> filebeat agent --+
...                             |
log files ---> filebeat agent --+> logstash container ---> aliyun™ log service
...                             |
log files ---> filebeat agent --+

docker-compose.yml

logstash:
  image: docker.elastic.co/logstash/logstash:6.1.1
  ports:
    - "5044:5044"
    - "9600:9600"
  volumes:
    - ./data/logstash.yml:/usr/share/logstash/config/logstash.yml
    - ./data/pipeline:/usr/share/logstash/pipeline
  environment:
    LS_JAVA_OPTS: "-Xms1g -Xmx1g"
  restart: always

Up and Running

$ docker-compose up -d
$ docker-compose exec logstash bash
>>> logstash-plugin install logstash-output-logservice
Validating logstash-output-logservice
Installing logstash-output-logservice
Installation successful
>>> logstash-plugin list
logstash-output-logservice
>>> exit
$ vim data/pipeline/logstash.conf
$ docker-compose restart
$ docker-compose logs -f
$ curl http://localhost:9600
{
  "host": "easypi",
  "version": "6.1.1",
  "http_address": "0.0.0.0:9600",
  "id": "c7c4f9d7-5621-4375-bfc9-96abb0f1b4c3",
  "name": "6848fe4c533f",
  "build_date": "2017-12-17T21:51:17+00:00",
  "build_sha": "d46ca0de31662d29b8c5c94d4162e4c760d3f8fb",
  "build_snapshot": false
}

Setup Filebeat

# https://www.elastic.co/downloads/beats/filebeat
$ wget https://artifacts.elastic.co/downloads/beats/filebeat/filebeat-6.1.1-amd64.deb
$ dpkg -i filebeat-6.1.1-amd64.deb
$ vim /etc/filebeat/filebeat.yml
#output.elasticsearch:
  # Array of hosts to connect to.
  #hosts: ["localhost:9200"]
output.logstash:
  # The Logstash hosts
  hosts: ["1.2.3.4:5044"]
$ systemctl start filebeat
$ systemctl enable filebeat

Download filebeat binary for raspberry pi here.

References