self-hosted/dockerfiles
1
0
Fork 0
mirror of https://github.com/vimagick/dockerfiles.git synced 2025-04-02 21:55:33 +02:00
Code Issues Releases Activity

add scrapyrt to scrapyd image

Browse Source
This commit is contained in:
vimagick 2017-03-06 10:00:44 +08:00
parent 265261fbf1
commit be9ad440b1
4 changed files with 10 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
scrapyd/Dockerfile
View File

@ -37,6 +37,7 @@ RUN set -xe \
git+https://github.com/scrapy/scrapyd.git \ git+https://github.com/scrapy/scrapyd.git \
git+https://github.com/scrapy/scrapyd-client.git \ git+https://github.com/scrapy/scrapyd-client.git \
git+https://github.com/scrapinghub/scrapy-splash.git \ git+https://github.com/scrapinghub/scrapy-splash.git \
git+https://github.com/scrapinghub/scrapyrt.git \
git+https://github.com/python-pillow/Pillow.git \ git+https://github.com/python-pillow/Pillow.git \
&& curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \ && curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \
&& echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \ && echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \

10
scrapyd/README.md
View File

@ -14,14 +14,17 @@ utility which allows you to deploy your project to a Scrapyd server.
[scrapy-splash][4] provides Scrapy+JavaScript integration using Splash. [scrapy-splash][4] provides Scrapy+JavaScript integration using Splash.
[pillow][5] is the Python Imaging Library to support the ImagesPipeline. [scrapyrt][5] allows you to easily add HTTP API to your existing Scrapy project.
This image is based on `debian:jessie`, 5 latest python packages are installed: [pillow][6] is the Python Imaging Library to support the ImagesPipeline.
This image is based on `debian:jessie`, 6 latest python packages are installed:
- `scrapy`: git+https://github.com/scrapy/scrapy.git - `scrapy`: git+https://github.com/scrapy/scrapy.git
- `scrapyd`: git+https://github.com/scrapy/scrapyd.git - `scrapyd`: git+https://github.com/scrapy/scrapyd.git
- `scrapyd-client`: git+https://github.com/scrapy/scrapyd-client.git - `scrapyd-client`: git+https://github.com/scrapy/scrapyd-client.git
- `scrapy-splash`: git+https://github.com/scrapinghub/scrapy-splash.git - `scrapy-splash`: git+https://github.com/scrapinghub/scrapy-splash.git
- `scrapyrt`: git+https://github.com/scrapinghub/scrapyrt.git
- `pillow`: git+https://github.com/python-pillow/Pillow.git - `pillow`: git+https://github.com/python-pillow/Pillow.git
Please use this as base image for your own project. Please use this as base image for your own project.
@ -123,4 +126,5 @@ $ docker-compose run --rm scrapy
[2]: https://github.com/scrapy/scrapyd [2]: https://github.com/scrapy/scrapyd
[3]: https://github.com/scrapy/scrapyd-client [3]: https://github.com/scrapy/scrapyd-client
[4]: https://github.com/scrapinghub/scrapy-splash [4]: https://github.com/scrapinghub/scrapy-splash
[5]: https://github.com/python-pillow/Pillow [5]: https://github.com/scrapinghub/scrapyrt
[6]: https://github.com/python-pillow/Pillow

1
scrapyd/arm/Dockerfile
View File

@ -37,6 +37,7 @@ RUN set -xe \
git+https://github.com/scrapy/scrapyd.git \ git+https://github.com/scrapy/scrapyd.git \
git+https://github.com/scrapy/scrapyd-client.git \ git+https://github.com/scrapy/scrapyd-client.git \
git+https://github.com/scrapinghub/scrapy-splash.git \ git+https://github.com/scrapinghub/scrapy-splash.git \
git+https://github.com/scrapinghub/scrapyrt.git \
git+https://github.com/python-pillow/Pillow.git \ git+https://github.com/python-pillow/Pillow.git \
&& curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \ && curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \
&& echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \ && echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \

1
scrapyd/py3/Dockerfile
View File

@ -37,6 +37,7 @@ RUN set -xe \
git+https://github.com/scrapy/scrapyd.git \ git+https://github.com/scrapy/scrapyd.git \
git+https://github.com/scrapy/scrapyd-client.git \ git+https://github.com/scrapy/scrapyd-client.git \
git+https://github.com/scrapinghub/scrapy-splash.git \ git+https://github.com/scrapinghub/scrapy-splash.git \
git+https://github.com/scrapinghub/scrapyrt.git \
git+https://github.com/python-pillow/Pillow.git \ git+https://github.com/python-pillow/Pillow.git \
&& curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \ && curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \
&& echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \ && echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \