mirror of
https://github.com/vimagick/dockerfiles.git
synced 2024-12-25 02:04:06 +02:00
update
This commit is contained in:
parent
918b9dae79
commit
51c715a63c
@ -14,6 +14,7 @@ RUN apt-get update \
|
|||||||
libtool \
|
libtool \
|
||||||
python \
|
python \
|
||||||
python-dev \
|
python-dev \
|
||||||
|
vim-tiny \
|
||||||
&& mkdir libxml2 \
|
&& mkdir libxml2 \
|
||||||
&& curl -sSL ftp://xmlsoft.org/libxml2/libxml2-2.9.2.tar.gz | tar xz --strip 1 -C libxml2 \
|
&& curl -sSL ftp://xmlsoft.org/libxml2/libxml2-2.9.2.tar.gz | tar xz --strip 1 -C libxml2 \
|
||||||
&& cd libxml2 \
|
&& cd libxml2 \
|
||||||
@ -33,8 +34,9 @@ RUN apt-get update \
|
|||||||
&& cd .. \
|
&& cd .. \
|
||||||
&& rm -rf libxslt \
|
&& rm -rf libxslt \
|
||||||
&& curl -sSL https://bootstrap.pypa.io/get-pip.py | python \
|
&& curl -sSL https://bootstrap.pypa.io/get-pip.py | python \
|
||||||
&& pip install scrapy==1.0.0rc1 \
|
&& pip install scrapy==0.24.6 \
|
||||||
&& curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \
|
&& curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion \
|
||||||
|
&& echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \
|
||||||
&& apt-get remove -y autoconf \
|
&& apt-get remove -y autoconf \
|
||||||
build-essential \
|
build-essential \
|
||||||
libffi-dev \
|
libffi-dev \
|
||||||
|
@ -3,12 +3,18 @@
|
|||||||
`Scrapy`: An open source and collaborative framework for extracting the data
|
`Scrapy`: An open source and collaborative framework for extracting the data
|
||||||
you need from websites. In a fast, simple, yet extensible way.
|
you need from websites. In a fast, simple, yet extensible way.
|
||||||
|
|
||||||
You can create a scrapy (v1.0.0rc1) project on top of this image.
|
This image is based on `debian:jessie`, and it only takes 278.6 MB.
|
||||||
|
You can create a scrapy (v0.24.6) project on top of this image.
|
||||||
|
|
||||||
## HOW-TO
|
## HOW-TO
|
||||||
|
|
||||||
```
|
```
|
||||||
docker run --name scrapy -it vimagick/scrapy
|
$ docker run --name scrapy -it vimagick/scrapy
|
||||||
|
>>> scrapy startproject demo
|
||||||
|
>>> cd demo
|
||||||
|
>>> scrapy genspider example example.com
|
||||||
|
>>> scrapy edit example
|
||||||
|
>>> scrapy crawl example
|
||||||
```
|
```
|
||||||
|
|
||||||
## TODO-LIST
|
## TODO-LIST
|
||||||
|
Loading…
Reference in New Issue
Block a user