kev
5dc9babdf6
scrapyd: ipython for better shell
2021-08-09 17:55:55 +08:00
kev
bd56ef8a53
patch scrapyd-clent ( FIX #72 #183 )
2021-07-21 19:02:44 +08:00
Pratik raj
b113da5d19
chore: Use --no-cache-dir flag to pip in Dockerfiles, to save space
...
Using "--no-cache-dir" flag in pip install ,make sure dowloaded packages
by pip don't cached on system . This is a best practise which make sure
to fetch ftom repo instead of using local cached one . Further , in case
of Docker Containers , by restricing caching , we can reduce image size.
In term of stats , it depends upon the number of python packages
multiplied by their respective size . e.g for heavy packages with a lot
of dependencies it reduce a lot by don't caching pip packages.
Further , more detail information can be found at
https://medium.com/sciforce/strategies-of-docker-images-optimization-2ca9cc5719b6
Signed-off-by: Pratik Raj <rajpratik71@gmail.com>
2021-07-02 01:02:49 +05:30
kev
41718a0e1f
fix scrapyd
2021-04-14 16:26:13 +08:00
kev
dd70ca4100
upgrade scrapyd:py3 to 2.5.0
2021-04-13 17:04:01 +08:00
kev
5b2f1b7e5c
update scrapyd
2021-03-29 15:39:47 +08:00
kev
1d106f8599
update scrapyd
2021-02-01 16:42:49 +08:00
kev
02d21a23f8
update scrapyd
2021-02-01 15:16:46 +08:00
kev
022b7c6892
upgrade scrapy to 2.4.1
2020-12-08 17:08:39 +08:00
kev
aacfd8a6f6
update
2020-10-22 14:41:34 +08:00
kev
414672f1a6
update scrapyd
2020-10-16 14:45:15 +08:00
kev
7f434d29ae
update scrapyd
2020-10-16 14:44:48 +08:00
kev
ab647f9c5b
upgrade scrapy to 2.4.0
2020-10-13 10:43:32 +08:00
kev
53fd25762d
add README.md to scrapyd:py3
2020-08-24 17:49:04 +08:00
kev
fd80119fb6
upgrade scrapy to 2.3.0
2020-08-12 15:43:20 +08:00
kev
88160689af
upgrade scrapy to 2.2.1
2020-07-20 10:59:14 +08:00
kev
21ff39567e
update scrapy
2020-07-10 11:52:01 +08:00
kev
fcf05f47d6
update scrapyd
2020-05-29 12:11:32 +08:00
kev
01dc8560e1
update scrapyd
2020-05-26 18:24:55 +08:00
kev
8eac19f9f5
update scrapyd
2020-05-26 17:31:46 +08:00
kev
c6db9ccb64
update scrapyd
2019-03-08 11:56:59 +08:00
kev
299d84de53
add scrapyrt tutorial for scrapyd
2018-01-25 15:01:53 +08:00
kev
724db85a01
fix scrapyd
2018-01-23 23:01:57 +08:00
kev
a62429af3c
upgrade scrapyd base image
2018-01-23 22:54:44 +08:00
kev
241269a1e4
scrapyd: bind 0.0.0.0:6800
2017-05-09 14:12:22 +08:00
kev
82143a5b63
swith to new domain: easypi.pro
2017-05-08 07:05:07 +08:00
Felipe Roberto
c86d9d5fd9
Update scrapyd.conf
...
With the release of 1.2.0 at 2017-04-12 scrapyd’s bind_address now defaults to 127.0.0.1 instead of 0.0.0.0 to listen only for connection from the local host, but for docker environment it should be listened from outside so now we should set it manually.
2017-04-29 01:32:32 -03:00
kev
7178a7aa72
scrapyd: run without pidfile
2017-04-04 11:59:17 +08:00
kev
363fefb187
fix scrapyd:py3 volume path in docker-compose.yml ( FIX #39 )
2017-03-21 08:17:51 +08:00
vimagick
be9ad440b1
add scrapyrt to scrapyd image
2017-03-06 13:08:27 +08:00
kev
fb634d2d92
add scrapyd-arm
2017-03-04 22:50:30 +08:00
kev
f24f0716fe
add scrapyd:py3 ( FIX #36 )
2017-02-02 10:15:53 +08:00
kev
50797ce5e4
update scrapyd
2017-01-22 13:32:27 +08:00
kev
34ee0334c0
update scrapyd
2016-08-10 11:32:53 +08:00
kev
06b6ac3041
update scrapyd
2016-08-04 19:31:24 +08:00
kev
5d0bd1d138
update scrapyd
2016-06-03 01:34:30 +08:00
kev
2707f1997e
use libxml2-dev libxslt1-dev packages
2016-05-26 20:46:51 +08:00
kev
d05e246d0c
add pillow to scrapyd to handle images
2016-05-26 20:41:08 +08:00
kev
202392cdc6
switch to new domain: easypi.info
2016-05-01 09:06:20 +08:00
kev
284c022e6f
add scrapyjs to scrapyd
2015-09-20 18:19:43 +08:00
kev
2a1682e7e0
update
2015-07-02 22:19:37 +08:00
kev
af70a1fdea
update
2015-06-20 17:29:44 +08:00
kev
70e711f336
update
2015-06-20 17:12:04 +08:00
kev
189033aa6e
update
2015-06-20 17:04:33 +08:00
kev
2002a7df31
update
2015-06-20 17:02:23 +08:00
kev
817c0252c8
update
2015-06-20 16:45:20 +08:00
kev
7be2bb4748
update
2015-06-02 16:20:05 +08:00
kev
b48e5eed3b
fix
2015-06-01 11:42:11 +08:00
kev
ba564d1bd6
fix
2015-06-01 11:33:07 +08:00
kev
9dec559183
add scrapyd-onbuild
2015-06-01 09:08:57 +08:00