1
0
mirror of https://github.com/lorien/awesome-web-scraping.git synced 2024-11-28 08:48:58 +02:00
awesome-web-scraping/web_services.md
2022-06-27 12:30:17 +02:00

2.3 KiB

Web-scraping Web Services

Web-data Extracting Services

  • Dataflow kit - Turn websites data into structured data with a simple point-and-click toolkit
  • ProxyCrawl - Crawl and scrape any website without blocks, captchas or proxies
  • ScraperAPI - A service that manages proxies and headless browsers, exposing a single API endpoint to scrape any url.
  • Scraping Fish - The simplest API for web scraping without getting blocked powered by 4G/LTE proxy.
  • import.io
  • ScraperWiki
  • Mozenda
  • PhantomJs.Cloud
  • CloudScrape
  • DiffBot
  • Apify - A serverless web scraping, data extraction and web automation platform
  • Portia; also on GitHub: scrapinghub/portia
  • Dexi
  • Morph.io free of charge, fully open-source service
  • Page.REST
  • ParseHub
  • WrapAPI
  • Agenty
  • ScrapingBee - A web scraping API that handles rotating proxies and headless browsers.
  • SerpApi - Real-time API to access structured search results of search engines.
  • ScrapingAnt - Web Scraping API with thousands of residential proxies and headless Chrome cluster.
  • Zyte (formerly Scrapinghub) - Web data extraction services and platform, also lead maintainers of Scrapy.
  • ProxiesAPI - Rotating proxies API with automatic retries, CAPTCHA handling and javacript rendering.
  • ZenRows - Web Scraping API & proxy server that bypasses any anti-bot solution while offering javascript rendering, rotating proxies, and geotargeting.
  • Data Collector - Pre-made collectors with web unlocking features and a JavaScript IDE to build your own scraper.