go/ferret
go/ferret
1
0
Fork 0
mirror of https://github.com/MontFerret/ferret.git synced 2025-01-06 03:03:57 +02:00
Code Issues Releases Activity
Declarative web scraping https://www.montferret.dev/
781 Commits 4 Branches 41 Tags 12 MiB
Go 83.6%
HTML 14.5%
JavaScript 1.4%
ANTLR 0.4%
90427cd537
Go to file
Tim Voronov 90427cd537
Feature/new selector type (#657) 
* Added remote type reference resolver

* Added support of XPath query selector

* Added CDP e2e testss covering XPath integration

* Added additional CDP e2e tests covering XPath integration

* Added type check to QuerySelector casting function

* Fixed XPath e2e tests

* Fixed vuln issue

* Added support of XPath selectors to http driver

* Added e2e tests for XPAth
2021-09-16 21:40:20 -04:00
.github Dropped support of Go 1.13 2021-09-02 22:43:59 -04:00
assets Fixed incorrectly compiled LIMIT clause. 2018-10-08 16:04:49 -04:00
e2e Feature/new selector type (#657) 2021-09-16 21:40:20 -04:00
examples Feature/eval template (#651) 2021-09-07 16:33:30 -04:00
pkg Feature/new selector type (#657) 2021-09-16 21:40:20 -04:00
.codecov.yml Updated codecov settings 2018-11-05 11:36:55 -05:00
.editorconfig Updates spaces in README 2018-09-18 21:47:54 -04:00
.gitignore Added support of using keywords in namespaces (#481) 2020-04-28 17:30:47 -04:00
.golangci.yml Update .golangci.yml 2019-10-15 08:11:15 +02:00
CHANGELOG.md Update CHANGELOG.md 2021-04-23 15:45:29 -04:00
ferret.go Updated root API (#622) 2021-05-04 15:01:27 -04:00
go.mod Bugfix/e2e tests (#648) 2021-09-02 11:09:48 -04:00
go.sum Bugfix/e2e tests (#648) 2021-09-02 11:09:48 -04:00
LICENSE Update LICENSE 2019-07-09 14:43:33 -04:00
Makefile Removed old CLI (#608) 2021-04-08 18:46:17 -04:00
options.go Updated root API (#622) 2021-05-04 15:01:27 -04:00
README.md Update README.md 2021-04-22 15:13:27 -04:00
revive.toml Added click count (#377) 2019-09-07 01:59:32 -04:00

README.md

Ferret

Go Report Status Build Status Discord Chat Discord Chat Ferret release Apache-2.0 License

ferret

Try it! Docs CLI Test runner Web worker

What is it?

ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.
ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. It is extremely portable, extensible, and fast.

Read the introductory blog post about Ferret here!

Features

  • Declarative language
  • Support of both static and dynamic web pages
  • Embeddable
  • Extensible

Documentation is available at our website.

Different languages

  • Ferret for python. Pyfer