go/ferret
go/ferret
1
0
Fork 0
mirror of https://github.com/MontFerret/ferret.git synced 2025-01-08 03:13:15 +02:00
Code Issues Releases Activity
Declarative web scraping https://www.montferret.dev/
782 Commits 4 Branches 41 Tags 12 MiB
Go 83.6%
HTML 14.5%
JavaScript 1.4%
ANTLR 0.4%
847dda1f10
Go to file
Tim Voronov 847dda1f10
Feature/pre compiled eval scripts (#658) 
* Added support of pre-compiled eval expressions

* Added unit tests for eval.Function

* Added RemoteType and RemoteObjectType enums

* Refactored function generation

* Refactored Document and Element loading logic

* Removed redundant fields from cdp.Page

* Exposed eval.Runtime to external callers

* Added new eval.RemoteValue interface
2021-09-19 19:35:54 -04:00
.github Dropped support of Go 1.13 2021-09-02 22:43:59 -04:00
assets Fixed incorrectly compiled LIMIT clause. 2018-10-08 16:04:49 -04:00
e2e Feature/pre compiled eval scripts (#658) 2021-09-19 19:35:54 -04:00
examples Feature/eval template (#651) 2021-09-07 16:33:30 -04:00
pkg Feature/pre compiled eval scripts (#658) 2021-09-19 19:35:54 -04:00
.codecov.yml Updated codecov settings 2018-11-05 11:36:55 -05:00
.editorconfig Updates spaces in README 2018-09-18 21:47:54 -04:00
.gitignore Added support of using keywords in namespaces (#481) 2020-04-28 17:30:47 -04:00
.golangci.yml Update .golangci.yml 2019-10-15 08:11:15 +02:00
CHANGELOG.md Update CHANGELOG.md 2021-04-23 15:45:29 -04:00
ferret.go Updated root API (#622) 2021-05-04 15:01:27 -04:00
go.mod Bugfix/e2e tests (#648) 2021-09-02 11:09:48 -04:00
go.sum Bugfix/e2e tests (#648) 2021-09-02 11:09:48 -04:00
LICENSE Update LICENSE 2019-07-09 14:43:33 -04:00
Makefile Removed old CLI (#608) 2021-04-08 18:46:17 -04:00
options.go Updated root API (#622) 2021-05-04 15:01:27 -04:00
README.md Update README.md 2021-04-22 15:13:27 -04:00
revive.toml Added click count (#377) 2019-09-07 01:59:32 -04:00

README.md

Ferret

Go Report Status Build Status Discord Chat Discord Chat Ferret release Apache-2.0 License

ferret

Try it! Docs CLI Test runner Web worker

What is it?

ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.
ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. It is extremely portable, extensible, and fast.

Read the introductory blog post about Ferret here!

Features

  • Declarative language
  • Support of both static and dynamic web pages
  • Embeddable
  • Extensible

Documentation is available at our website.

Different languages

  • Ferret for python. Pyfer