go/ferret
1
0
Fork 0
mirror of https://github.com/MontFerret/ferret.git synced 2025-08-15 20:02:56 +02:00
Code Issues Releases Activity
1,009 Commits 4 Branches 42 Tags
0e0205870309d867bf38a0f557e8104202e9db03
Go to file
Clone
Open with VS Code Open with VSCodium
Download ZIP Download TAR.GZ Download BUNDLE
Tim Voronov 0e02058703 Refactor ExprCompiler and LoopCollectCompiler: extract function name compilation logic, introduce aggregateSelector struct, improve aggregation handling with grouped and global selectors, optimize collector setup, and enhance loop processing.
2025-07-21 22:01:03 -04:00
.github
Updated lab runner
2023-03-28 13:35:56 -04:00
assets
Fixed incorrectly compiled LIMIT clause.
2018-10-08 16:04:49 -04:00
examples
Remove unused HTML element attribute manipulation functionality, including attribute getters, setters, and related utility code, across drivers and stdlib.
2025-06-25 20:48:48 -04:00
pkg
Refactor ExprCompiler and LoopCollectCompiler: extract function name compilation logic, introduce aggregateSelector struct, improve aggregation handling with grouped and global selectors, optimize collector setup, and enhance loop processing.
2025-07-21 22:01:03 -04:00
test
Refactor ExprCompiler and LoopCollectCompiler: extract function name compilation logic, introduce aggregateSelector struct, improve aggregation handling with grouped and global selectors, optimize collector setup, and enhance loop processing.
2025-07-21 22:01:03 -04:00
.codecov.yml
Updated codecov settings
2018-11-05 11:36:55 -05:00
.editorconfig
Updates spaces in README
2018-09-18 21:47:54 -04:00
.gitignore
Added support of using keywords in namespaces (#481)
2020-04-28 17:30:47 -04:00
.golangci.yml
Update .golangci.yml
2019-10-15 08:11:15 +02:00
CHANGELOG.md
Updated changelog
2022-02-10 19:08:45 -05:00
CODE_OF_CONDUCT.md
Create CODE_OF_CONDUCT.md (#679)
2021-10-10 10:16:33 -04:00
ferret.go
Remove unused HTML element attribute manipulation functionality, including attribute getters, setters, and related utility code, across drivers and stdlib.
2025-06-25 20:48:48 -04:00
go.mod
Remove unused HTML element attribute manipulation functionality, including attribute getters, setters, and related utility code, across drivers and stdlib.
2025-06-25 20:48:48 -04:00
go.sum
Remove unused HTML element attribute manipulation functionality, including attribute getters, setters, and related utility code, across drivers and stdlib.
2025-06-25 20:48:48 -04:00
LICENSE
Update LICENSE
2019-07-09 14:43:33 -04:00
Makefile
Refactor compiler internals; rename files and update context usage for improved clarity and structure
2025-06-11 10:12:42 -04:00
options.go
Updated root API (#622)
2021-05-04 15:01:27 -04:00
README.md
Update README.md
2021-04-22 15:13:27 -04:00
revive.toml
Added click count (#377)
2019-09-07 01:59:32 -04:00

README.md

Ferret

Go Report Status Build Status Discord Chat Discord Chat Ferret release Apache-2.0 License

ferret

Try it! Docs CLI Test runner Web worker

What is it?

ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.
ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. It is extremely portable, extensible, and fast.

Read the introductory blog post about Ferret here!

Features

  • Declarative language
  • Support of both static and dynamic web pages
  • Embeddable
  • Extensible

Documentation is available at our website.

Different languages

  • Ferret for python. Pyfer
Description
Declarative web scraping
https://www.montferret.dev/
cdpchromeclicrawlercrawlingdata-miningdslgogolanghacktoberfestlibraryquery-languagescraperscrapingscraping-websitestool
Readme Apache-2.0 16 MiB
Languages
Go 83.9%
HTML 14.2%
JavaScript 1.4%
ANTLR 0.4%