Daniel Eloff
9c3abeae1d
Tokens by value ( #187 )
...
This results in about a 8% improvement in speed.
2018-11-04 10:22:51 +11:00
Alec Thomas
15a009f0fc
Add DelegatingLexer.
2018-03-17 13:44:03 +11:00
Alec Thomas
3020e2ea8c
Fix bug with nested newlines.
...
Fixes #124 .
Also reinstitute lexer tests that disappeared during package split.
2018-03-03 10:16:21 +11:00
Alec Thomas
e56590a815
Add data-driven test framework for lexers.
...
See #68 .
2018-01-02 14:53:25 +11:00
Alec Thomas
93868c5a99
Add Objective-C and support lexer priorities.
...
Fixes #66 .
2017-10-23 11:21:37 +11:00
Alec Thomas
ce3d6bf527
Invert default "ensure newline" behaviour so that it is opt-in.
...
See #47 .
2017-09-30 14:41:05 +10:00
Alec Thomas
573c1d157d
Ensure a newline exists at the end of files.
...
Fixes #42 .
2017-09-29 21:59:52 +10:00
Alec Thomas
cc0e4a59ab
Switch to an Iterator interface.
...
This is to solve an issue where writers returned by the Formatter
were often stateful, but this fact was not obvious to the API consumer,
and failed in interesting ways.
2017-09-20 22:19:36 +10:00
Alec Thomas
44b23f97b4
Split Regexp lexer into its own file.
2017-09-20 20:19:33 +10:00
Alec Thomas
3f230ec717
Add support for line numbers.
2017-09-20 13:33:44 +10:00
Alec Thomas
a72960340e
Add test to pre-compile all regexes.
2017-09-19 14:15:33 +10:00
Alec Thomas
87183b3633
Add HTML formatter option for setting the tab width.
2017-09-19 13:14:29 +10:00
Alec Thomas
631fc87d6e
Fix lua lexer, and actually check error value from compiling regexes :(
2017-09-19 12:05:53 +10:00
Alec Thomas
3df4c80190
Rename S -> R + sort list of lexers.
2017-09-19 10:47:22 +10:00
Alec Thomas
431e913333
Update documentation. Include "quick" package.
2017-09-18 13:15:07 +10:00
Alec Thomas
a10fd0a23d
Switch to github.com/dlclark/regexp2.
...
This makes translating Pygments lexers much much simpler (and possible).
2017-09-18 11:16:44 +10:00
Alec Thomas
86bda70acd
Switch to github.com/dlclark/regexp2
2017-09-15 22:18:20 +10:00
Alec Thomas
d12529ae61
HTML formatter + import all Pygments styles.
2017-07-20 00:01:29 -07:00
Alec Thomas
7ae55eb265
Wire up content sniffing.
2017-06-07 19:47:59 +10:00
Alec Thomas
5749aebe42
Generalise and support 8, 256 and 16m colour terminals.
2017-06-07 19:47:59 +10:00
Alec Thomas
1f47bd705c
Use pointers to tokens + support regex flags in importer.
2017-06-07 19:47:59 +10:00
Alec Thomas
c64e5829b5
Add JavaScript.
2017-06-07 19:47:59 +10:00
Alec Thomas
5dedc6e45b
Add a bunch of automatically translated lexers.
2017-06-07 19:47:59 +10:00
Alec Thomas
b30de35ff1
Use a callback to emit tokens.
...
This is a) faster and b) supports streaming output.
2017-06-07 19:47:59 +10:00
Alec Thomas
6dd81b044b
Add Markdown processor. A bunch of performance improvements.
2017-06-07 19:47:59 +10:00
Alec Thomas
b2fb8edf77
Initial commit! Working!
2017-06-07 19:47:59 +10:00