satotake
34d9c7143b
Add new TokeniseOption EnsureLF ( #336 )
...
* Add new TokeniseOption EnsureLF
ref #329
* Use efficient process suggested by @chmike
2020-03-04 18:56:47 +11:00
Alec Thomas
3aaf3e542f
Fix Java lexer (synced with latest Pygments).
...
Fixes #297 .
2019-11-05 13:57:51 +11:00
Alec Thomas
ea14dd8660
Fixed a fundamental bug where ^ would always match.
...
The engine was always passing a string sliced to the current position,
resulting in ^ always matching. Switched to use
FindRunesMatchStartingAt.
Fixes #242 .
2019-06-12 12:32:20 +10:00
Daniel Eloff
9c3abeae1d
Tokens by value ( #187 )
...
This results in about a 8% improvement in speed.
2018-11-04 10:22:51 +11:00
Alec Thomas
6326cbaeff
Add test for EnsureNL.
2017-10-13 10:58:37 +11:00