0.9.4
- Added a fixed-width multi-byte reading option that fixes some corner cases where otherwise backtracking would be needed. For example having
"."
and"..."
token definitions matching against".."
should produce two single-dot tokens.
"."
and "..."
token definitions matching against ".."
should produce two single-dot tokens.