You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm using Parsimonious to implement the reference compiler for a language I'm working on, and in the absence of maximally-Unicode-expressive regular expression support (would be fixed by #162 or eventually abandoning regular expressions for something more well-scoped) I'd like to use a custom tokenizer and the TokenGrammar class. However, the __str__ method on ParseError assumes its text property is a string rather than a token sequence: https://github.com/erikrose/parsimonious/blob/master/parsimonious/exceptions.py#L35
I'm not quite sure how this should be fixed, but it does make debugging and error reporting more difficult.
The text was updated successfully, but these errors were encountered:
I too want better tokenization than parsimonious seems capable of, and what you have there seems reasonable for your tasks, but I was hoping for a smaller solution for a smaller project.
I'm using Parsimonious to implement the reference compiler for a language I'm working on, and in the absence of maximally-Unicode-expressive regular expression support (would be fixed by #162 or eventually abandoning regular expressions for something more well-scoped) I'd like to use a custom tokenizer and the TokenGrammar class. However, the
__str__
method onParseError
assumes itstext
property is a string rather than a token sequence: https://github.com/erikrose/parsimonious/blob/master/parsimonious/exceptions.py#L35I'm not quite sure how this should be fixed, but it does make debugging and error reporting more difficult.
The text was updated successfully, but these errors were encountered: