Coq unicode improvements

[cormacrelf]

Fixes #1312 for coq.

Unfortunately it does not fix this for every language, but as a general rule for fixing other languages that should support unicode identifiers, replace [a-z]/\w or similar with Ruby's regex unicode classes e.g. \p{L} for any unicode letter. The Coq version here makes use of \p{S}|\p{Pc} to cover all symbols and non-parenthetical punctuation, makes them all operators (with some nuances/overrides).

[cormacrelf]

There's even a little nuance that's hard to see in the Github theme, which you get back with monokai etc

[cormacrelf]

One choice that I made is that the big list of first/second-order logic symbols from the previous effort are now Operator instead of Punctuation. This is basically because most of them are indeed operators. If you want +-* (from the bullet point goal selection syntax) to be Punctuation like all the braces are, then the way to go is differentiating between proof mode sentence-initial symbols (ie bullets) and symbols anywhere else. You can push/pop proof mode with Proof. and Qed. (et al). It works but is obviously going to be slightly more fragile to invalid syntax.

[cormacrelf]

I'll push the work anyway, have a look

[Lysxia]

This would be very nice to have for Coq projects on gitlab to render better.

[tancnle]

Thanks a lot for your contribution @cormacrelf ❤️ Sorry to get back to this PR late 🙏🏼

It looks great to me overall 👍🏼 I have added some suggestions for your consideration. Please let me know what you think.

If possible, could you also rebase this branch of upstream/master to initiate the CI 🙏🏼?

[gmalecha]

It would be really good to get this merged. @tancnle can you apply the changes and merge it?

[tancnle]

It would be really good to get this merged. @tancnle can you apply the changes and merge it?

👋🏼 @gmalecha I can go over the PR again and apply these changes.

[gmalecha]

Thank you so much @tancnle!

Who can approve to merge? I have another PR that I'd also like to merge related to Coq string parsing (#1116).

[tancnle]

@gmalecha Sorry for the delay. Let's merge and follow up with some improvement 👍🏼