Support semantic token MultilineTokenSupport

[CppCXY]

If multiline tokens are not supported and a tokens length takes it past the end of the line, it should be treated as if the token ends at the end of the line and will not wrap onto the next line.

If the length of a token exceeds the end of this line, it should not continue to the next line.

[angelozerr]

Have you a usecase?

[CppCXY]

test script here:
test2.zip

If the language server detects that the client does not support multiline tokens, it will return multiple single-line tokens, each with a length of 9999. According to LSP, overly long tokens should not continue to the next line. However, LSP4IJ continues them to the following lines, causing the string color to change.

the response:

[angelozerr]

Could you share please your LSP traces, because I would like to start writting tests for sem1ntic tokens by using real LSP traces. I need your full trace with initialize which return legend and semanticTokens/full

[CppCXY]

LSPIJ.zip

[angelozerr]

@CppCXY do you have some coloration, or does semantic fail with a stack trace error?

[CppCXY]

@CppCXY do you have some coloration, or does semantic fail with a stack trace error?

no stack trace,

[angelozerr]

Are you sure that your semanticFull trace is for the content of your file that you have attached?

Could you add a screenshot with the result of the problem please.

[CppCXY]

"hello" was rendered in gray:

[CppCXY]

This is because Luals splits tokens that span multiple lines into several single-line tokens and sets the token length to 9999, which is in accordance with the language server specifications.