Tokens form the terminals for the syntactic grammar and are comprised of identifiers, keywords, reserved words, literals, operators, and punctuators. Whitespace and comments are not tokens, but may separate tokens.
token
: identifier
| keyword
| reserved_word
| literal
| operator_or_punctuator
;