Merge dev into master #3642

Create CodeGenerator only one time during grammar processing, refactor code

…Kotlin)

… value

…on returns correct value

[Swift] Use proper constants

…hat's wrong when failed.

…va which needs big strings for efficiency.

…Limit normalize targets to 80 char strings for ATN serialization segments.

fixed a small typo

getLanguage(): protected -> public as it was before appendUnicodeEscapedCodePoint(int codePoint, StringBuilder sb, boolean escape): protected -> private (it's a new helper method, no need for API now) Added comment for appendUnicodeEscapedCodePoint

Some tool bugfixes

Update actions.md

Use atomic instead of a shared mutex for DFA.s0

Update Swift runtime doc

[Python3] rename pygrun, add entry_point

caseInsensitive lexer rule option

Add browser fs fallback

Corrected/clarified the Linux C++ runtime compilation instructions

Fix #3096 - antlr4-maven-plugin is using maven-project version 2.2.1 …

Use `AnyObject` instead of `class`.

Update contributors.txt to add Abe Skolnik

Remove `late` modifier for Dart generated context classes

* remove all -q quiet mvn options to see output on CI servers. * run the various unit test classes in parallel rather than each individual test method, all except for Swift at the moment: `-Dparallel=classes -DthreadCount=4` * use bigger machine at circleci * No more test groups like parser1, parser2.

* Add Swift Package Manager Support * Swift Package Dynamic * 【fix】【test】Fix run process path Co-authored-by: Terence Parr <[email protected]>

* use src 11 for tool, but 8 for plugin/runtime/runtime-tests. * use 11 in CI builds

This installs DLLs in bin directory instead of lib.

* Fixed pygrun relative import issue * Added name to contributors.txt Co-authored-by: Terence Parr <[email protected]>

* no need for plugin in runtime, always gen svg from dot for javadoc, gen 1.8 not 1.7 doc for runtime. Gen 11 for tool. * tweak doc for 1.8 runtime. Test rig should gen 1.8 not 1.7

…ime to release yet.

* Escape reserved words during grammar generation, fixes #1070 (for -> for_ but RULE_for) Deprecate USE_OF_BAD_WORD * Make name and escapedName consistent across tool and codegen classes Fix other pull request notes * Rename NamedActionChunk to SymbolRefChunk

use self-hosted windows github action runners

Fix cmd line issue

GitHub windows runner

display Github status for windows

try python 3

Python GitHub action

GitHub javascript action

fix warnings in C# CI

GitHub action csharp

GitHub action dart

GitHub action go

* Update windows.yml * Create run-tests-php.cmd * Update run-tests-php.cmd * Update run-tests-php.cmd * Update run-tests-php.cmd * Update run-tests-php.cmd * Update windows.yml * Update windows.yml * Update windows.yml * Update run-tests-php.cmd * Update windows.yml

* Delete .appveyor directory * Delete .travis directory

* Update windows.yml * Update windows.yml * Update windows.yml

replace toArray(new T[size]) with toArray(new T[0]) for better performance https://shipilev.net/blog/2016/arrays-wisdom-ancients/#_conclusion

* fix-maven-concurrency * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update run-tests-python2.cmd * Update run-tests-python3.cmd * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update windows.yml * Update run-tests-php.cmd * Update windows.yml * Update run-tests-dart.cmd * Update run-tests-csharp.cmd * Update run-tests-go.cmd * Update run-tests-java.cmd * Update run-tests-javascript.cmd * Update run-tests-php.cmd * Update run-tests-python2.cmd * Update run-tests-python3.cmd

increase Windows CI concurrency for all targets except Dart

* Preserve line separators for input data in runtime tests, fix test data Refactor and improve performance of BaseRuntimeTest * Add LineSeparator (\n, \r\n) tests * Set up .gitattributes for LineSeparator_LF.txt (eol=lf) and LineSeparator_CRLF.txt (eol=crlf)

…s (LineSeparatorLf, LineSeparatorCrLf)

[JavaScript] Migrate from jest to jasmine

…t information concerning how many of each integer value appear in a serialized ATN.

Also includes separating the generation of the .interp file from writing it out so that we can use both independently.

Regenerate XPathLexer files

…iling ATN simulator setup bug

…output files Fix creation of excess fragments for Dart, Cpp, PHP runtimes

…rom ATNSimulator

) * Convert Python2/3 to use int arrays not strings for ATN encodings. Also make target indicate int vs string. * rename and reverse ATNSerializedAsInts * add override * remove unneeded method

Thanks guys. A major advancement.

* Add Swift Package Manager Support * Swift Package Dynamic * 【fix】【test】Fix run process path * [Docs] [Swift] update link, remove expired descriptions Co-authored-by: Terence Parr <[email protected]>

@OverRide

* go back to generating pure ascii ATN serializations to avoid issues where target compilers might assume ascii vs utf-8. * forgot I had to change php on previous ATN serialization tweak. * change how we escapeChar() per target. * oops; gotta use escapeChar method * rm unneeded case * add @OverRide

* use ints not chars for C# * oops. remove 'quotes' * regen from XPathLexer.g4 * simplify ATN with bypass alts mechanism in Java. * Change string to int[] for serialized ATN for C#; removed unneeded `use System` from XPathLexer.g4; regen that grammar.

* perf: Add default implementation for Visit in ParseTreeVisitor. Reference: https://github.com/antlr/antlr4/blob/ad29539cd2e94b2599e0281515f6cbb420d29f38/runtime/Java/src/org/antlr/v4/runtime/tree/AbstractParseTreeVisitor.java#L18 * doc: add contributor

…ng exception handling: #3162

* [C++] Remove unused LexerATNSimulator::match_calls * Remove match_calls from other targets

…TI (#3584)

This reverts commit 01bc811.

* Make it easier to contribute: Add c++ configuration for .editorconfig. Using the observed style with 2 indentation spaces. Signed-off-by: Henner Zeller <[email protected]> * Add hzeller to contributors.txt Signed-off-by: Henner Zeller <[email protected]>

…3597)

This reverts commit b0f8551.

@KvanTTT

) * refactor serialize so we don't need comments * more cleanup during refactor * store language in serializer obj * A lexer rule token type should never be -1 (EOF). 0 is fragment but then must be > 0. * Go uses int not uint16 for ATN now. java/go/python3 pass * remove checks for 0xFFFF in Go. * C++ uint16_t to int for ATN. * add mac php dir; fix type on accept() for generated code to be mixed. * Add test from @KvanTTT. This PR fixes #3555 for non-Java targets. * cleanup and add big lexer from #3546 * increase mvn mem size to 2G * increase mvn mem size to 8G * turn off the big ATN lexer test as we have memory issues during testing. * Fixes #3592 * Revert "C++ uint16_t to int for ATN." This reverts commit 4d2ebbf. # Conflicts: # runtime/Cpp/runtime/src/atn/ATNSerializer.cpp # runtime/Cpp/runtime/src/tree/xpath/XPathLexer.cpp * C++ uint16_t to int32_t for ATN. * rm unnecessary include file, updating project file. get rid of the 0xFFFF does in the C++ deserialization * rm refs to 0xFFFF in swift * javascript tests were running as Node...added to ignore list. * don't distinguish between 16 and 32 bit char sets in serialization; Python2/3 updated to work with this change. * update C++ to deserialize only 32-bit sets * 0xFFFF -> -1 for C++ target. * get other targets to use 32-bit sets in serialization. tests pass locally. * refactor to reduce code size * add comment * oops. comment out call to writeSerializedATNIntegerHistogram(). I wonder if this is why it ran out of memory during testing? * all but Java, Node, PHP, Go work now for the huge lexer file; I have set them to ignore. note that the swift target takes over a minute to lex it. I've turned off Node but it does not seem to terminate but it could terminate eventually. * all but Java, Node, PHP, Go work now for the huge lexer file; I have set them to ignore. note that the swift target takes over a minute to lex it. I've turned off Node but it does not seem to terminate but it could terminate eventually. * Turn off this big lexer because we get memory errors during continuous integration * Intermediate commit where I have shuffled around all of the -1 flipping and bumping by two. work still needs to be done because the token stream rewriter stuff fails. and I assume the other decoding for human readability testing if doesn't work * convert decode to use int[]; remove dead code. don't use serializeAsChar stuff. more tests pass. * more tests passing. simplify. When copying atn, must run ATN through serializer to set some state flags. * 0xFFFD+ are not valid char * clean up. tests passing now * huge clean up. Got Java working with 32-bit ATNs!Still working on cleanup but I want to run the tests * Cleanup the hack I did earlier; everything still seems to work * Use linux DCO not our old contributors certificate of origin * remove bump-by-2 code * clean up per @KvanTTT. Can't test locally on this box. Will see what CI says. * tweak comment * Revert "Use linux DCO not our old contributors certificate of origin" This reverts commit b0f8551. * see if C++ works in CI for huge ATN

* Use linux DCO not our old contributors certificate of origin * Revert "Use linux DCO not our old contributors certificate of origin" This reverts commit b0f8551. * use linux DCO * use linux DCO * Use linux DCO not our old contributors certificate of origin * update release documentation Signed-off-by: Terence Parr <[email protected]>

* fix default equality * equality cases * optional unwrapping

* common for in loops * reversed loop * drop first loop * for in with default BitSet

#3612)

#3608)

…provements (#3615)

fix dependabot issues

* this was added to the stdlib in Swift 5 * &>> is defined as lhs >> (rhs % lhs.bitwidth) * the stdlib has these * reduce loops * use indices * append(contentsOf:) * Array literal init works for sets too! * inline and remove bit query functions

…tions and semantic predicates; Fixes #3611. Fixes #3606. Signed-off-by: Terence Parr <[email protected]>

* refactor, 1 file per class, use import, use module semantics, use webpack 5, use eslint * all tests pass * simplifications and alignment with standard js idioms * simplifications and alignment with standard js idioms * support reading legacy ATN * support both module and non-module imports * fix failing tests * fix failing tests

… bigger than 16bits. (#3620)

Included specific examples of using ANTLR4_TAG and ANTLR4_ZIP_REPOSITORY in the sample CMakeLists file.

The new option to cmake ANTLR_BUILD_CPP_TESTS is default on (so the behavior is as before), but it provides a way to switch off if not needed. The C++ tests pull in an external dependency (googletests), which might conflict if ANTLR is used as a subproject in another cmake project. Signed-off-by: Henner Zeller <[email protected]>

Interval was a pointer to 2 Ints it ought to be just 2 Ints, which is smaller and more semantically correct, with no need for a cache. However, this technically breaks metadata and AnyObject conformance but people shouldn't be relying on those for an Interval.

* Tweak doc * Swift was referring to hardcoded version * Start version update script. * add files to update * clean up setup * clean up setup * clean up setup * don't need file * don't need file * Fixes #3600. add instructions and associated code necessary to build the xpath lexers. * clean up version nums * php8 * php8 * php8 * php8 * php8 * php8 * php8 * php8 * tweak doc * ok, i give up. php won't bump up too v8 * tweak doc * version number bumped to 4.10 in runtime. * Change the doc for releasing and update to use latest ST 4.3.2 * fix dart version to 4.10.0 * cmd files Cannot use export bash command. * try fixing php ci again * working on deploy Signed-off-by: Terence Parr <[email protected]> * php8 always install. * set js to 4.10.0 not 4.10 * turn off apt update for php circleci * try w/o cimg/php * try setting branch * ok i give up * tweak * update docs for release. * php8 circleci * use 3.5.3 antlr * use 3.5.3-SNAPSHOT antlr

* ParserRuleContext.children see comment in removeLastChild * TokenStream.getText * Parser._parseListeners this might require changes to the code templates? * ATN {various} * make computeReachSet return empty, not nil * overrides refine optionality * BufferedTokenStream getHiddenTokensTo{Left, Right} return empty not nil * Update Swift.stg * avoid breakage by adding overload of `getText` in extension

Signed-off-by: Terence Parr <[email protected]>

This reverts commit b5ccba0.

Commits on Jan 3, 2022

set tool version for testing

parrt committed Jan 3, 2022

Configuration menu

View commit details

Copy full SHA for 53c1139

Browse repository at this point

Copy the full SHA

53c1139 View commit details

Browse the repository at this point in the history

Commits on Jan 19, 2022

[JavaScript] Migrate from jest to jasmine

jcking committed Jan 19, 2022

Configuration menu

View commit details

Copy full SHA for c973950

Browse repository at this point

Copy the full SHA

c973950 View commit details

Browse the repository at this point in the history

Merge dev into master #3642

Merge dev into master #3642

Commits on Dec 27, 2021

Commits on Dec 28, 2021

Commits on Dec 29, 2021

Commits on Dec 30, 2021

Commits on Dec 31, 2021

Commits on Jan 2, 2022

Commits on Jan 3, 2022

Commits on Jan 4, 2022

Commits on Jan 5, 2022

Commits on Jan 6, 2022

Commits on Jan 8, 2022

Commits on Jan 9, 2022

Commits on Jan 11, 2022

Commits on Jan 17, 2022

Commits on Jan 19, 2022

Commits on Jan 21, 2022

Commits on Jan 23, 2022

Commits on Jan 29, 2022

Commits on Jan 30, 2022

Commits on Jan 31, 2022

Commits on Feb 1, 2022

Commits on Feb 5, 2022

Commits on Feb 6, 2022

Commits on Feb 7, 2022

Commits on Feb 8, 2022

Commits on Feb 9, 2022

Commits on Feb 12, 2022

Commits on Feb 15, 2022

Commits on Feb 16, 2022

Commits on Feb 19, 2022

Commits on Feb 21, 2022

Commits on Feb 26, 2022

Commits on Feb 27, 2022

Commits on Feb 28, 2022

Commits on Mar 1, 2022

Commits on Mar 4, 2022

Commits on Mar 5, 2022

Commits on Mar 6, 2022

Commits on Mar 7, 2022

Commits on Mar 8, 2022

Commits on Mar 9, 2022

Commits on Mar 10, 2022

Commits on Mar 11, 2022

Commits on Mar 13, 2022

Commits on Mar 14, 2022

Commits on Mar 17, 2022

Commits on Mar 18, 2022

Commits on Mar 19, 2022

Commits on Mar 22, 2022

Commits on Mar 25, 2022

Commits on Mar 26, 2022

Commits on Mar 27, 2022

Commits on Mar 28, 2022

Commits on Mar 29, 2022

Commits on Mar 30, 2022

Commits on Mar 31, 2022

Commits on Apr 1, 2022

Commits on Apr 2, 2022

Commits on Apr 3, 2022

Commits on Apr 5, 2022

Commits on Apr 6, 2022

Commits on Apr 8, 2022

Commits on Apr 9, 2022

Commits on Apr 10, 2022