Add filter cmdline option to tests

[Akirathan]

There is Suite.run_with_filter spec_filter group_filter method that allows to filter specs or groups. There are many main methods in tests that call into that method. Let's add an optional filter that can be passed from the cmd line. The filter will be just a single argument that will be first treated as a text and will try to match both groups and specs. If there are no matches, the filter will be interpreter as a regex.

Tasks

Preview Give feedback

1. Add filter cmd line option
2. Print pending groups

[enso-bot]

Pavel Marek reports a new STANDUP for today (2024-02-13):

Progress: - Engine benches work, let's see if there will be any regressions or compile problems after the dailies.

• Bookclub
• Managed to remove all the akka classes from runtime.jar (Remove akka from runtime #8953).
  • Fixing licenses - takes a lot of time, it is a painful process, and feels unnecessary. It should be finished by 2024-02-16.

[enso-bot]

Pavel Marek reports a new STANDUP for yesterday (2024-02-14):

Progress: - Designing the new filter option to Suite.run_with_filter.

• Bumped into a problem with the compiler - DataflowAnalysis fails on "Blanks should not be present" #9063
• Let's simplify the filter parameter as much as possible. It should be finished by 2024-02-16.

[enso-bot]

Pavel Marek reports a new STANDUP for today (2024-02-15):

Progress: - filter from cmdline is ready for review #9065

• Integrating some of the review requests. It should be finished by 2024-02-16.

[enso-bot]

Pavel Marek reports a new STANDUP for today (2024-02-16):

Progress: - Surprisingly, Base_Tests are failing:

• Dealing with some weird issues in Array_Proxy
• Will have to finish this PR next week. It should be finished by 2024-02-16.

[enso-bot]

Pavel Marek reports a new 🔴 DELAY for today (2024-02-19):

Summary: There is 5 days delay in implementation of the Add filter cmdline option to tests (#8998) task.
It will cause 5 days delay for the delivery of this weekly plan.

Running the tests with filter revealed some unexpected issues in the engine related to the partial evaluation in Truffle

Delay Cause: Bumped into unexpected issues with the tests

[enso-bot]

Pavel Marek reports a new STANDUP for today (2024-02-19):

Progress: - Array_Proxy test fixed by fixing a GraalVM PE - related issue when checking arguments for ArrayProxy.

• Tests in Atom_With_Hoels still remain to be fixed It should be finished by 2024-02-21.

[enso-bot]

Pavel Marek reports a new STANDUP for today (2024-02-20):

Progress: - Created PR that ensures the correct versions of Java and GraalVM are used: #9106

• Spent most of the time debugging a leak of cache value issue.
  • After a long struggle, created a minimal reproducer in 334c11c It should be finished by 2024-02-21.

[enso-bot]

Pavel Marek reports a new STANDUP for today (2024-02-21):

Progress: - Fixed the issue with atom with hole cashing after consultation with Jaroslav.

• Fixing another cashing related issue with EnsoHashMap that is difficult to reproduce as well
  • Discovered the issue: specialization guards are not exclusive. It should be finished by 2024-02-21.