Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EQL: clean-up toml test execution #61841

Closed
costin opened this issue Sep 2, 2020 · 1 comment · Fixed by #71064
Closed

EQL: clean-up toml test execution #61841

costin opened this issue Sep 2, 2020 · 1 comment · Fixed by #71064
Assignees
Labels
:Analytics/EQL EQL querying Team:QL (Deprecated) Meta label for query languages team >test Issues or PRs that are addressing/adding tests

Comments

@costin
Copy link
Member

costin commented Sep 2, 2020

It's worth looking through the test suite and verify what tests are disabled and what aren't.
The current approach of duplicating tests across different files is error-prone ; having the queries in only one place should make things easier, potentially alongside a deny list.

@costin costin added >bug :Analytics/EQL EQL querying labels Sep 2, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-ql (:Query Languages/EQL)

@elasticmachine elasticmachine added the Team:QL (Deprecated) Meta label for query languages team label Sep 2, 2020
@matriv matriv added >enhancement >test Issues or PRs that are addressing/adding tests and removed >bug >enhancement labels Feb 8, 2021
@matriv matriv self-assigned this Mar 30, 2021
matriv added a commit to matriv/elasticsearch that referenced this issue Mar 30, 2021
Previously, 2 files were used, `test_queries.toml` and
`test_queries_unsupported.toml`. The queries where read from both files
and each query in the 1st file but not in the 2nd was executed, but if
it was also included in the 2nd file (unsupported) was skipped. This
approach helped in first phase of developing EQL since those tests came
from the EQL-endpoint implementation and we wanted to keep those files
in sync. Now, we no longer need to keep this sync approach, so the
unsupported queries are simply commented out in the original file:
`test_queries.toml` and the `test_queries_unsupported.toml` is removed.

Moreover, a few more queries are now enabled (previously where
incorrectly still in the `test_queries_unsupported.toml` file.

Fixes: elastic#61841
matriv added a commit that referenced this issue Mar 31, 2021
Previously, two files were used, `test_queries.toml` and
`test_queries_unsupported.toml`. The queries where read from both files
and each query in the 1st file but not in the 2nd was executed, but if
it was also included in the 2nd file (unsupported) was skipped. This
approach helped in first phase of developing EQL since those tests came
from the EQL-endpoint implementation and we wanted to keep those files
in sync. Now, we no longer need to keep this sync approach, so the
unsupported queries are simply commented out in the original file:
`test_queries.toml` and the `test_queries_unsupported.toml` is removed.

Moreover, one more query is now enabled (previously was
incorrectly still in the `test_queries_unsupported.toml` file) and a few
more were added as commented out, which previously only existed in the
unsupported file.

Fixes: #61841
matriv added a commit to matriv/elasticsearch that referenced this issue Mar 31, 2021
Previously, two files were used, `test_queries.toml` and
`test_queries_unsupported.toml`. The queries where read from both files
and each query in the 1st file but not in the 2nd was executed, but if
it was also included in the 2nd file (unsupported) was skipped. This
approach helped in first phase of developing EQL since those tests came
from the EQL-endpoint implementation and we wanted to keep those files
in sync. Now, we no longer need to keep this sync approach, so the
unsupported queries are simply commented out in the original file:
`test_queries.toml` and the `test_queries_unsupported.toml` is removed.

Moreover, one more query is now enabled (previously was
incorrectly still in the `test_queries_unsupported.toml` file) and a few
more were added as commented out, which previously only existed in the
unsupported file.

Fixes: elastic#61841
(cherry picked from commit 8537b2d)
matriv added a commit that referenced this issue Mar 31, 2021
Previously, two files were used, `test_queries.toml` and
`test_queries_unsupported.toml`. The queries where read from both files
and each query in the 1st file but not in the 2nd was executed, but if
it was also included in the 2nd file (unsupported) was skipped. This
approach helped in first phase of developing EQL since those tests came
from the EQL-endpoint implementation and we wanted to keep those files
in sync. Now, we no longer need to keep this sync approach, so the
unsupported queries are simply commented out in the original file:
`test_queries.toml` and the `test_queries_unsupported.toml` is removed.

Moreover, one more query is now enabled (previously was
incorrectly still in the `test_queries_unsupported.toml` file) and a few
more were added as commented out, which previously only existed in the
unsupported file.

Fixes: #61841
(cherry picked from commit 8537b2d)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/EQL EQL querying Team:QL (Deprecated) Meta label for query languages team >test Issues or PRs that are addressing/adding tests
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants