Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update conformance GH action gradle version (#1485) #1486

Merged
merged 1 commit into from
Jun 11, 2024

Conversation

alancai98
Copy link
Member

Relevant Issues

  • None

Description

Other Information

  • Updated Unreleased Section in CHANGELOG: [NO]

    • No API changes
  • Any backward-incompatible changes? [NO]

  • Any new external dependencies? [NO]

  • Do your changes comply with the Contributing Guidelines
    and Code Style Guidelines? [YES]

License Information

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@alancai98 alancai98 self-assigned this Jun 11, 2024
Copy link

Conformance comparison report-Cross Engine

Base (eval) legacy +/-
% Passing 91.22% 92.59% 1.37%
✅ Passing 5341 5420 79
❌ Failing 514 434 -80
🔶 Ignored 0 0 0
Total Tests 5855 5854 -1
Number passing in both: 5102

Number failing in both: 195

Number passing in eval engine but fail in legacy engine: 239

Number failing in eval engine but pass in legacy engine: 319
⁉️ CONFORMANCE REPORT REGRESSION DETECTED ⁉️
The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.
319 test(s) were failing in eval but now pass in legacy. Before merging, confirm they are intended to pass.
The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

@alancai98 alancai98 merged commit 67c5392 into v1 Jun 11, 2024
14 checks passed
@alancai98 alancai98 deleted the cp-conformance-gh-action-update branch June 11, 2024 23:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants