Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Automate nightly e2e testing for cortex.cpp against cortex.llamacpp pre-release #1729

Closed
2 tasks
hiento09 opened this issue Nov 26, 2024 · 0 comments · Fixed by #1771
Closed
2 tasks
Assignees
Milestone

Comments

@hiento09
Copy link
Contributor

Problem Statement

Enhance the current CI pipeline to include automated end-to-end (e2e) testing for cortex.cpp against the nightly pre-release version of cortex.llamacpp. This improvement aims to streamline the decision-making process for releasing a new version of cortex.llamacpp based on test results.

Feature Idea

Tasks:

  • Modify the CI workflow to:
    • Trigger e2e tests automatically after the nightly pre-release of cortex.llamacpp is generated.
    • Fetch and test the latest pre-release version of cortex.llamacpp against cortex.cpp.
  • Ensure the pipeline reports the results of e2e tests clearly.

This enhancement will provide better confidence in the stability of nightly builds and facilitate faster decisions on promoting pre-releases to production versions.

@hiento09 hiento09 self-assigned this Nov 26, 2024
@hiento09 hiento09 added this to Menlo Nov 26, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Nov 26, 2024
@hiento09 hiento09 moved this from Investigating to In Progress in Menlo Nov 26, 2024
@hiento09 hiento09 moved this from In Progress to In Review in Menlo Nov 28, 2024
@hiento09 hiento09 moved this from Eng Review to QA in Menlo Dec 2, 2024
@gabrielle-ong gabrielle-ong modified the milestones: v1.0.5, v1.0.4 Dec 6, 2024
@TC117 TC117 moved this from QA to Completed in Menlo Dec 16, 2024
@github-project-automation github-project-automation bot moved this from Completed to QA in Menlo Dec 23, 2024
@hiento09 hiento09 moved this from QA to Completed in Menlo Dec 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants