Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DAOS-14369 test: Rework pydaos and avocado install/setup process. #13565

Merged
merged 111 commits into from
Apr 5, 2024

Conversation

ashleypittman
Copy link
Contributor

@ashleypittman ashleypittman commented Jan 4, 2024

Update pydaos install process. Include pydaos sources in daos-devel rpm to allow
installation on non-default python versions and virtual environments.
Use updated python version for NLT to improve reporting and verify pydaos install process.
Update dependencies for daos-client-tests rpm, add daos-devel to get pydaos sources
and remove some no longer required python libs.
Re-write entire python requirements.txt files whilst keeping install process the same.
requirements.txt is now split into build, utest and ftest files, the origional file pulls in all
three as well as cq for linting.
Update the build to only install build requirements, have utest install utest requirements and
ftest install ftest requirements.

Include avocado 82 in ftest requirements so this is used universally throughout CI.
Update code as required to no longer handle or patch older avocado versions and
add check that at least 82 is in use.

Signed-off-by: Ashley Pittman [email protected]

Copy link

github-actions bot commented Jan 4, 2024

Bug-tracker data:
Ticket title is 'Bump avocado version used throughout CI.'
Status is 'Open'
Labels: 'scrubbed'
https://daosio.atlassian.net/browse/DAOS-14369

@ashleypittman ashleypittman changed the title DAOS-14369 ftest: Use a common avocado version everywhere. DAOS-14369 test: Use a common avocado version everywhere. Jan 4, 2024
@daosbuild1
Copy link
Collaborator

Test stage Unit Test on EL 8.8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-13565/9/testReport/

@daosbuild1
Copy link
Collaborator

@daosbuild1
Copy link
Collaborator

Test stage Unit Test on EL 8.8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-13565/10/testReport/

@daosbuild1
Copy link
Collaborator

@daosbuild1
Copy link
Collaborator

Test stage Functional on EL 8.8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-13565/19/execution/node/757/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15.5 completed with status UNSTABLE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-13565/20/execution/node/337/log

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status UNSTABLE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-13565/20/execution/node/310/log

@daosbuild1
Copy link
Collaborator

Test stage Functional on EL 8.8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-13565/22/execution/node/720/log

@daosbuild1
Copy link
Collaborator

Test stage Functional on EL 8.8 completed with status FAILURE. https://build.hpdd.intel.com/job/daos-stack/job/daos/job/PR-13565/30/display/redirect

Update provisioning scripts to use pip
bump the pip version of avocado.
Update ansible to use the same version.

Required-githooks: true

Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Use venv for NLT.

Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
Required-githooks: true
Signed-off-by: Ashley Pittman <[email protected]>
@ashleypittman
Copy link
Contributor Author

@phender @daltonbohning @brianjmurrell can this be prioritised please? It's a big change and I'd like to get it in ASAP.

@daltonbohning
Copy link
Contributor

IMO we should move forward with this ASAP before it has conflicts yet again. And this work precedes being able to update to an even newer avocado version

@daosbuild1
Copy link
Collaborator

Test stage Functional Hardware Medium Verbs Provider completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-13565/106/execution/node/1441/log

@phender
Copy link
Contributor

phender commented Apr 5, 2024

@ashleypittman ashleypittman changed the title DAOS-14369 test: Rework pydaos and and avocado install/setup process. DAOS-14369 test: Rework pydaos and avocado install/setup process. Apr 5, 2024
@ashleypittman ashleypittman requested a review from a team April 5, 2024 14:16
@phender phender merged commit dcbaf55 into master Apr 5, 2024
73 of 75 checks passed
@phender phender deleted the amd/avocado-version branch April 5, 2024 14:35
daltonbohning added a commit that referenced this pull request Apr 16, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely.

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 16, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely.

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 16, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely.

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 16, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely.

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 16, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely.

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 23, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
"command -v daos" and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 23, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
"command -v daos" and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 23, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
"command -v daos" and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 23, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
"command -v daos" and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 23, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
"command -v daos" and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 25, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
"command -v daos" and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 25, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
shutil.which("daos") and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 26, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
shutil.which("daos") and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 26, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
shutil.which("daos") and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
daltonbohning added a commit that referenced this pull request Apr 26, 2024
Test-tag: pr
Skip-unit-tests: true
Skip-fault-injection-test: true

PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
shutil.which("daos") and support setting DAOS_TEST_PREFIX

Required-githooks: true

Signed-off-by: Dalton Bohning <[email protected]>
phender pushed a commit that referenced this pull request Apr 29, 2024
PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
shutil.which("daos") and support setting DAOS_TEST_PREFIX

Signed-off-by: Dalton Bohning <[email protected]>
mjmac pushed a commit that referenced this pull request Apr 30, 2024
PR #13565 accidentally broke how ftest determines the prefix from
.build_vars.json because it is no longer installed.

Eliminate the need for .build_vars.json in ftest entirely by using
shutil.which("daos") and support setting DAOS_TEST_PREFIX

Signed-off-by: Dalton Bohning <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

7 participants