[Bug]: Unify code for all things that are used for a build

[gaiksaya]

Describe the bug

It is observed during the separation task of CI libraries (issue #2489) that the code in this repo is split into 2 process. Building components and CI libraries (for uploading, releasing, etc) that integrates and runs with CI system (Jenkins)
However, looks like few of them have mixed up.
For example:
https://github.com/opensearch-project/opensearch-build/blob/main/vars/buildYumRepo.groovy
https://github.com/opensearch-project/opensearch-build/blob/main/vars/rpmMetaValidation.groovy
https://github.com/opensearch-project/opensearch-build/blob/main/vars/rpmDistValidation.groovy
https://github.com/opensearch-project/opensearch-build/blob/main/vars/rpmDashboardsDistValidation.groovy
More ....

The above snippets cannot be run independently as a code but needs to be run as a part of CI.

All of them should be run as a python code. A wrapper can be used to run them as a part of CI system like integ-test but they should run independently and locally too and not dependent on any CI

To reproduce

No way to run the above code independently

Expected behavior

No response

Screenshots

If applicable, add screenshots to help explain your problem.

Host / Environment

No response

Additional context

No response

Relevant log output

No response

Acceptance Criteria:

• Identify the right groovy code that needs to be migrated to python code in the build repo.
• If the existing validation workflow part of the build repo can validate, then remove the groovy code that does the validation ([Bug]: Unify code for all things that are used for a build #2609 (comment)).
• Identify the groovy libs that are outdated and remove them from being used in the workflows.

[prudhvigodithi]

@gaiksaya @bbarani this is more of a feature to convert into a python code and use them as part of the existing workflows rather than a bug. wdyt?

[gaiksaya]

I believe this was supposed to be python code from the start, I did comment on the PR that added some of this #1912 (comment) but looks like it was ignored/missed. Added as bug as today we cannot run/test this code locally.
Further more if we add validations for Deb, macos, windows, I believe this should not be the path we choose. Better to have a validation framework that extends for each distribution, architecture

[gaiksaya]

New links for above libraries: https://github.com/opensearch-project/opensearch-build-libraries/tree/main/vars

[jordarlu]

Hi, @gaiksaya , as #2725 has been merged, do you think we can close this issue? thanks!

[gaiksaya]

No we still have code in var such as
https://github.com/opensearch-project/opensearch-build-libraries/blob/main/vars/rpmMetaValidation.groovy
https://github.com/opensearch-project/opensearch-build-libraries/blob/main/vars/rpmDistValidation.groovy
https://github.com/opensearch-project/opensearch-build-libraries/blob/main/vars/rpmDashboardsDistValidation.groovy
that needs to be moved to python!

[prudhvigodithi]

We should consider moving all validation groovy code to the validation workflow https://github.com/opensearch-project/opensearch-build/tree/main/src/validation_workflow.