Avoid modelmesh and Kserve loop on updating shared CRDs

[lburgazzoli]

Description

The KServe and ModelMesh are shipping the same CRDs as part of
their manifests but with different versions, this cause the
respective component reconcilers to keep trying to install
their respective version, ending in a infinite loop.

This commit does not solve the underlying problem of having two
components shipping the same CRDs with different versions, but
avoids the infinite reconcile loop. The CRDs that is actually
installed on the cluster is undefined, the latest one that is
applied wins

https://issues.redhat.com/browse/RHOAIENG-18518

How Has This Been Tested?

• enable the KServe and ModelMesh component
• observe the CRDs chaing version version, which should change a few tie but should stabilize
  kubectl get crd servingruntimes.serving.kserve.io -o yaml -w | grep kubebuilder
kubectl get crd inferenceservices.serving.kserve.io -o yaml -w | grep kubebuilder
• observing operator logs that should not show controller reconciliation keep gogin forever, but should stabilize once components become ready

Screenshot or short clip

Merge criteria

• You have read the contributors guide.
• Commit messages are meaningful - have a clear and concise summary and detailed explanation of what was changed and why.
• Pull Request contains a description of the solution, a link to the JIRA issue, and to any dependent or related Pull Request.
• Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work

[ykaliuta]

Probably it should be named something like "Avoid modelmesh and Kserve loop on updating shared CRDs" because now it's just a declaration of a fact.

[zdtsw]

tested with change local, works as fixing the reconcilation issue when both kserve and modelmesh are enabled at the same time

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: zdtsw

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [zdtsw]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[lburgazzoli]

/test all

[zdtsw]

/test opendatahub-operator-e2e

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 26 lines in your changes missing coverage. Please review.

Project coverage is 19.81%. Comparing base (e83f2fc) to head (36b829c).
Report is 2 commits behind head on main.

Files with missing lines	Patch %	Lines
controllers/components/kserve/kserve_controller.go	0.00%	13 Missing ⚠️
...ts/modelmeshserving/modelmeshserving_controller.go	0.00%	13 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1547      +/-   ##
==========================================
+ Coverage   19.70%   19.81%   +0.11%     
==========================================
  Files         160      160              
  Lines       10979    10917      -62     
==========================================
  Hits         2163     2163              
+ Misses       8588     8526      -62     
  Partials      228      228              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.