Fix the unit tests that use Rust FlyteIDL

[austin362667]

Tracking issue

Follow-ups in #2561

Why are the changes needed?

The unit tests of flyrs-v2 dev branch should also be updated to the corresponding flyteidl_rust in flyteorg/flyte#5525

What changes were proposed in this pull request?

Beyond fixing all unit tests to use new flyteidl_rust, there are some pending todos:

1. PyO3 not support pickling in Python:
   As it's not currently supported by PyO3. So Flyte keeps failing on pickling exposed flyteidl_rust objects.

   • I decided to temporarily mark them as flyteidl_rust and skip in pytest.
   • For more details on supporting pickle serialization in PyO3, please check Pickle Support PyO3/pyo3#100 (One of the oldest lasting issues..).

2. OpenSSL linking not found:

   • Currently, only the Windows CI is failing because the Rust openssl[vendored] crate can't link to OpenSSL. I've tried both static and dynamic linking.
   • With dynamic linking, it can compile, but an error occurs when importing the Python module. The solution is to copy the .dll file inside the Python module folder.
   • However, I think a better solution would be to directly replace openssl with rustls. Please refer to this discussion.

How was this patch tested?

Rather than directly installing flyteidl_rust from https://test.pypi.org/project/flyteidl-rust/. We build flyteidl_rust from flyteorg/flyte#5525 source code to simulate future development process, users modify new protos then build the new flyteidl_rust python package locally.

Setup process

Screenshots

As you can see, only windows CI failed due to OpenSSL compilation and static linking error:

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

Docs link

[codecov]

Codecov Report

Attention: Patch coverage is 3.50877% with 55 lines in your changes missing coverage. Please review.

Please upload report for BASE (flyrs-v2@5c8f1e7). Learn more about missing BASE report.

Files with missing lines	Patch %	Lines
flytekit/core/utils.py	0.00%	14 Missing ⚠️
flytekit/models/core/condition.py	0.00%	14 Missing ⚠️
flytekit/models/common.py	0.00%	9 Missing ⚠️
flytekit/models/core/workflow.py	0.00%	9 Missing ⚠️
flytekit/extras/accelerators.py	0.00%	2 Missing ⚠️
flytekit/clients/friendly.py	0.00%	1 Missing ⚠️
flytekit/core/array_node.py	0.00%	1 Missing ⚠️
flytekit/core/artifact.py	0.00%	1 Missing ⚠️
flytekit/core/local_cache.py	0.00%	1 Missing ⚠️
flytekit/models/admin/common.py	0.00%	1 Missing ⚠️
... and 2 more

Additional details and impacted files

@@             Coverage Diff             @@
##             flyrs-v2    #2811   +/-   ##
===========================================
  Coverage            ?   37.61%           
===========================================
  Files               ?      183           
  Lines               ?    19042           
  Branches            ?     2470           
===========================================
  Hits                ?     7163           
  Misses              ?    11692           
  Partials            ?      187           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.