UPSTREAM: <carry>: Rebase code to kfp 2.2.0 #78

rimolive · 2024-08-30T17:57:53Z

Description of your changes:

Checklist:

The title for your pull request (PR) should follow our title convention. Learn more about the pull request title convention used in this repository.

PiperOrigin-RevId: 591051675

PiperOrigin-RevId: 591075392

* add subprocess task handler * response to review feedback

…` when uploading models from `preview.llm.rlhf_pipeline` instead of hardcoding value as `text-bison@001` PiperOrigin-RevId: 591346782

…lm.rlhf_pipeline` run instead of reusing cached result PiperOrigin-RevId: 591365087

…f model checkpoint from `preview.llm.rlhf_pipeline` PiperOrigin-RevId: 591393116

…eflow#10325) * feat(sdk): add local execution output collection #localexecution * update ExecutorInput processing * address review feedback * fix exception handling test

PiperOrigin-RevId: 592033936

…10318) (kubeflow#10319) * feat: preserve querystring in pipeline root * refactor: create AppendToPipelineRoot Also apply to client.go * feat: remove query string from URIs (#1) * feat: remove query string from URIs * refactor(GenerateOutputURI): move and preserve comments

PiperOrigin-RevId: 592257929

…omponent (kubeflow#10315)

…ubeflow#10334)

…eflow#10330)

kubeflow#10333) * support Container Components * address review feedback

PiperOrigin-RevId: 592702825

PiperOrigin-RevId: 592769441

PiperOrigin-RevId: 594058915

PiperOrigin-RevId: 595174285

…ion (kubeflow#10353)

…logs (kubeflow#10354)

…ubeflow#10336)

…low#10355)

…low#10338)

…r component execution #localexecution (kubeflow#10348) * feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution * address review feedback * fix test

…localexecution (kubeflow#10339)

dsp-developers · 2024-10-07T15:54:36Z

Commit Checker results:

**NOTE**: These are the results of the commit checker scans. 
If these are not commits from upstream kfp, then please ensure
you adhere to the commit checker formatting

commitchecker verson unknown
Validating 0 commits between 0f96e42b1bd0968e898f6912a7b23f0a1285c6db...b9c7a42a34a491573135add13f875154e6feb540

dsp-developers · 2024-10-07T16:03:37Z

Change to PR detected. A new PR build was completed.
A set of new images have been built to help with testing out this PR:
API Server: quay.io/opendatahub/ds-pipelines-api-server:pr-78
DSP DRIVER: quay.io/opendatahub/ds-pipelines-driver:pr-78
DSP LAUNCHER: quay.io/opendatahub/ds-pipelines-launcher:pr-78
Persistence Agent: quay.io/opendatahub/ds-pipelines-persistenceagent:pr-78
Scheduled Workflow Manager: quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-78
MLMD Server: quay.io/opendatahub/mlmd-grpc-server:latest
MLMD Envoy Proxy: registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2
UI: quay.io/opendatahub/ds-pipelines-frontend:pr-78

backend/src/v2/metadata/client.go

backend/src/v2/driver/driver.go

backend/src/v2/component/launcher_v2.go

backend/src/v2/objectstore/object_store.go

dsp-developers · 2024-10-08T13:24:05Z

Commit Checker results:

**NOTE**: These are the results of the commit checker scans. 
If these are not commits from upstream kfp, then please ensure
you adhere to the commit checker formatting

commitchecker verson unknown
Validating 0 commits between 0f96e42b1bd0968e898f6912a7b23f0a1285c6db...8e291dac97ee7e77c1f8ff3e7ec4e64d9c9742ce

dsp-developers · 2024-10-08T13:33:24Z

Change to PR detected. A new PR build was completed.
A set of new images have been built to help with testing out this PR:
API Server: quay.io/opendatahub/ds-pipelines-api-server:pr-78
DSP DRIVER: quay.io/opendatahub/ds-pipelines-driver:pr-78
DSP LAUNCHER: quay.io/opendatahub/ds-pipelines-launcher:pr-78
Persistence Agent: quay.io/opendatahub/ds-pipelines-persistenceagent:pr-78
Scheduled Workflow Manager: quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-78
MLMD Server: quay.io/opendatahub/mlmd-grpc-server:latest
MLMD Envoy Proxy: registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2
UI: quay.io/opendatahub/ds-pipelines-frontend:pr-78

dsp-developers · 2024-10-08T14:24:48Z

Commit Checker results:

**NOTE**: These are the results of the commit checker scans. 
If these are not commits from upstream kfp, then please ensure
you adhere to the commit checker formatting

commitchecker verson unknown
Validating 0 commits between 0f96e42b1bd0968e898f6912a7b23f0a1285c6db...fa2ed8e1d6a74d0386a98bdf4ab76a9f1bcf86ad

dsp-developers · 2024-10-08T14:29:50Z

Commit Checker results:

**NOTE**: These are the results of the commit checker scans. 
If these are not commits from upstream kfp, then please ensure
you adhere to the commit checker formatting

commitchecker verson unknown
Validating 0 commits between 0f96e42b1bd0968e898f6912a7b23f0a1285c6db...a99d754d3ea4428b37693363e3cfa639ec709406

dsp-developers · 2024-10-08T14:34:03Z

Change to PR detected. A new PR build was completed.
A set of new images have been built to help with testing out this PR:
API Server: quay.io/opendatahub/ds-pipelines-api-server:pr-78
DSP DRIVER: quay.io/opendatahub/ds-pipelines-driver:pr-78
DSP LAUNCHER: quay.io/opendatahub/ds-pipelines-launcher:pr-78
Persistence Agent: quay.io/opendatahub/ds-pipelines-persistenceagent:pr-78
Scheduled Workflow Manager: quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-78
MLMD Server: quay.io/opendatahub/mlmd-grpc-server:latest
MLMD Envoy Proxy: registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2
UI: quay.io/opendatahub/ds-pipelines-frontend:pr-78

Signed-off-by: Ricardo M. Oliveira <[email protected]>

openshift-ci · 2024-10-08T14:36:16Z

The following users are mentioned in OWNERS file(s) but are untrusted for the following reasons. One way to make the user trusted is to add them as members of the opendatahub-io org. You can then trigger verification by writing /verify-owners in a comment.

Tomcli
- User is not a member of the org. User is not a collaborator. Satisfy at least one of these conditions to make the user trusted.
- backend/OWNERS

dsp-developers · 2024-10-08T14:36:52Z

Commit Checker results:

**NOTE**: These are the results of the commit checker scans. 
If these are not commits from upstream kfp, then please ensure
you adhere to the commit checker formatting

commitchecker verson unknown
Validating 0 commits between 0f96e42b1bd0968e898f6912a7b23f0a1285c6db...5b9caa3e954ea41c961e944aecf7dc797ed99250

dsp-developers · 2024-10-08T14:39:13Z

Change to PR detected. A new PR build was completed.
A set of new images have been built to help with testing out this PR:
API Server: quay.io/opendatahub/ds-pipelines-api-server:pr-78
DSP DRIVER: quay.io/opendatahub/ds-pipelines-driver:pr-78
DSP LAUNCHER: quay.io/opendatahub/ds-pipelines-launcher:pr-78
Persistence Agent: quay.io/opendatahub/ds-pipelines-persistenceagent:pr-78
Scheduled Workflow Manager: quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-78
MLMD Server: quay.io/opendatahub/mlmd-grpc-server:latest
MLMD Envoy Proxy: registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2
UI: quay.io/opendatahub/ds-pipelines-frontend:pr-78

dsp-developers · 2024-10-08T14:45:57Z

Change to PR detected. A new PR build was completed.
A set of new images have been built to help with testing out this PR:
API Server: quay.io/opendatahub/ds-pipelines-api-server:pr-78
DSP DRIVER: quay.io/opendatahub/ds-pipelines-driver:pr-78
DSP LAUNCHER: quay.io/opendatahub/ds-pipelines-launcher:pr-78
Persistence Agent: quay.io/opendatahub/ds-pipelines-persistenceagent:pr-78
Scheduled Workflow Manager: quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-78
MLMD Server: quay.io/opendatahub/mlmd-grpc-server:latest
MLMD Envoy Proxy: registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2
UI: quay.io/opendatahub/ds-pipelines-frontend:pr-78

HumairAK · 2024-10-08T19:25:49Z

/lgtm
/approve

openshift-ci · 2024-10-08T19:26:00Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: HumairAK

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [HumairAK]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

dsp-developers · 2024-10-08T19:27:20Z

Commit Checker results:

**NOTE**: These are the results of the commit checker scans. 
If these are not commits from upstream kfp, then please ensure
you adhere to the commit checker formatting

commitchecker verson unknown
Validating 0 commits between 028d903889f2de5d7e0ac27be001f9523a3a126e...5b9caa3e954ea41c961e944aecf7dc797ed99250

TheMichaelHu and others added 30 commits December 14, 2023 14:25

feat(components): Add better docstrings for AutoSxS

9f8495d

PiperOrigin-RevId: 591051675

test(components): INTERNAL

75ffbf9

PiperOrigin-RevId: 591075392

feat(sdk): add subprocess task handler #localexecution (kubeflow#10302)

21f8e9c

* add subprocess task handler * response to review feedback

fix(components): Use large_model_reference as `model_reference_name…

f51a930

…` when uploading models from `preview.llm.rlhf_pipeline` instead of hardcoding value as `text-bison@001` PiperOrigin-RevId: 591346782

test(sdk): add kfp-kubernetes execution tests (kubeflow#10304)

2009dfb

fix(components): Resolve unique model display name on each `preview.l…

075d58f

…lm.rlhf_pipeline` run instead of reusing cached result PiperOrigin-RevId: 591365087

fix(components): Upload the tuned adapter to Model Registry instead o…

2e2ba9e

…f model checkpoint from `preview.llm.rlhf_pipeline` PiperOrigin-RevId: 591393116

feat(sdk): add local execution output collection #localexecution (kub…

76aad8b

…eflow#10325) * feat(sdk): add local execution output collection #localexecution * update ExecutorInput processing * address review feedback * fix exception handling test

chore(sdk): fix use of invalid escape sequence in tests (kubeflow#10310)

d0da0ad

feat(sdk): add local execution logging #localexecution (kubeflow#10326)

7849272

chore(components): Fix argument description

8eddc27

PiperOrigin-RevId: 592033936

feat(components): change output format to allow possible post eval

44f9992

PiperOrigin-RevId: 592257929

fix(frontend): Add disableParsingRawHTML option for markdown-to-jsx c…

c6acac9

…omponent (kubeflow#10315)

feat(sdk): add DockerRunner #localexecution (kubeflow#10328)

adc5b3b

feat(sdk): add special dsl.OutputPath read logic #localexecution (k…

654bbde

…ubeflow#10334)

chore(sdk): write local execution logs to stdout #localexecution (kub…

f52ba56

…eflow#10330)

feat(sdk): support local Container Component execution #localexecution (

846f887

kubeflow#10333) * support Container Components * address review feedback

No public description

14de087

PiperOrigin-RevId: 592702825

feat(components): Output errors as a separate table from Arbiter

a66c599

PiperOrigin-RevId: 592769441

docs(components): Fix AutoSxS docstring formatting

216d3f8

PiperOrigin-RevId: 594058915

chore(components): add json_escape placeholder util

973610b

PiperOrigin-RevId: 595174285

fix(sdk): fix presentation of strings in local execution #localexecut…

89d4234

…ion (kubeflow#10353)

fix(sdk): remove redundant newline character in local DockerRunner …

86b7e23

…logs (kubeflow#10354)

test(sdk): improve KFP SDK local runner test safety #localexecution (k…

dcab051

…ubeflow#10336)

feat(backend): Enable logging for KFP components (kubeflow#10288)

5399585

feat(sdk): remove local execution feature flag #localexecution (kubef…

8a5a17e

…low#10355)

fix(sdk): permit empty local execution outputs #localexecution (kubef…

64d46df

…low#10338)

feat(sdk): support Concat and IfPresent placeholder in local containe…

2897a10

…r component execution #localexecution (kubeflow#10348) * feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution * address review feedback * fix test

test(sdk): add test for local execution of None default parameter #…

ca5f97d

…localexecution (kubeflow#10339)