Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide unified scalable deployment and benchmarking support for exam… #1315

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

bjzhjing
Copy link
Collaborator

Description

Provide an unified approach to scalable deployment of AI examples in a Kubernetes environment, along with benchmarking.

Issues

This is to fix #1260 .

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

Copy link

github-actions bot commented Dec 27, 2024

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

@bjzhjing bjzhjing force-pushed the unified-scalable-deployment branch from eb2087e to dee9960 Compare December 29, 2024 03:39
@chensuyue
Copy link
Collaborator

chensuyue commented Jan 2, 2025

The scripts looks good to me. But the benchmark folder here is not well adapt to the design philosophy of this Repo. We need to think about where and how to host those benchmark scripts.


# Pull and untar the chart
subprocess.run(["helm", "pull", chart_pull_url, "--untar"], check=True)

Copy link

@vrantala vrantala Jan 9, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When we are pulling the the chart, should we also add --version parameter to it?
$ helm pull oci://localhost:5000/helm-charts/mychart --version 0.1.0

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the comment, added the version support in new version.

@bjzhjing bjzhjing force-pushed the unified-scalable-deployment branch from 54c1ce8 to 29fbb2c Compare January 19, 2025 23:31
@bjzhjing bjzhjing requested a review from letonghan as a code owner January 19, 2025 23:31
@bjzhjing bjzhjing force-pushed the unified-scalable-deployment branch 2 times, most recently from 8867800 to c7715f4 Compare January 21, 2025 00:40
@bjzhjing bjzhjing force-pushed the unified-scalable-deployment branch from 35b3cdf to 67fe6db Compare January 21, 2025 00:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Enable helm-charts based benchmark scripts for more examples
4 participants