Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(ray): determine ram usage by file size #89

Merged
merged 3 commits into from
Jan 26, 2024
Merged

feat(ray): determine ram usage by file size #89

merged 3 commits into from
Jan 26, 2024

Conversation

heiruwu
Copy link
Member

@heiruwu heiruwu commented Jan 26, 2024

Because

  • we want to dynamically adjust the memory value for each model

This commit

  • determine ram usage by file size

@linear Linear
Copy link

linear bot commented Jan 26, 2024

INS-3529 add ram usage for cpu model

@heiruwu heiruwu merged commit 7a0023d into main Jan 26, 2024
7 checks passed
@heiruwu heiruwu deleted the INS-3529 branch January 26, 2024 11:16
@droplet-bot droplet-bot mentioned this pull request Jan 26, 2024
Merged
heiruwu pushed a commit that referenced this pull request Jan 30, 2024
@droplet-bot
chore(main): release 0.7.0 (#88)
e707952 
🤖 I have created a release *beep* *boop*
---


##
[0.7.0](v0.6.0...v0.7.0)
(2024-01-30)


### Features

* **ray:** determine ram usage by file size
([#89](#89))
([7a0023d](7a0023d))
* **ray:** determine vram usage by file size
([#87](#87))
([71e84e6](71e84e6))


### Bug Fixes

* **ray:** add vram ceiling and override list
([#94](#94))
([5804e4a](5804e4a))
* **ray:** fix application name
([f2bb563](f2bb563))
* **ray:** fix gpu resource > 1
([#91](#91))
([b121f56](b121f56))
* **ray:** fix ray autoscaling
([#95](#95))
([5bd8c2a](5bd8c2a))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
instill core
Projects
No open projects
🔮 Instill Core
Status: 👋 Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@heiruwu @droplet-bot