Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(ray): fix ray autoscaling #95

Merged
merged 1 commit into from
Jan 28, 2024
Merged

fix(ray): fix ray autoscaling #95

merged 1 commit into from
Jan 28, 2024

Conversation

heiruwu
Copy link
Member

@heiruwu heiruwu commented Jan 28, 2024

Because

  • application level autoscaling is not working due to wrong application name and deployment name
  • we can now apply more standard autoscaling configs

This commit

  • lower max concurrent queries
  • lower default number of max replicas
  • lower upscale factor
  • lower downscale delay
  • higher downscale factor

resolves ins-3133

Copy link

linear bot commented Jan 28, 2024

@heiruwu heiruwu changed the title fix(ray): update autoscaling configs fix(ray): fix autoscaling configs Jan 28, 2024
@heiruwu heiruwu changed the title fix(ray): fix autoscaling configs fix(ray): fix ray autoscaling Jan 28, 2024
@heiruwu heiruwu merged commit f0dfdd6 into main Jan 28, 2024
13 checks passed
@heiruwu heiruwu deleted the INS-3535 branch January 28, 2024 23:57
heiruwu added a commit that referenced this pull request Jan 29, 2024
Because

- application level autoscaling is not working due to wrong `application
name` and `deployment name`
- we can now apply more standard autoscaling configs

This commit

- lower max concurrent queries
- lower default number of max replicas
- lower upscale factor
- lower downscale delay
- higher downscale factor

resolves ins-3133
heiruwu pushed a commit that referenced this pull request Jan 30, 2024
🤖 I have created a release *beep* *boop*
---


##
[0.7.0](v0.6.0...v0.7.0)
(2024-01-30)


### Features

* **ray:** determine ram usage by file size
([#89](#89))
([7a0023d](7a0023d))
* **ray:** determine vram usage by file size
([#87](#87))
([71e84e6](71e84e6))


### Bug Fixes

* **ray:** add vram ceiling and override list
([#94](#94))
([5804e4a](5804e4a))
* **ray:** fix application name
([f2bb563](f2bb563))
* **ray:** fix gpu resource > 1
([#91](#91))
([b121f56](b121f56))
* **ray:** fix ray autoscaling
([#95](#95))
([5bd8c2a](5bd8c2a))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: 👋 Done
Development

Successfully merging this pull request may close these issues.

2 participants