Skip to content
This repository has been archived by the owner on Jul 23, 2020. It is now read-only.

App deployments fail silently after quota is exhaused. #2897

Closed
jaseemabid opened this issue Apr 5, 2018 · 3 comments
Closed

App deployments fail silently after quota is exhaused. #2897

jaseemabid opened this issue Apr 5, 2018 · 3 comments

Comments

@jaseemabid
Copy link
Contributor

I've an openshift account that has already exhausted its quota and there are a few apps running in stage/prod envs. I can start a new build to deploy an app and Jenkins reports that the app deployment went fine while it failed with quota errors behind the scene. There are no errors in Jenkins logs. OSIO does not report any errors either. Openshift thankfully sheds light into the problem with the following error.

Error creating: pods "vertx1-5-" is forbidden: exceeded quota: compute-resources, requested: 
limits.cpu=1,limits.memory=512Mi, used: limits.cpu=2,limits.memory=1Gi, limited: 
limits.cpu=2,limits.memory=1Gi
27 times in the last 2 hours

We should either prevent the build from starting or report an error in the build that quota is exhausted. Also tell people what to do at that point.

This bug is related, but it talks more about the parallelism aspect rather than resource exhaustion. #2729

@jaseemabid jaseemabid changed the title Appl deployments fail silently after quota is exhaused. App deployments fail silently after quota is exhaused. Apr 5, 2018
@joshuawilson
Copy link
Member

@catrobson can you link to the design work you are planning regarding this.

@catrobson
Copy link
Collaborator

Designs are not final, but in progress designs can be seen here: https://redhat.invisionapp.com/share/BHGPNUXCR9A#/screens/287414528

@piyush-garg
Copy link
Collaborator

Duplicate of #3346 Can we close this? @jaseemabid

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

5 participants