Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extended.deploymentconfigs with custom deployments [Conformance] should run the custom deployment steps #9285

Closed
bparees opened this issue Jun 11, 2016 · 11 comments
Assignees
Labels
area/tests component/apps kind/test-flake Categorizes issue or PR as related to test flakes. priority/P2

Comments

@bparees
Copy link
Contributor

bparees commented Jun 11, 2016

• Failure [27.036 seconds]
deploymentconfigs
/data/src/github.com/openshift/origin/test/extended/deployments/deployments.go:309
  with custom deployments
  /data/src/github.com/openshift/origin/test/extended/deployments/deployments.go:211
    should run the custom deployment steps [Conformance] [It]
    /data/src/github.com/openshift/origin/test/extended/deployments/deployments.go:210

    Expected
        <string>: --> pre: Running hook pod ...
        test pre hook executed
        --> pre: Success
        --> Scaling custom-deployment-1 to 2
        --> Waiting up to 10m0s for pods in deployment custom-deployment-1 to become ready
        --> Reached 50%
        Halfway
        --> pre: Hook pod already succeeded
        --> Waiting up to 10m0s for pods in deployment custom-deployment-1 to become ready
    to contain substring
        <string>: Finished

    /data/src/github.com/openshift/origin/test/extended/deployments/deployments.go:205

as seen here: https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_conformance/1925/consoleFull

@smarterclayton
Copy link
Contributor

@stevekuznetsov is this a similar symptom to the Docker 1.10 hangs?

@stevekuznetsov
Copy link
Contributor

Node never becomes unresponsive, very unlikely it's the same cause.

@0xmichalis
Copy link
Contributor

One more instance in https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_conformance/5578/consoleFull

The deployment is successful which means the deployer pod was Complete.

apiVersion: v1
kind: ReplicationController
metadata:
  annotations:
    openshift.io/deployer-pod.name: custom-deployment-1-deploy
    openshift.io/deployment-config.latest-version: "1"
    openshift.io/deployment-config.name: custom-deployment
    openshift.io/deployment.phase: Complete

Not sure why we cannot get all the logs though...

@0xmichalis
Copy link
Contributor

Hm this is slightly different:

Expected
        <string>: --> pre: Running hook pod ...
        test pre hook executed
        --> pre: Success
        --> Scaling custom-deployment-1 to 2
        --> Waiting up to 10m0s for pods in deployment custom-deployment-1 to become ready
        --> Reached 50%
        Halfway
        --> pre: Hook pod already succeeded
        --> Waiting up to 10m0s for pods in deployment custom-deployment-1 to become ready
        --> Success
    to contain substring
        <string>: Finished

Finished should come before --> Success but it's somehow lost?

@smarterclayton
Copy link
Contributor

Very strange - race in pod log lookups?

On Thu, Aug 25, 2016 at 9:44 AM, Michail Kargakis [email protected]
wrote:

Hm this is slightly different:

Expected
: --> pre: Running hook pod ...
test pre hook executed
--> pre: Success
--> Scaling custom-deployment-1 to 2
--> Waiting up to 10m0s for pods in deployment custom-deployment-1 to become ready
--> Reached 50%
Halfway
--> pre: Hook pod already succeeded
--> Waiting up to 10m0s for pods in deployment custom-deployment-1 to become ready
--> Success
to contain substring
: Finished

Finished should come before --> Success but it's somehow lost?


You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
#9285 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABG_p3TLdnuCwYNMF2JwoqKofLMc4Ai_ks5qjZxAgaJpZM4IzcRC
.

@bparees bparees changed the title deploymentconfigs with custom deployments extended test flake Extended.deploymentconfigs with custom deployments [Conformance] should run the custom deployment steps Dec 7, 2016
@0xmichalis 0xmichalis assigned ncdc and unassigned 0xmichalis Dec 21, 2016
@ncdc
Copy link
Contributor

ncdc commented Dec 21, 2016

Possible fix: projectatomic/docker#218

@bparees
Copy link
Contributor Author

bparees commented Mar 13, 2017

@ncdc
Copy link
Contributor

ncdc commented May 22, 2017

This sure sounds like it might be journal rate limiting, maybe?

@ncdc
Copy link
Contributor

ncdc commented May 22, 2017

cc @soltysh

@soltysh
Copy link
Contributor

soltysh commented Jun 2, 2017

#12558 is still open and I'm still trying to figure it out. So there's a chance when I increase the limits in journal this will be solve along with it.

@liggitt liggitt unassigned ncdc Jun 5, 2017
@mfojtik
Copy link
Contributor

mfojtik commented Jul 12, 2017

Closing this due to age and that we have #14785, #14140, #13980 which basically tracks the same issue with journald rate limiting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/tests component/apps kind/test-flake Categorizes issue or PR as related to test flakes. priority/P2
Projects
None yet
Development

No branches or pull requests

8 participants