I1002 20:08:03.000002 1 static_autoscaler.go:138] Starting main loop I1002 20:08:03.121824 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:08:03.121846 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:08:03.122493 1 static_autoscaler.go:311] No schedulable pods I1002 20:08:03.122512 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:08:03.122623 1 scale_up.go:300] Upcoming 0 nodes I1002 20:08:03.122658 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:03.122676 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:08:03.122686 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:08:03.122703 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:03.122716 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:08:03.122731 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:03.122745 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:08:03.122762 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:03.122775 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:08:03.122792 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:03.122803 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:08:03.122810 1 scale_up.go:416] No expansion options I1002 20:08:03.122855 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:08:03.122953 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:08:03.123378 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:08:03.123399 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123406 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123416 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123422 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123429 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123433 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123439 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:03.123448 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:03.123457 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123466 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123475 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123480 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123490 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123501 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123509 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123515 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123523 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123533 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123543 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:03.123552 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:03.123561 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:03.123570 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:03.123582 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:08:03.123590 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:08:03.123600 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123605 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123615 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123625 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123634 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123644 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123655 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:08:03.123661 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:08:03.123671 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123681 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123691 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123699 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123709 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:08:03.123719 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:08:03.123729 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123740 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123750 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123757 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123772 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:08:03.123778 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:08:03.123794 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:08:03.123800 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:08:03.123812 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:03.123818 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:03.123834 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:08:03.123843 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:08:03.123855 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123865 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123875 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:03.123887 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:03.123899 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:03.123908 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:03.184684 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:08:13.201464 1 static_autoscaler.go:138] Starting main loop I1002 20:08:13.318762 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:08:13.318787 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:08:13.319344 1 static_autoscaler.go:311] No schedulable pods I1002 20:08:13.319362 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:08:13.319453 1 scale_up.go:300] Upcoming 0 nodes I1002 20:08:13.319486 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:13.319505 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:08:13.319519 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:08:13.319548 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:13.319563 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:08:13.319582 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:13.319597 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:08:13.319617 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:13.319630 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:08:13.319651 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:13.319664 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:08:13.319671 1 scale_up.go:416] No expansion options I1002 20:08:13.319713 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:08:13.319805 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:08:13.320217 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:08:13.320236 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320244 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320251 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320256 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320264 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:08:13.320271 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:08:13.320279 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:13.320283 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:13.320290 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:08:13.320295 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:08:13.320301 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320305 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320311 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320315 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320321 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:13.320327 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:13.320333 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:08:13.320339 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:08:13.320350 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320359 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320369 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320375 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320385 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:13.320391 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:13.320398 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320404 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320410 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320416 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320423 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320427 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320433 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320437 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320443 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320447 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320457 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320464 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320473 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:13.320477 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:13.320484 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:13.320490 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:13.320498 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:08:13.320502 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:08:13.320508 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320512 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320519 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320522 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320529 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320532 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320544 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:08:13.320551 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:08:13.320559 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320563 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320569 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:13.320576 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:13.320583 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:08:13.320587 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:08:13.321097 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:08:14.613389 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:280: Watch close - *v1.Node total 220 items received I1002 20:08:23.399721 1 static_autoscaler.go:138] Starting main loop I1002 20:08:23.487061 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:08:23.487090 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:08:23.584308 1 static_autoscaler.go:311] No schedulable pods I1002 20:08:23.584340 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:08:23.584499 1 scale_up.go:300] Upcoming 0 nodes I1002 20:08:23.584558 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:23.584583 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:08:23.584604 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:08:23.584631 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:23.584654 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:08:23.584680 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:23.584696 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:08:23.584720 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:23.584738 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:08:23.584762 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:23.584776 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:08:23.584785 1 scale_up.go:416] No expansion options I1002 20:08:23.584834 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:08:23.585991 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:08:23.586022 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586032 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586045 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:23.586062 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:23.586076 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:23.586084 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:23.586098 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:08:23.586108 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:08:23.586125 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586136 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586149 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586157 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586171 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586178 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586197 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:08:23.586205 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:08:23.586217 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586227 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586238 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586250 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586262 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:08:23.586272 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:08:23.586283 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586289 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586306 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586316 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586327 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:08:23.586339 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:08:23.586353 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:23.586367 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:23.586386 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:08:23.586394 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:08:23.586406 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586412 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586430 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586438 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586450 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:23.586458 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:23.586475 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:08:23.586526 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:08:23.586546 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586553 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586564 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586571 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586589 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:23.586594 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:23.586606 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586612 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586625 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586634 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586652 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586657 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586669 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586679 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.586693 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:23.586707 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:23.587813 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:08:23.684725 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:08:33.984636 1 static_autoscaler.go:138] Starting main loop I1002 20:08:34.192767 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:08:34.314506 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:09:34.314498034 +0000 UTC m=+11050.425811731 I1002 20:08:34.426478 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:08:34.426499 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:08:34.427068 1 static_autoscaler.go:311] No schedulable pods I1002 20:08:34.427085 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:08:34.427175 1 scale_up.go:300] Upcoming 0 nodes I1002 20:08:34.427209 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:34.427227 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:08:34.427240 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:08:34.427260 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:34.427273 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:08:34.427293 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:34.427306 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:08:34.427325 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:34.427338 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:08:34.427357 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:34.427370 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:08:34.427377 1 scale_up.go:416] No expansion options I1002 20:08:34.427415 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:08:34.427512 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:08:34.427907 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:08:34.427927 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.427937 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.427947 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:34.427954 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:34.427964 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:34.428006 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:34.428016 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:08:34.428022 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:08:34.428031 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428039 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428048 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428054 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428063 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428071 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428082 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:08:34.428089 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:08:34.428099 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428108 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428117 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428124 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428133 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:08:34.428140 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:08:34.428150 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428156 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428167 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428173 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428182 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:08:34.428193 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:08:34.428203 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:34.428210 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:34.428223 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:08:34.428229 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:08:34.428240 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428246 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428256 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428264 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428274 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:34.428280 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:34.428293 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:08:34.428300 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:08:34.428310 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428315 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428325 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428332 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428342 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:34.428350 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:34.428360 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428368 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428378 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428385 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428395 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428401 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428411 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428421 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428432 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:34.428440 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:34.428887 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:08:44.584043 1 static_autoscaler.go:138] Starting main loop I1002 20:08:44.716812 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:08:44.716836 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:08:44.717585 1 static_autoscaler.go:311] No schedulable pods I1002 20:08:44.717604 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:08:44.717708 1 scale_up.go:300] Upcoming 0 nodes I1002 20:08:44.717739 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:44.717752 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:08:44.717759 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:08:44.717772 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:44.717783 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:08:44.717797 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:44.717812 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:08:44.717839 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:44.717856 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:08:44.717873 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:44.717889 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:08:44.717896 1 scale_up.go:416] No expansion options I1002 20:08:44.717937 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:08:44.718029 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:08:44.718522 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:08:44.718546 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718557 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718566 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718573 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718588 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:08:44.718598 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:08:44.718608 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718617 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718627 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718636 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718646 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:08:44.718655 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:08:44.718665 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:44.718671 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:44.718682 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:08:44.718691 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:08:44.718701 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718712 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718721 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718731 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718741 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:44.718751 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:44.718761 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:08:44.718770 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:08:44.718779 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718785 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718798 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718807 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718819 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:44.718826 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:44.718835 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718845 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718854 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718864 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718874 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718883 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718893 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718903 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718912 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718922 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718931 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.718942 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.718951 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:44.718960 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:44.718970 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:44.718981 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:44.718991 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:08:44.719000 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:08:44.719009 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.719016 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.719028 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.719035 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.719044 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:44.719056 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:44.719067 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:08:44.719078 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:08:44.719475 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:08:45.115012 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:253: Watch close - *v1.Node total 325 items received I1002 20:08:47.133242 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:359: Watch close - *v1.StatefulSet total 0 items received I1002 20:08:54.884029 1 static_autoscaler.go:138] Starting main loop I1002 20:08:54.947163 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:08:54.947190 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:08:54.947917 1 static_autoscaler.go:311] No schedulable pods I1002 20:08:54.947937 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:08:54.948045 1 scale_up.go:300] Upcoming 0 nodes I1002 20:08:54.948070 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:54.948084 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:08:54.948094 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:08:54.948109 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:54.948119 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:08:54.948132 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:54.948140 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:08:54.948152 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:54.948159 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:08:54.948173 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:08:54.948185 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:08:54.948190 1 scale_up.go:416] No expansion options I1002 20:08:54.948228 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:08:54.948678 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:08:54.948808 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:08:54.948828 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948835 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948846 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948849 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948856 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948862 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948869 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948875 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948882 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:54.948888 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:54.948895 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948901 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948907 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948914 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948920 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948924 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948930 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948935 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948942 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:54.948949 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:54.948955 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:54.948959 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:54.948966 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:08:54.948973 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:08:54.948979 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948983 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.948989 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.948998 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949004 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949008 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949015 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:08:54.949023 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:08:54.949029 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949037 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949043 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949049 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949056 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:08:54.949060 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:08:54.949066 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949073 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949079 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949083 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949089 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:08:54.949097 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:08:54.949103 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:08:54.949107 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:08:54.949114 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:08:54.949120 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:08:54.949127 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:08:54.949134 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:08:54.949143 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:08:54.949149 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:08:54.949155 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949160 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949166 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:08:54.949171 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:08:54.949839 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:08:57.820369 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.ReplicaSet total 69 items received I1002 20:09:02.904214 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1beta1.PodDisruptionBudget total 0 items received I1002 20:09:04.992830 1 static_autoscaler.go:138] Starting main loop I1002 20:09:05.065515 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:09:05.065538 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:09:05.066168 1 static_autoscaler.go:311] No schedulable pods I1002 20:09:05.066185 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:09:05.066270 1 scale_up.go:300] Upcoming 0 nodes I1002 20:09:05.066298 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:05.066318 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:09:05.066329 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:09:05.066344 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:05.066355 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:09:05.066367 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:05.066379 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:09:05.066397 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:05.066407 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:09:05.066420 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:05.066432 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:09:05.066436 1 scale_up.go:416] No expansion options I1002 20:09:05.066477 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:09:05.066925 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:09:05.066943 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.066950 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.066957 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.066962 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.066967 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:09:05.066972 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:09:05.066978 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.066982 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.066988 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.066993 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.066999 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:09:05.067003 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:09:05.067009 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:05.067015 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:05.067023 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:09:05.067029 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:09:05.067037 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067049 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067056 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067059 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067065 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:05.067069 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:05.067076 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:09:05.067081 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:09:05.067086 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067093 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067102 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067113 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067123 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:05.067129 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:05.067138 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067145 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067154 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067161 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067169 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067177 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067186 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067194 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067202 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067209 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067220 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067226 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067236 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:05.067243 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:05.067253 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:05.067258 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:05.067266 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:09:05.067271 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:09:05.067282 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067287 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067293 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067297 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067304 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:05.067310 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:05.067319 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:09:05.067324 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:09:05.067747 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:09:05.084080 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:09:11.384080 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:215: Watch close - *v1.Pod total 101 items received I1002 20:09:15.099688 1 static_autoscaler.go:138] Starting main loop I1002 20:09:15.238959 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:09:15.238982 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:09:15.239554 1 static_autoscaler.go:311] No schedulable pods I1002 20:09:15.239570 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:09:15.239655 1 scale_up.go:300] Upcoming 0 nodes I1002 20:09:15.239686 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:15.239701 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:09:15.239713 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:09:15.239728 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:15.239735 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:09:15.239754 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:15.239767 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:09:15.239783 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:15.239793 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:09:15.239809 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:15.239821 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:09:15.239825 1 scale_up.go:416] No expansion options I1002 20:09:15.239863 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:09:15.239959 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 1 max limit reached, 5 node(s) didn't match node selector I1002 20:09:15.240372 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:09:15.240392 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:15.240402 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:15.240413 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:09:15.240420 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:09:15.240427 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240430 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240436 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240441 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240447 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:15.240451 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:15.240458 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:09:15.240461 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:09:15.240467 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240471 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240479 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240487 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240496 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:15.240504 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:15.240510 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240514 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240520 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240526 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240532 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240535 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240541 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240545 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240551 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240556 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240562 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240566 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240572 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:15.240579 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:15.240589 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:15.240594 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:15.240605 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:09:15.240611 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:09:15.240619 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240625 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240637 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240642 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240652 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240658 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240667 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:09:15.240673 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:09:15.240685 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240691 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240700 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240707 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240719 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:09:15.240726 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:09:15.240736 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240746 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240756 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:15.240763 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:15.240771 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:09:15.240778 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:09:15.241205 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:09:25.095520 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.PersistentVolumeClaim total 0 items received I1002 20:09:25.255356 1 static_autoscaler.go:138] Starting main loop I1002 20:09:25.328209 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:09:25.328232 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:09:25.328801 1 static_autoscaler.go:311] No schedulable pods I1002 20:09:25.328819 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:09:25.328901 1 scale_up.go:300] Upcoming 0 nodes I1002 20:09:25.328931 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:25.328948 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:09:25.328960 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:09:25.328977 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:25.328992 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:09:25.329014 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:25.329029 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:09:25.329049 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:25.329063 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:09:25.329083 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:25.329097 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:09:25.329104 1 scale_up.go:416] No expansion options I1002 20:09:25.329139 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:09:25.329575 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:09:25.329595 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329606 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329616 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329623 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329632 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:25.329643 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:25.329650 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329654 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329660 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329663 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329669 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329673 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329679 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329683 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329689 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329692 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329698 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329707 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329713 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:25.329721 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:25.329727 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:25.329731 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:25.329737 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:09:25.329744 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:09:25.329751 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329758 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329764 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329776 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329784 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329788 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329795 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.888750 I1002 20:09:25.329798 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.888750) I1002 20:09:25.329805 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329811 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329818 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329824 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329832 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:09:25.329843 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:09:25.329853 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329859 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329869 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329880 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329891 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:09:25.329901 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:09:25.329912 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:25.329921 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:25.329934 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:09:25.329943 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:09:25.329950 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329953 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329959 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:25.329964 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:25.329973 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:25.329986 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:25.330000 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:09:25.330007 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:09:25.330440 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:09:25.330741 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:09:35.345053 1 static_autoscaler.go:138] Starting main loop I1002 20:09:35.441487 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:09:35.528119 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:10:35.528112663 +0000 UTC m=+11111.639426313 I1002 20:09:35.595576 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:09:35.595597 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:09:35.596185 1 static_autoscaler.go:311] No schedulable pods I1002 20:09:35.596201 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:09:35.596281 1 scale_up.go:300] Upcoming 0 nodes I1002 20:09:35.596311 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:35.596328 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:09:35.596338 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:09:35.596360 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:35.596376 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:09:35.596395 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:35.596412 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:09:35.596425 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:35.596433 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:09:35.596447 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:35.596462 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:09:35.596468 1 scale_up.go:416] No expansion options I1002 20:09:35.596514 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:09:35.596611 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:09:35.596938 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:09:35.596957 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.596967 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.596976 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.596983 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.596990 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:35.596997 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:35.597003 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597007 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597012 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597016 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597022 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597026 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597031 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597035 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597044 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597054 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597062 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597068 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597074 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:35.597078 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:35.597083 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:35.597087 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:35.597094 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:09:35.597097 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:09:35.597103 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597107 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597113 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597118 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597125 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597136 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597147 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:09:35.597152 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:09:35.597158 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597165 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597171 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597175 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597181 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:09:35.597185 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:09:35.597191 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597194 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597200 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597204 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597210 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:09:35.597214 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:09:35.597225 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:35.597233 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:35.597243 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:09:35.597249 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:09:35.597258 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597266 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597272 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:35.597276 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:35.597282 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:35.597295 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:35.597303 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:09:35.597308 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:09:35.597674 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:09:39.526582 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:190: Watch close - *v1.Pod total 54 items received I1002 20:09:45.684043 1 static_autoscaler.go:138] Starting main loop I1002 20:09:45.754184 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:09:45.754208 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:09:45.754775 1 static_autoscaler.go:311] No schedulable pods I1002 20:09:45.754793 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:09:45.754877 1 scale_up.go:300] Upcoming 0 nodes I1002 20:09:45.754908 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:45.754929 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:09:45.754939 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:09:45.754952 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:45.754962 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:09:45.754973 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:45.754980 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:09:45.754991 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:45.755006 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:09:45.755028 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:45.755042 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:09:45.755050 1 scale_up.go:416] No expansion options I1002 20:09:45.755094 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:09:45.755154 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:09:45.755635 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:09:45.755654 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755661 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755667 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755671 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755677 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:09:45.755689 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:09:45.755695 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755699 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755704 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755710 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755716 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:09:45.755720 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:09:45.755728 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:09:45.755733 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:09:45.755742 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:45.755750 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:45.755759 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:09:45.755765 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:09:45.755774 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755780 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755789 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755794 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755800 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:45.755807 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:45.755813 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755817 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755823 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755829 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755837 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755841 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755851 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:45.755859 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:45.755869 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755873 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755879 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755885 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755891 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755895 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755901 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755905 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755912 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.755916 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.755926 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:45.755933 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:45.755943 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:45.755947 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:45.755954 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:09:45.755958 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:09:45.755964 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.784043 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.784074 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.784079 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.784110 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:45.784125 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:45.784148 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:09:45.784158 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:09:45.784800 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:09:49.584133 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.StorageClass total 0 items received I1002 20:09:55.884049 1 static_autoscaler.go:138] Starting main loop I1002 20:09:55.951851 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:09:55.951872 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:09:55.952487 1 static_autoscaler.go:311] No schedulable pods I1002 20:09:55.952504 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:09:55.952605 1 scale_up.go:300] Upcoming 0 nodes I1002 20:09:55.952633 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:55.952647 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:09:55.952661 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:09:55.952682 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:55.952695 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:09:55.952709 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:55.952721 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:09:55.952737 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:55.952748 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:09:55.952760 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:09:55.952774 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:09:55.952783 1 scale_up.go:416] No expansion options I1002 20:09:55.952820 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:09:55.952869 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 1 max limit reached, 5 node(s) didn't match node selector I1002 20:09:55.953298 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:09:55.953320 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:55.953330 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:55.953339 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:09:55.953343 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:09:55.953349 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953359 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953367 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953374 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953383 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:55.953392 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:55.953403 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:09:55.953412 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:09:55.953421 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953430 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953439 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953445 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953455 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:55.953466 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:55.953475 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953484 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953493 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953503 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953511 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953518 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953528 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953537 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953546 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953558 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953567 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953576 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953586 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:09:55.953595 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:09:55.953605 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:09:55.953614 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:09:55.953624 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:09:55.953633 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:09:55.953642 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953652 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953661 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953668 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953681 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953688 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953704 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:09:55.953712 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:09:55.953722 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953730 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953739 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953746 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953756 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:09:55.953763 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:09:55.953773 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953782 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953792 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:09:55.953803 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:09:55.953813 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:09:55.953820 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:09:55.954467 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:10:05.984340 1 static_autoscaler.go:138] Starting main loop I1002 20:10:06.118529 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:10:06.118553 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:10:06.119271 1 static_autoscaler.go:311] No schedulable pods I1002 20:10:06.119293 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:10:06.119391 1 scale_up.go:300] Upcoming 0 nodes I1002 20:10:06.119418 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:06.119434 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:10:06.119450 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:10:06.119468 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:06.119490 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:10:06.119515 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:06.119528 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:10:06.119551 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:06.119562 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:10:06.119576 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:06.119587 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:10:06.119597 1 scale_up.go:416] No expansion options I1002 20:10:06.119638 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:10:06.120129 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 1 max limit reached, 5 node(s) didn't match node selector I1002 20:10:06.120192 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:10:06.120217 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120229 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120239 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120245 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120255 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:10:06.120264 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:10:06.120274 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120280 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120294 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120303 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120313 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:10:06.120319 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:10:06.120328 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120339 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120349 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:06.120358 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:06.120370 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:10:06.120381 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:10:06.120396 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:06.120402 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:06.120414 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:10:06.120423 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:10:06.120434 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120443 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120453 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120459 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120470 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120483 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120496 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120505 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120514 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120521 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120532 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120538 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120548 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:06.120558 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:06.120568 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120577 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120587 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120593 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120605 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:06.120612 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:06.120626 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120635 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120645 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:06.120652 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:06.120663 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:06.120668 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:06.120678 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120684 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120694 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120704 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120714 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:06.120727 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:06.120742 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:10:06.120748 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:10:06.121305 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:10:16.184442 1 static_autoscaler.go:138] Starting main loop I1002 20:10:16.349800 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:10:16.349824 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:10:16.350533 1 static_autoscaler.go:311] No schedulable pods I1002 20:10:16.350556 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:10:16.350674 1 scale_up.go:300] Upcoming 0 nodes I1002 20:10:16.350711 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:16.350734 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:10:16.350745 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:10:16.350767 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:16.350782 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:10:16.350808 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:16.350825 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:10:16.350845 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:16.350856 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:10:16.350877 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:16.350889 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:10:16.350896 1 scale_up.go:416] No expansion options I1002 20:10:16.350945 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:10:16.351048 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 1 max limit reached, 5 node(s) didn't match node selector I1002 20:10:16.351705 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351726 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351738 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351744 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351755 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351761 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351774 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:10:16.351781 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:10:16.351792 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351803 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351813 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351819 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351831 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:10:16.351838 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:10:16.351849 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351859 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351870 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.351882 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.351893 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:10:16.351899 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:10:16.351914 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:10:16.351922 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:10:16.351933 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:16.351940 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:16.351955 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:10:16.351962 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:10:16.384024 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384058 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384074 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384078 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384091 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:16.384095 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:16.384108 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384114 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384127 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384133 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384146 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384153 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384167 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:16.384172 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:16.384185 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384192 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384204 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384211 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384224 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384228 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384241 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384246 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384268 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:16.384276 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:16.384290 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:16.384294 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:16.384310 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:16.384321 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:16.384339 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:16.384343 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:16.384358 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:16.384365 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:16.385057 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:10:21.188110 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.Node total 206 items received I1002 20:10:26.399849 1 static_autoscaler.go:138] Starting main loop I1002 20:10:26.554796 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:10:26.554819 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:10:26.555413 1 static_autoscaler.go:311] No schedulable pods I1002 20:10:26.555426 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:10:26.555530 1 scale_up.go:300] Upcoming 0 nodes I1002 20:10:26.555565 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:26.555584 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:10:26.555607 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:10:26.555624 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:26.555639 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:10:26.555662 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:26.555679 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:10:26.555701 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:26.555717 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:10:26.555741 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:26.555754 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:10:26.555762 1 scale_up.go:416] No expansion options I1002 20:10:26.555802 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:10:26.584034 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:10:26.584538 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584556 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584565 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584569 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584581 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:26.584590 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:26.584600 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584608 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584619 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:26.584628 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:26.584642 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:26.584647 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:26.584661 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:26.584672 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:26.584686 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584696 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584707 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584716 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584725 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584729 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584738 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:10:26.584742 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:10:26.584756 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584764 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584773 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584781 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584794 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:10:26.584809 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:10:26.584821 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584827 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584838 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584843 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584851 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:10:26.584857 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:10:26.584870 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:26.584876 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:26.584893 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:10:26.584899 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:10:26.584911 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584920 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584930 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584940 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.584948 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:26.584952 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:26.584967 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:10:26.584977 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:10:26.584988 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.584997 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.585008 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.585014 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.585028 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:26.585036 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:26.585047 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.585059 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.585070 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.585074 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.585083 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:26.585091 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:26.585616 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:10:36.599468 1 static_autoscaler.go:138] Starting main loop I1002 20:10:36.713887 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:10:36.793461 1 auto_scaling_groups.go:397] Instance group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M has only 0 instances created while requested count is 1. Creating placeholder instance with ID i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0. I1002 20:10:36.793903 1 auto_scaling_groups.go:106] Updating ASG eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:10:36.793969 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:11:36.793964352 +0000 UTC m=+11172.905278003 W1002 20:10:36.924744 1 clusterstate.go:558] Failed to get nodegroup for aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0: wrong id: expected format aws:////, got aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0 W1002 20:10:36.924782 1 clusterstate.go:593] Readiness for node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M not found I1002 20:10:36.924804 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:10:36.924858 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:10:36.924872 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:10:36.925614 1 static_autoscaler.go:311] No schedulable pods I1002 20:10:36.925632 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:10:36.925745 1 scale_up.go:300] Upcoming 1 nodes I1002 20:10:36.925771 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:36.925787 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:10:36.925796 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:10:36.925814 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:36.925824 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:10:36.925840 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:36.925851 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:10:36.925865 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:36.925874 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 W1002 20:10:36.925884 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:36.925889 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:36.925896 1 scale_up.go:322] Node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M is not ready for scaleup - unhealthy I1002 20:10:36.925903 1 scale_up.go:416] No expansion options I1002 20:10:36.925937 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:10:36.926444 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:10:36.926460 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:10:36.926469 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926473 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926479 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926483 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926491 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:10:36.926497 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:10:36.926506 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926515 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926523 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926530 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926540 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926546 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926555 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926563 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926570 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:36.926575 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:36.926582 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:10:36.926586 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:10:36.926592 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:36.926597 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:36.926605 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:10:36.926609 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:10:36.926616 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:36.926621 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:36.926630 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926638 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926646 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926650 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926656 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926660 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926666 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926670 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926676 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926680 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926687 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:36.926693 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:36.926699 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926703 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926712 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926717 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926725 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:36.926731 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:36.926739 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:36.926743 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:36.926749 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926754 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926761 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:36.926764 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:36.926770 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926774 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926782 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:10:36.926789 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:10:36.926801 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926807 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.926818 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:36.926824 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:36.927293 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false W1002 20:10:36.927345 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:36.927357 1 clusterstate.go:419] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:36.927362 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:10:36.927781 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 4 node(s) didn't match node selector, 1 max limit reached, 1 not ready for scale-up I1002 20:10:47.084035 1 static_autoscaler.go:138] Starting main loop W1002 20:10:47.149527 1 clusterstate.go:558] Failed to get nodegroup for aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0: wrong id: expected format aws:////, got aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0 W1002 20:10:47.149567 1 clusterstate.go:593] Readiness for node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M not found I1002 20:10:47.149592 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:10:47.149642 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:10:47.149653 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:10:47.150217 1 static_autoscaler.go:311] No schedulable pods I1002 20:10:47.150235 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:10:47.150326 1 scale_up.go:300] Upcoming 1 nodes I1002 20:10:47.150358 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:47.150374 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:10:47.150382 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:10:47.150393 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:47.150403 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:10:47.150422 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:47.150435 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:10:47.150448 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:47.150456 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 W1002 20:10:47.150465 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:47.150469 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:47.150477 1 scale_up.go:322] Node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M is not ready for scaleup - unhealthy I1002 20:10:47.150489 1 scale_up.go:416] No expansion options I1002 20:10:47.150526 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:10:47.150570 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 1 max limit reached, 1 not ready for scale-up, 4 node(s) didn't match node selector I1002 20:10:47.150991 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151007 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151014 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:47.151018 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:47.151023 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:47.151027 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:47.151037 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:47.151047 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:47.151055 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151060 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151068 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151078 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151087 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151094 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151104 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:10:47.151111 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:10:47.151120 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151130 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151139 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151147 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151157 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:10:47.151162 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:10:47.151177 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151182 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151190 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151199 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151208 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:10:47.151216 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:10:47.151230 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:47.151236 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:47.151249 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:10:47.151258 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:10:47.151268 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151277 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151286 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151293 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151304 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:47.151309 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:47.151324 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:10:47.151329 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:10:47.151340 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151347 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151357 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151366 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151377 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:47.151383 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:47.151393 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151403 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151414 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151423 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151434 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151440 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151450 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151459 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151474 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:47.151485 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:47.151499 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:47.151505 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:47.184405 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false W1002 20:10:47.184483 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:47.184498 1 clusterstate.go:419] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:47.184503 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:10:57.198842 1 static_autoscaler.go:138] Starting main loop W1002 20:10:57.285018 1 clusterstate.go:558] Failed to get nodegroup for aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0: wrong id: expected format aws:////, got aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0 W1002 20:10:57.285055 1 clusterstate.go:593] Readiness for node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M not found I1002 20:10:57.285079 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:10:57.285123 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:10:57.285134 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:10:57.285731 1 static_autoscaler.go:311] No schedulable pods I1002 20:10:57.285747 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:10:57.285846 1 scale_up.go:300] Upcoming 1 nodes I1002 20:10:57.285879 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:57.285897 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:10:57.285912 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:10:57.285931 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:57.285946 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:10:57.285969 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:57.285984 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:10:57.286006 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:10:57.286020 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 W1002 20:10:57.286030 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:57.286036 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:57.286046 1 scale_up.go:322] Node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M is not ready for scaleup - unhealthy I1002 20:10:57.286056 1 scale_up.go:416] No expansion options I1002 20:10:57.286097 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:10:57.286175 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 4 node(s) didn't match node selector, 1 max limit reached, 1 not ready for scale-up I1002 20:10:57.286600 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:57.286616 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:57.286625 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286631 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286641 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286650 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286660 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:57.286666 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:57.286675 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:10:57.286684 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:10:57.286693 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286699 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286708 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:57.286716 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:57.286726 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286732 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286742 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:10:57.286754 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:10:57.286764 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286774 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286780 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286787 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286793 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:10:57.286797 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:10:57.286803 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286806 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286812 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286822 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286831 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:10:57.286840 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:10:57.286849 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286858 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286868 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286875 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286885 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286890 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286899 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.286908 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.286918 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:57.286925 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:57.286936 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:10:57.286943 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:10:57.286953 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:10:57.286959 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:10:57.286970 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:10:57.286975 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:10:57.286986 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:10:57.286993 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:10:57.287001 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.287009 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.287019 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.287029 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.287040 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.287050 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.287059 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.287071 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.287083 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:10:57.287089 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:10:57.287493 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false W1002 20:10:57.287543 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:57.287555 1 clusterstate.go:419] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:10:57.287559 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:07.384030 1 static_autoscaler.go:138] Starting main loop W1002 20:11:07.454377 1 clusterstate.go:558] Failed to get nodegroup for aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0: wrong id: expected format aws:////, got aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0 W1002 20:11:07.454412 1 clusterstate.go:593] Readiness for node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M not found I1002 20:11:07.454432 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:11:07.454477 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:11:07.454485 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:11:07.455290 1 static_autoscaler.go:311] No schedulable pods I1002 20:11:07.455313 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:11:07.455438 1 scale_up.go:300] Upcoming 1 nodes I1002 20:11:07.455481 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:07.455505 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:11:07.455521 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:11:07.455546 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:07.455558 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:11:07.455580 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:07.455592 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:07.455610 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:07.455620 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 W1002 20:11:07.455625 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:07.455629 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:07.455635 1 scale_up.go:322] Node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M is not ready for scaleup - unhealthy I1002 20:11:07.455644 1 scale_up.go:416] No expansion options I1002 20:11:07.455680 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:11:07.484166 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 4 node(s) didn't match node selector, 1 not ready for scale-up, 1 max limit reached I1002 20:11:07.484276 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:11:07.484296 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:11:07.484308 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484321 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484334 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484342 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484355 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484361 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484374 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484388 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484402 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:07.484414 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:07.484426 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:11:07.484430 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:11:07.484445 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:07.484455 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:07.484468 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:11:07.484488 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:11:07.484512 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:07.484528 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:07.484545 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484552 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484562 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484571 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484582 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484586 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484595 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484607 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484619 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484626 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484640 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:07.484647 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:07.484658 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484663 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484673 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484693 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484705 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:07.484713 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:07.484728 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:07.484737 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:07.484749 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484754 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484762 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:07.484766 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:07.484775 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484785 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484799 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:11:07.484808 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:11:07.484819 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484829 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484840 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484848 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484860 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:11:07.484871 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:11:07.484884 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484895 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.484907 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:07.484916 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:07.485527 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false W1002 20:11:07.485577 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:07.485588 1 clusterstate.go:419] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:07.485592 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:17.584042 1 static_autoscaler.go:138] Starting main loop W1002 20:11:17.650333 1 clusterstate.go:558] Failed to get nodegroup for aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0: wrong id: expected format aws:////, got aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0 W1002 20:11:17.650365 1 clusterstate.go:593] Readiness for node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M not found I1002 20:11:17.650383 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:11:17.650431 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:11:17.650441 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:11:17.651009 1 static_autoscaler.go:311] No schedulable pods I1002 20:11:17.651024 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:11:17.651134 1 scale_up.go:300] Upcoming 1 nodes I1002 20:11:17.651162 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:17.651176 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:11:17.651186 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:11:17.651198 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:17.651216 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:11:17.651228 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:17.651248 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:17.651260 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:17.651271 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 W1002 20:11:17.651275 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:17.651281 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:17.651291 1 scale_up.go:322] Node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M is not ready for scaleup - unhealthy I1002 20:11:17.651297 1 scale_up.go:416] No expansion options I1002 20:11:17.651330 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:11:17.651414 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70803236", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 4 node(s) didn't match node selector, 1 max limit reached, 1 not ready for scale-up I1002 20:11:17.651958 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684051 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684090 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684100 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684118 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:11:17.684129 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:11:17.684146 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684156 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684172 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:17.684178 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:17.684202 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:11:17.684208 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:11:17.684227 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:17.684233 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:17.684258 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:11:17.684264 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:11:17.684280 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684290 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684306 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684313 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684330 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684336 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684352 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684358 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684373 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684379 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684393 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684402 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684420 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:17.684432 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:17.684448 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684458 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684473 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684483 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684504 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:17.684510 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:17.684531 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:17.684543 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:17.684558 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684568 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684584 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:17.684595 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:17.684612 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:17.684623 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:17.684639 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684645 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684660 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684670 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684686 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684693 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684711 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:11:17.684721 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:11:17.684738 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684749 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684765 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:17.684775 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:17.684791 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:11:17.684797 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:11:17.685635 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false W1002 20:11:17.685708 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:17.685722 1 clusterstate.go:419] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:17.685727 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:27.884616 1 static_autoscaler.go:138] Starting main loop W1002 20:11:28.018863 1 clusterstate.go:558] Failed to get nodegroup for aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0: wrong id: expected format aws:////, got aws:///us-west-2c/i-placeholder-eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M-0 W1002 20:11:28.018894 1 clusterstate.go:593] Readiness for node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M not found I1002 20:11:28.018918 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:11:28.018961 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:11:28.018970 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:11:28.019651 1 static_autoscaler.go:311] No schedulable pods I1002 20:11:28.019673 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:11:28.019791 1 scale_up.go:300] Upcoming 1 nodes I1002 20:11:28.019821 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:28.019838 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:11:28.019849 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:11:28.019870 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:28.019916 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:11:28.019935 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:28.019947 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:28.019960 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:28.019999 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 W1002 20:11:28.020010 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:28.020015 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:28.020026 1 scale_up.go:322] Node group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M is not ready for scaleup - unhealthy I1002 20:11:28.020033 1 scale_up.go:416] No expansion options I1002 20:11:28.020083 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:11:28.020117 1 utils.go:543] Skipping ip-10-42-166-59.us-west-2.compute.internal - no node group config I1002 20:11:28.020247 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70804590", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 4 node(s) didn't match node selector, 1 max limit reached, 1 not ready for scale-up I1002 20:11:28.020719 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020735 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020743 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020747 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020754 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:11:28.020767 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:11:28.020777 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020783 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020792 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020798 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020809 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:11:28.020816 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:11:28.020826 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020832 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020841 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020849 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020859 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:11:28.020867 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:11:28.020882 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:28.020888 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:28.020901 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:11:28.020910 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:11:28.020920 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020927 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020936 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.020946 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.020956 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:28.020965 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:28.020981 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:11:28.020991 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:11:28.021000 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021006 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021015 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021021 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021038 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:28.021043 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:28.021053 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021062 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021072 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021086 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021096 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021102 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021110 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021115 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021124 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021132 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021143 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:28.021147 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:28.021155 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021160 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021171 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:28.021182 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:28.021192 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:28.021201 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:28.021216 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:28.021220 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:28.021230 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:28.021240 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:28.021763 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false W1002 20:11:28.021810 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:28.021818 1 clusterstate.go:419] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M W1002 20:11:28.021827 1 clusterstate.go:362] Failed to find readiness information for eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:38.184018 1 static_autoscaler.go:138] Starting main loop I1002 20:11:38.262329 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:11:38.339301 1 auto_scaling_groups.go:106] Updating ASG eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:38.339415 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:12:38.339411689 +0000 UTC m=+11234.450725326 I1002 20:11:38.414087 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:11:38.414145 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:11:38.414153 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:11:38.414742 1 static_autoscaler.go:311] No schedulable pods I1002 20:11:38.414757 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:11:38.414861 1 scale_up.go:300] Upcoming 2 nodes I1002 20:11:38.414888 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:38.414903 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:11:38.414914 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:11:38.414926 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:38.414940 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:11:38.414956 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:38.414963 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:38.414975 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:38.414985 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:11:38.414996 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:38.415005 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:38.415009 1 scale_up.go:416] No expansion options I1002 20:11:38.415044 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:11:38.415069 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:11:38.415504 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415522 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415529 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415533 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415539 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:11:38.415543 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:11:38.415549 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415557 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415562 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415566 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415572 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:11:38.415581 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:11:38.415586 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:38.415597 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:38.415605 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:11:38.415613 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:11:38.415619 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:38.415624 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:38.415631 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:11:38.415635 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:11:38.415641 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415648 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415654 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415658 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415664 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415676 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415683 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415689 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415695 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415699 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415704 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415712 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415719 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:38.415722 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:38.415728 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415735 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415741 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415746 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415755 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415762 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415769 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:38.415773 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:38.415778 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415782 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415788 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:38.415792 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:38.415798 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:38.415802 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:38.415808 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:38.415812 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:38.415817 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415821 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415830 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415840 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415846 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:38.415851 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:38.415857 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:11:38.415865 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:11:38.416294 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:11:38.416824 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70804590", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:11:48.484035 1 static_autoscaler.go:138] Starting main loop I1002 20:11:48.551602 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:11:48.551664 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:11:48.551678 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:11:48.585421 1 static_autoscaler.go:311] No schedulable pods I1002 20:11:48.585447 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:11:48.585558 1 scale_up.go:300] Upcoming 2 nodes I1002 20:11:48.585585 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:48.585598 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:11:48.585607 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:11:48.585622 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:48.585636 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:11:48.585647 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:48.585656 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:48.585667 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:48.585682 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:11:48.585697 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:48.585705 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:48.585711 1 scale_up.go:416] No expansion options I1002 20:11:48.585752 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:11:48.585790 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:11:48.585787 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70804590", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:11:48.586361 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:48.586378 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:48.586388 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586394 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586404 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:48.586409 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:48.586420 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:48.586425 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:48.586435 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586443 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586454 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586463 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586473 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586483 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586496 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:11:48.586505 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:11:48.586517 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586529 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586540 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586549 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586560 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:11:48.586570 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:11:48.586581 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586586 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586597 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586602 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586613 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:11:48.586627 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:11:48.586637 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586647 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586658 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:48.586664 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:48.586678 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:11:48.586684 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:11:48.586696 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:48.586704 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:48.586720 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:11:48.586727 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:11:48.586738 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586747 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586758 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586763 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586774 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586780 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586793 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586804 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586814 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586823 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586843 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586848 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586859 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:48.586868 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:48.586879 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586889 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586905 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:48.586919 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:48.586932 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:48.586938 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:48.587486 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:11:58.602513 1 static_autoscaler.go:138] Starting main loop I1002 20:11:58.671530 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:11:58.671605 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:11:58.671617 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:11:58.684414 1 static_autoscaler.go:311] No schedulable pods I1002 20:11:58.684437 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 is unschedulable I1002 20:11:58.684548 1 scale_up.go:300] Upcoming 2 nodes I1002 20:11:58.684584 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:58.684605 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:11:58.684621 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:11:58.684640 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:58.684655 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:11:58.684674 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:58.684688 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:11:58.684708 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:58.684728 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:11:58.684747 1 utils.go:237] Pod str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25 can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:11:58.684763 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:11:58.684770 1 scale_up.go:416] No expansion options I1002 20:11:58.684832 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:11:58.684862 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570046860-579cb979f4-bgh25", UID:"4ce86b47-e550-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70804590", FieldPath:""}): type: 'Normal' reason: 'NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added): 5 node(s) didn't match node selector, 1 max limit reached I1002 20:11:58.684899 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:11:58.685545 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685563 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685570 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685574 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685585 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:58.685590 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:58.685601 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685611 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685621 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:58.685629 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:58.685642 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:58.685651 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:58.685665 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:11:58.685676 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:11:58.685686 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685690 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685697 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685712 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685726 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685731 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685744 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:11:58.685754 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:11:58.685766 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685776 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685784 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685790 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685800 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:11:58.685814 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:11:58.685826 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685836 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685847 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685855 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685867 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:11:58.685875 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:11:58.685888 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:11:58.685895 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:11:58.685909 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:11:58.685919 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:11:58.685934 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:11:58.685938 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:11:58.685950 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685957 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685967 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.685976 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.685987 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:58.685997 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:58.686010 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.686020 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.686033 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.686043 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.686055 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.686066 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.686079 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:11:58.686089 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:11:58.686097 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.686104 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.686112 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:11:58.686119 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:11:58.686647 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:12:08.784043 1 static_autoscaler.go:138] Starting main loop I1002 20:12:08.885013 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:12:08.885069 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:12:08.885077 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:12:08.885610 1 static_autoscaler.go:311] No schedulable pods I1002 20:12:08.885628 1 static_autoscaler.go:319] No unschedulable pods I1002 20:12:08.885638 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:12:08.885713 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:12:08.886194 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886210 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886217 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886221 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886227 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:08.886232 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:08.886240 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886247 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886256 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886265 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886274 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886281 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886290 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886296 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886305 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886315 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886327 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:08.886339 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:08.886349 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886359 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886368 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:08.886377 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:08.886385 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:08.886393 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:08.886400 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:08.886406 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:08.886415 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886427 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886438 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886444 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886454 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886461 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886468 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:12:08.886474 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:12:08.886486 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886490 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886500 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886506 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886513 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:12:08.886518 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:12:08.886527 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886534 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886544 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886551 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886560 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:12:08.886565 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:12:08.886576 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:08.886585 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:08.886597 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:12:08.886603 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:12:08.886612 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886620 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886629 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:08.886642 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:08.886657 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:08.886662 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:08.886674 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:12:08.886680 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:12:08.887304 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:12:15.820577 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:329: Watch close - *v1.ReplicationController total 0 items received I1002 20:12:18.902451 1 static_autoscaler.go:138] Starting main loop I1002 20:12:18.985168 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:12:18.985227 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:12:18.985236 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:12:18.985847 1 static_autoscaler.go:311] No schedulable pods I1002 20:12:18.985866 1 static_autoscaler.go:319] No unschedulable pods I1002 20:12:18.985877 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:12:18.985922 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:12:18.986401 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986415 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986423 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:18.986427 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:18.986435 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986442 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986451 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:18.986458 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:18.986468 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:18.986475 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:18.986485 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:18.986494 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:18.986504 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986514 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986524 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986533 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986543 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986552 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986568 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:12:18.986575 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:12:18.986586 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986592 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986601 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986609 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986620 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:12:18.986627 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:12:18.986638 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986648 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986658 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986664 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986675 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:12:18.986680 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:12:18.986690 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986698 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986707 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:12:18.986711 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:12:18.986722 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986729 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986738 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986745 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986755 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:18.986763 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:18.986775 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:12:18.986781 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:12:18.986792 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:18.986798 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:18.986808 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986813 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986825 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:18.986832 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:18.986842 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986848 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986858 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986868 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986879 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986887 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.986896 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:18.986901 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:18.987581 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:12:29.084081 1 static_autoscaler.go:138] Starting main loop I1002 20:12:29.122006 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:12:29.122059 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:12:29.122064 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:12:29.122635 1 static_autoscaler.go:311] No schedulable pods I1002 20:12:29.122652 1 static_autoscaler.go:319] No unschedulable pods I1002 20:12:29.122663 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:12:29.122735 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:12:29.123065 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:12:29.123081 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:12:29.123095 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123101 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123111 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123121 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123130 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123139 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123149 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123158 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123167 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:29.123176 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:29.123187 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:12:29.123196 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:12:29.123206 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:29.123215 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:29.123227 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:12:29.123237 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:12:29.123246 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:29.123253 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:29.123262 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123269 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123278 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123288 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123298 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123307 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123316 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123327 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123336 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123345 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123354 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:29.123361 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:29.123373 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123382 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123391 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123398 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123407 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:29.123413 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:29.123427 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:29.123434 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:29.123443 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123451 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123461 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:29.123471 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:29.123480 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123489 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123499 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:12:29.123509 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:12:29.123518 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123528 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123537 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123546 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123556 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:12:29.123568 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:12:29.123582 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123591 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.123600 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:29.123610 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:29.124036 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:12:39.139174 1 static_autoscaler.go:138] Starting main loop I1002 20:12:39.244848 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:12:39.382884 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:13:39.382876461 +0000 UTC m=+11295.494190153 I1002 20:12:39.416570 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:12:39.416622 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:12:39.416631 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:12:39.417168 1 static_autoscaler.go:311] No schedulable pods I1002 20:12:39.417183 1 static_autoscaler.go:319] No unschedulable pods I1002 20:12:39.417191 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:12:39.417256 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:12:39.417641 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417654 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417661 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417665 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417674 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:39.417683 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:39.417692 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:12:39.417702 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:12:39.417711 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:39.417716 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:39.417726 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:12:39.417737 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:12:39.417747 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:39.417757 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:39.417767 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417777 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417786 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417798 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417807 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417815 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417822 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417826 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417833 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417836 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417843 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:39.417853 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:39.417862 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417870 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417877 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417880 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417886 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:39.417893 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:39.417900 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:39.417910 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:39.417919 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417928 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417938 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:39.417947 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:39.417956 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417966 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.417977 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:12:39.417985 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:12:39.417995 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.417999 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.418009 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.418018 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.418028 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:12:39.418036 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:12:39.418047 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.418055 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.418065 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.418070 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.418079 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:12:39.418086 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:12:39.418096 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.418106 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.418116 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:39.418126 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:39.418736 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:12:41.119653 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:319: Watch close - *v1.DaemonSet total 6 items received I1002 20:12:41.687893 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:339: Watch close - *v1.Job total 0 items received I1002 20:12:49.433467 1 static_autoscaler.go:138] Starting main loop I1002 20:12:49.477459 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:12:49.477522 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:12:49.477534 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:12:49.478097 1 static_autoscaler.go:311] No schedulable pods I1002 20:12:49.478117 1 static_autoscaler.go:319] No unschedulable pods I1002 20:12:49.478129 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:12:49.478166 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:12:49.478775 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478803 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478815 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478821 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478833 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:12:49.478839 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:12:49.478849 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478861 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478870 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478876 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478886 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:12:49.478897 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:12:49.478908 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478919 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478929 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478940 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478951 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:12:49.478967 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:12:49.478977 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.478983 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.478997 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:12:49.479007 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:12:49.479017 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479027 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479037 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479047 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479056 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:49.479065 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:49.479086 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:12:49.479099 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:12:49.479110 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:49.479116 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:49.479126 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479138 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479148 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:49.479158 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:49.479168 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479173 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479184 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479194 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479205 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479210 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479220 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479230 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479240 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479245 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479257 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:49.479267 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:49.479277 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479283 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.479293 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:49.479298 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:49.479308 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:49.479322 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:49.479334 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:49.479346 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:49.479357 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:49.479367 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:49.480417 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:12:59.784048 1 static_autoscaler.go:138] Starting main loop I1002 20:12:59.819132 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:12:59.819193 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:12:59.819200 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:12:59.819808 1 static_autoscaler.go:311] No schedulable pods I1002 20:12:59.819826 1 static_autoscaler.go:319] No unschedulable pods I1002 20:12:59.819834 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:12:59.819880 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:12:59.820318 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820336 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820348 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820354 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820364 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:59.820373 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:59.820382 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820392 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820403 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:59.820412 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:59.820422 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:59.820432 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:59.820442 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:12:59.820448 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:12:59.820458 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820467 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820477 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820488 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820507 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820517 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820528 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:12:59.820534 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:12:59.820545 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820554 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820561 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820565 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820572 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:12:59.820578 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:12:59.820584 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820598 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820604 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820608 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820615 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:12:59.820629 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:12:59.820638 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:59.820646 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:59.820653 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:12:59.820657 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:12:59.820664 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:12:59.820670 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:12:59.820679 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:12:59.820684 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:12:59.820693 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820703 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820713 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820721 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820730 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820736 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820745 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820751 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820759 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820764 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820773 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820790 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.820803 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:12:59.820807 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:12:59.820814 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:12:59.820818 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:12:59.821225 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:13:09.874353 1 static_autoscaler.go:138] Starting main loop I1002 20:13:09.910885 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:13:09.910938 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:13:09.910944 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:13:09.911487 1 static_autoscaler.go:311] No schedulable pods I1002 20:13:09.911502 1 static_autoscaler.go:319] No unschedulable pods I1002 20:13:09.911510 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:13:09.911558 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:13:09.912031 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912051 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912065 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912071 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912082 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:09.912089 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:09.912099 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912105 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912115 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:09.912124 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:09.912133 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:13:09.912145 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:13:09.912155 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:09.912165 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:09.912174 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912180 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912189 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912200 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912209 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912220 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912231 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:13:09.912237 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:13:09.912247 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912253 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912262 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912270 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912280 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:13:09.912291 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:13:09.912300 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912310 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912319 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912330 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912339 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:13:09.912345 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:13:09.912355 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.913750 I1002 20:13:09.912363 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:13:09.912376 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:13:09.912384 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:13:09.912395 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912401 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912410 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912417 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912427 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:09.912433 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:09.912447 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:13:09.912455 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:13:09.912465 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912470 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912479 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912486 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912495 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:09.912500 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:09.912510 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912523 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912533 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912540 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.912554 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:09.912559 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:09.913020 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:13:19.928559 1 static_autoscaler.go:138] Starting main loop I1002 20:13:20.016550 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:13:20.016610 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:13:20.016621 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:13:20.017205 1 static_autoscaler.go:311] No schedulable pods I1002 20:13:20.017219 1 static_autoscaler.go:319] No unschedulable pods I1002 20:13:20.017227 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:13:20.017275 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:13:20.017728 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:20.017783 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:20.017815 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.017853 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.017884 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.017955 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.017975 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:13:20.017981 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:13:20.017993 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:20.018001 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:20.018012 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018018 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018028 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:20.018034 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:20.018044 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018049 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018060 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:13:20.018075 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:13:20.018086 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018091 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018101 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018110 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018118 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:13:20.018125 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:13:20.018134 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018143 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018152 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018162 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018169 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:13:20.018176 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:13:20.018184 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018190 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018198 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018204 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018214 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018220 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018229 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018232 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018240 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:20.018244 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:20.018253 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:13:20.018259 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:13:20.018267 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:13:20.018274 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:13:20.018284 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:13:20.018290 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:13:20.018302 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018310 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018318 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018325 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018333 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018339 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018348 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018358 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018366 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018375 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018384 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:20.018390 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:20.018874 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:13:21.704845 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.StatefulSet total 0 items received I1002 20:13:28.615503 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:280: Watch close - *v1.Node total 218 items received I1002 20:13:30.061283 1 static_autoscaler.go:138] Starting main loop I1002 20:13:30.185016 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:13:30.185076 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:13:30.185088 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:13:30.185605 1 static_autoscaler.go:311] No schedulable pods I1002 20:13:30.185617 1 static_autoscaler.go:319] No unschedulable pods I1002 20:13:30.185625 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:13:30.185661 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:13:30.186182 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:13:30.186216 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:13:30.186236 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:30.186243 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:30.186253 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186265 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186275 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:30.186281 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:30.186296 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186302 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186313 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:13:30.186325 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:13:30.186335 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186341 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186351 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186362 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186372 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:13:30.186380 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:13:30.186391 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186401 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186411 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186417 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186433 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:13:30.186442 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:13:30.186453 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186462 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186472 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186485 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186496 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186506 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186516 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186522 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186531 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:30.186541 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:30.186554 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:13:30.186563 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:13:30.186574 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:13:30.186580 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:13:30.186594 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:13:30.186603 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:13:30.186614 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186624 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186634 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186643 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186653 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186662 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186673 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186679 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186688 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186696 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186704 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186708 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186716 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:30.186729 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:30.186740 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186750 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.186760 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:30.186770 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:30.187425 1 static_autoscaler.go:393] Scale down status: unneededOnly=false lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:13:30.187461 1 static_autoscaler.go:403] Starting scale down I1002 20:13:30.187538 1 scale_down.go:706] No candidates for scale down I1002 20:13:40.234178 1 static_autoscaler.go:138] Starting main loop I1002 20:13:40.384528 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:13:40.585316 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:14:40.585307453 +0000 UTC m=+11356.696621145 I1002 20:13:40.692606 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:13:40.692660 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:13:40.692666 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:13:40.693156 1 static_autoscaler.go:311] No schedulable pods I1002 20:13:40.693168 1 static_autoscaler.go:319] No unschedulable pods I1002 20:13:40.693175 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:13:40.693198 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:13:40.693512 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693527 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693534 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:13:40.693538 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:13:40.693544 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693547 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693553 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693557 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693563 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:13:40.693570 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:13:40.693576 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693580 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693586 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693592 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693598 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:13:40.693605 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:13:40.693610 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693616 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693625 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693634 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693640 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693644 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693649 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693653 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693658 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:40.693662 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:40.693669 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:13:40.693674 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:13:40.693680 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:13:40.693684 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:13:40.693695 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:13:40.693705 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:13:40.693714 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693720 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693732 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693737 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693746 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693750 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693756 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693760 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693765 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693770 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693778 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693785 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693793 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:40.693796 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:40.693803 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693806 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693816 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693822 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693830 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:13:40.693834 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:13:40.693841 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:40.693849 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:40.693857 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:40.693867 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:40.693876 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:40.693885 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:40.694329 1 static_autoscaler.go:393] Scale down status: unneededOnly=false lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:13:40.694354 1 static_autoscaler.go:403] Starting scale down I1002 20:13:40.694408 1 scale_down.go:706] No candidates for scale down I1002 20:13:50.749950 1 static_autoscaler.go:138] Starting main loop I1002 20:13:50.785998 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:13:50.786065 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:13:50.786095 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:13:50.786676 1 static_autoscaler.go:311] No schedulable pods I1002 20:13:50.786694 1 static_autoscaler.go:319] No unschedulable pods I1002 20:13:50.786704 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:13:50.786781 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:13:50.787197 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:13:50.787213 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:13:50.787221 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787225 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787233 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787238 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787251 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787256 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787268 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787274 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787284 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:50.787291 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:50.787303 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:13:50.787314 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:13:50.787326 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:13:50.787334 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:13:50.787347 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:13:50.787358 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:13:50.787368 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787374 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787383 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787391 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787398 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787404 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787417 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787426 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787435 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787445 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787453 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787458 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787470 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:50.787480 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:50.787490 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787494 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787502 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787511 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787518 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:13:50.787524 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:13:50.787531 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:13:50.787538 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:13:50.787544 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787551 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787561 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:13:50.787572 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:13:50.787579 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787585 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787594 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:13:50.787598 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:13:50.787604 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787607 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787615 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787620 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.787629 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:13:50.787638 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:13:50.787644 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:13:50.787655 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:13:50.787665 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:13:50.787675 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:13:50.788138 1 static_autoscaler.go:393] Scale down status: unneededOnly=false lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:13:50.788160 1 static_autoscaler.go:403] Starting scale down I1002 20:13:50.788215 1 scale_down.go:706] No candidates for scale down I1002 20:13:52.436404 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:307: Watch close - *v1beta1.PodDisruptionBudget total 0 items received I1002 20:13:58.984085 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.ReplicationController total 0 items received I1002 20:14:00.884044 1 static_autoscaler.go:138] Starting main loop I1002 20:14:00.921855 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:14:00.921919 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:14:00.921930 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:14:00.922529 1 static_autoscaler.go:311] No schedulable pods I1002 20:14:00.922547 1 static_autoscaler.go:319] No unschedulable pods I1002 20:14:00.922559 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:14:00.922621 1 utils.go:552] Skipping ip-10-42-166-59.us-west-2.compute.internal - node group min size reached I1002 20:14:00.923054 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923073 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923083 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923088 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923103 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923115 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923124 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923134 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923143 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923154 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923162 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923172 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923184 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:00.923193 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:00.923204 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923213 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923223 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923236 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923245 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:14:00.923255 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:14:00.923267 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:00.923276 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:00.923286 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923296 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923306 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:00.923315 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:00.923324 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923336 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923348 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:14:00.923354 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:14:00.923364 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923373 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923383 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923394 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923403 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:14:00.923409 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:14:00.923419 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923424 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923434 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923439 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923449 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:14:00.923455 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:14:00.923464 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923472 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923482 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:00.923491 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:00.923500 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923508 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923515 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:00.923522 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:00.923528 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:00.923535 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:00.923544 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:14:00.923554 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:14:00.923562 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:14:00.923569 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:14:00.923584 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:14:00.923590 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:14:00.984158 1 static_autoscaler.go:393] Scale down status: unneededOnly=false lastScaleUpTime=2019-10-02 20:03:26.672535525 +0000 UTC m=+10682.783849173 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:14:00.984189 1 static_autoscaler.go:403] Starting scale down I1002 20:14:00.984257 1 scale_down.go:706] No candidates for scale down I1002 20:14:11.084017 1 static_autoscaler.go:138] Starting main loop I1002 20:14:11.117650 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:14:11.117707 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:14:11.117719 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:14:11.118334 1 static_autoscaler.go:311] No schedulable pods I1002 20:14:11.118350 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:14:11.118453 1 scale_up.go:300] Upcoming 1 nodes I1002 20:14:11.118481 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:11.118498 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:14:11.118512 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:14:11.118524 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:11.118541 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:14:11.118559 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:11.118574 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:14:11.118593 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:11.118604 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:14:11.118652 1 waste.go:57] Expanding Node Group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M would waste 93.75% CPU, 90.67% Memory, 92.21% Blended I1002 20:14:11.118671 1 scale_up.go:423] Best option to resize: eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:14:11.118678 1 scale_up.go:427] Estimated 1 nodes needed in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:14:11.118692 1 scale_up.go:529] Final scale-up plan: [{eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M 1->2 (max: 10)}] I1002 20:14:11.118714 1 scale_up.go:694] Scale-up: setting group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M size to 2 I1002 20:14:11.118748 1 auto_scaling_groups.go:211] Setting asg eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M size to 2 I1002 20:14:11.118905 1 factory.go:33] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"kube-system", Name:"cluster-autoscaler-status", UID:"452e7394-e3d1-11e9-8712-0a77671bf818", APIVersion:"v1", ResourceVersion:"70805955", FieldPath:""}): type: 'Normal' reason: 'ScaledUpGroup' Scale-up: setting group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M size to 2 I1002 20:14:11.314441 1 factory.go:33] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"kube-system", Name:"cluster-autoscaler-status", UID:"452e7394-e3d1-11e9-8712-0a77671bf818", APIVersion:"v1", ResourceVersion:"70805955", FieldPath:""}): type: 'Normal' reason: 'ScaledUpGroup' Scale-up: group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M size set to 2 I1002 20:14:11.314467 1 factory.go:33] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk", UID:"2ed03a19-e551-11e9-9cf1-06e28602110a", APIVersion:"v1", ResourceVersion:"70805982", FieldPath:""}): type: 'Normal' reason: 'TriggeredScaleUp' pod triggered scale-up: [{eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M 1->2 (max: 10)}] I1002 20:14:17.622997 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.PersistentVolume total 0 items received I1002 20:14:21.328836 1 static_autoscaler.go:138] Starting main loop I1002 20:14:21.423225 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:14:21.423279 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:14:21.423286 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:14:21.424020 1 static_autoscaler.go:311] No schedulable pods I1002 20:14:21.424041 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:14:21.424183 1 scale_up.go:300] Upcoming 2 nodes I1002 20:14:21.424220 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:21.424238 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:14:21.424249 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:14:21.424268 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:21.424283 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:14:21.424301 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:21.424315 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:14:21.424333 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:21.424346 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:14:21.424401 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:14:21.424415 1 scale_up.go:416] No expansion options I1002 20:14:21.424429 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:14:21.424960 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.424975 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.424982 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:21.424986 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:21.424995 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425000 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425006 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:21.425010 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:21.425016 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:14:21.425021 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:14:21.425030 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:21.425035 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:21.425043 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425049 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425057 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425063 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425073 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425087 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425098 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:14:21.425108 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:14:21.425118 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425130 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425141 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425151 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425161 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:14:21.425172 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:14:21.425183 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:14:21.425191 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:14:21.425203 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425207 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425213 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425217 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425224 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:14:21.425227 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:14:21.425234 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425239 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425250 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:14:21.425259 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:14:21.425267 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425273 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425280 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425287 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425293 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:21.425296 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:21.425304 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:14:21.425312 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:14:21.425323 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:14:21.425332 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:14:21.425338 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425341 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425348 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425353 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425360 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425368 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425374 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425379 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425386 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:21.425391 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:21.425400 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:21.425409 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:21.425851 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:14:28.135278 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:359: Watch close - *v1.StatefulSet total 0 items received I1002 20:14:29.790293 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.Service total 0 items received I1002 20:14:31.484029 1 static_autoscaler.go:138] Starting main loop I1002 20:14:31.558295 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:14:31.558351 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:14:31.558360 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:14:31.558979 1 static_autoscaler.go:311] No schedulable pods I1002 20:14:31.558994 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:14:31.559109 1 scale_up.go:300] Upcoming 2 nodes I1002 20:14:31.559137 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:31.559149 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:14:31.559160 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:14:31.559175 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:31.559190 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:14:31.559215 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:31.559229 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:14:31.559246 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:31.559257 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:14:31.559307 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:14:31.559318 1 scale_up.go:416] No expansion options I1002 20:14:31.559331 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:14:31.559813 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.559833 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.559843 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.559848 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.559857 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:14:31.559865 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:14:31.559877 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:14:31.559886 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:14:31.559895 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.559900 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.559909 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.559919 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.559929 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:14:31.559935 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:14:31.559945 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:14:31.559955 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:14:31.560008 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:14:31.560021 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:14:31.560031 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.560041 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.560051 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.560057 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.560067 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:31.560072 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:31.560085 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:14:31.560095 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:14:31.560105 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.560114 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.560124 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.560133 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.560145 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560154 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560165 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560175 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560187 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560196 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560207 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560216 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560228 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560238 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560249 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560257 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560270 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:31.560275 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:31.560286 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560293 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560304 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:31.560311 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:31.560323 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:14:31.560330 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:14:31.560343 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:31.560354 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:31.560365 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.560377 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.560387 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:31.560394 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:31.560404 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:31.560415 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:31.560429 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:14:31.560435 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:14:31.560914 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:14:33.901144 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.Pod total 180 items received I1002 20:14:41.592731 1 static_autoscaler.go:138] Starting main loop I1002 20:14:41.801459 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:14:41.874287 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:15:41.874281487 +0000 UTC m=+11417.985595134 I1002 20:14:41.928313 1 static_autoscaler.go:206] 2 unregistered nodes present I1002 20:14:41.928370 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:14:41.928378 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:14:41.929014 1 static_autoscaler.go:311] No schedulable pods I1002 20:14:41.929033 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:14:41.929142 1 scale_up.go:300] Upcoming 2 nodes I1002 20:14:41.929171 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:41.929187 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:14:41.929196 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:14:41.929213 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:41.929226 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:14:41.929244 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:41.929258 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:14:41.929275 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:41.929288 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:14:41.929338 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:14:41.929348 1 scale_up.go:416] No expansion options I1002 20:14:41.929359 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:14:41.929858 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.929873 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.929880 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:41.929884 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:41.929890 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.929900 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.929908 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:41.929917 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:41.929926 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:14:41.929934 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:14:41.929942 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:41.929947 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:41.929955 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.929960 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.929968 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.929978 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.929985 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.929993 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930005 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:14:41.930009 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:14:41.930017 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930026 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930033 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.930038 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930047 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:14:41.930053 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:14:41.930065 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:14:41.930074 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:14:41.930083 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930093 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930103 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.930112 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930119 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:14:41.930123 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:14:41.930128 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930132 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930142 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:14:41.930151 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:14:41.930159 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930168 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930177 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930184 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930193 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:41.930203 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:41.930216 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:14:41.930222 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:14:41.930232 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:14:41.930243 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:14:41.930252 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930258 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930266 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.930277 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930285 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.930293 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930305 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.930311 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930320 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:41.930327 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:41.930335 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:41.930340 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:41.930911 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:14:49.906245 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1beta1.PodDisruptionBudget total 0 items received I1002 20:14:51.984055 1 static_autoscaler.go:138] Starting main loop I1002 20:14:52.073305 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:14:52.073370 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:14:52.073382 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:14:52.074013 1 static_autoscaler.go:311] No schedulable pods I1002 20:14:52.074031 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:14:52.074147 1 scale_up.go:300] Upcoming 2 nodes I1002 20:14:52.074175 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:52.074192 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:14:52.074203 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:14:52.074222 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:52.074239 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:14:52.074260 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:52.074271 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:14:52.074289 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:14:52.074303 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:14:52.074351 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:14:52.074361 1 scale_up.go:416] No expansion options I1002 20:14:52.074376 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:14:52.074937 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:14:52.074953 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:14:52.074963 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.074969 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.074978 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.074987 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.074997 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:14:52.075007 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:14:52.075019 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:14:52.075028 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:14:52.075037 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075048 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075057 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075063 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075072 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:14:52.075082 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:14:52.075091 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075100 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075111 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075120 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075129 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075139 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075146 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075150 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075156 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:52.075160 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:52.075170 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:14:52.075177 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:14:52.075182 1 scale_down.go:410] Node ip-10-42-188-61.us-west-2.compute.internal - utilization 0.013750 I1002 20:14:52.075189 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:14:52.075193 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:14:52.075205 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:14:52.075217 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:14:52.075227 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075236 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075246 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075250 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075257 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075260 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075267 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075271 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075276 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075280 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075286 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075290 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075297 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:52.075301 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:52.075307 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075313 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075326 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075330 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075337 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:14:52.075350 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:14:52.075358 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:14:52.075364 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:14:52.075373 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:14:52.075379 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:14:52.075390 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:14:52.075400 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:14:52.075410 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:14:52.075416 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:14:52.075900 1 static_autoscaler.go:382] ip-10-42-188-61.us-west-2.compute.internal is unneeded since 2019-10-02 20:14:51.984016616 +0000 UTC m=+11368.095330264 duration 0s I1002 20:14:52.075914 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:15:02.100433 1 static_autoscaler.go:138] Starting main loop I1002 20:15:02.145935 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:15:02.145988 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:15:02.145999 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:15:02.146553 1 static_autoscaler.go:311] No schedulable pods I1002 20:15:02.146568 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:15:02.146654 1 scale_up.go:300] Upcoming 2 nodes I1002 20:15:02.146677 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:02.146691 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:15:02.146701 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:15:02.146715 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:02.146726 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:15:02.146736 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:02.146747 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:15:02.146757 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:02.146772 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:15:02.146821 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:15:02.146833 1 scale_up.go:416] No expansion options I1002 20:15:02.146847 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:15:02.147408 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147427 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147437 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147443 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147452 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:15:02.147461 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:15:02.147469 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147475 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147484 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:02.147492 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:02.147503 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:15:02.147509 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:15:02.147516 1 scale_down.go:410] Node ip-10-42-188-61.us-west-2.compute.internal - utilization 0.013750 I1002 20:15:02.147527 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:15:02.147535 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:15:02.147549 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:15:02.147560 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:15:02.147570 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147576 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147586 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147595 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147606 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147615 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147626 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147636 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147645 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147657 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147667 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147674 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147684 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147693 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147703 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147713 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147724 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147734 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147747 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:02.147757 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:02.147770 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:02.147777 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:02.147788 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147795 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147807 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:02.147813 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:02.147825 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:15:02.147837 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:15:02.147848 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147857 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147867 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147872 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.147883 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.147892 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.147904 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:15:02.147917 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:15:02.147936 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:15:02.147948 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:15:02.147962 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:02.147995 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:02.148007 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:02.148014 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:02.148024 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:15:02.148033 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:15:02.148524 1 static_autoscaler.go:382] ip-10-42-188-61.us-west-2.compute.internal is unneeded since 2019-10-02 20:14:51.984016616 +0000 UTC m=+11368.095330264 duration 10.116398904s I1002 20:15:02.148541 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:15:12.184015 1 static_autoscaler.go:138] Starting main loop I1002 20:15:12.219419 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:15:12.219487 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:15:12.219496 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:15:12.220187 1 static_autoscaler.go:311] No schedulable pods I1002 20:15:12.220204 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:15:12.220315 1 scale_up.go:300] Upcoming 2 nodes I1002 20:15:12.220344 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:12.220359 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:15:12.220370 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:15:12.220392 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:12.220408 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:15:12.220426 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:12.220440 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:15:12.220456 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:12.220468 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:15:12.220510 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:15:12.220520 1 scale_up.go:416] No expansion options I1002 20:15:12.220533 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:15:12.222529 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:15:12.222552 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:15:12.222567 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:15:12.222573 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:15:12.222588 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.222595 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.222603 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.222609 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.222620 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:15:12.222630 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:15:12.222641 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.222647 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.222661 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.222668 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.222678 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.222689 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.222697 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.222706 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.222719 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:12.222725 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:12.222743 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:15:12.222751 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:15:12.222759 1 scale_down.go:410] Node ip-10-42-188-61.us-west-2.compute.internal - utilization 0.013750 I1002 20:15:12.222777 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:15:12.222784 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:15:12.222805 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:15:12.222818 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:15:12.222830 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.222836 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.222843 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.222855 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.222920 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.222939 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.222948 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.222952 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.222981 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.222988 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.223005 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.223012 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.223035 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:12.223056 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:12.223082 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.223090 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.223101 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.223108 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.223118 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:15:12.223126 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:15:12.223136 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:12.223141 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:12.223149 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.223153 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.223165 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:12.223293 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:12.223306 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.223313 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.223327 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:15:12.223334 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:15:12.223342 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:12.223346 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:12.223353 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:12.223360 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:12.285939 1 static_autoscaler.go:382] ip-10-42-188-61.us-west-2.compute.internal is unneeded since 2019-10-02 20:14:51.984016616 +0000 UTC m=+11368.095330264 duration 20.199977918s I1002 20:15:12.285966 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:15:22.689964 1 static_autoscaler.go:138] Starting main loop I1002 20:15:22.722866 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:15:22.722941 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:15:22.722958 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:15:22.723741 1 static_autoscaler.go:311] No schedulable pods I1002 20:15:22.723767 1 scale_up.go:263] Pod default/str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk is unschedulable I1002 20:15:22.723891 1 scale_up.go:300] Upcoming 2 nodes I1002 20:15:22.723928 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:22.723950 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH I1002 20:15:22.723963 1 scale_up.go:338] Skipping node group eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T - max size reached I1002 20:15:22.724046 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:22.724063 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M I1002 20:15:22.724108 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:22.724123 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA I1002 20:15:22.724145 1 utils.go:237] Pod str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk can't be scheduled on eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45, predicate failed: GeneralPredicates predicate mismatch, reason: node(s) didn't match node selector I1002 20:15:22.724161 1 scale_up.go:411] No pod can fit to eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 I1002 20:15:22.724207 1 scale_up.go:408] No need for any nodes in eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M I1002 20:15:22.724216 1 scale_up.go:416] No expansion options I1002 20:15:22.724227 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:15:22.724748 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.724769 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.724780 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.724786 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.724802 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:15:22.724812 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:15:22.724822 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.724832 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.724843 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.724853 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.724864 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:15:22.724873 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:15:22.724887 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:15:22.724896 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:15:22.724907 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.724913 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.724923 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.724937 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.724949 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:15:22.724955 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:15:22.724968 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:15:22.724976 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:15:22.724992 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:15:22.725003 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:15:22.725014 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.725022 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.725032 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.725041 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.725054 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:22.725063 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:22.725078 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:15:22.725084 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:15:22.725097 1 scale_down.go:410] Node ip-10-42-188-61.us-west-2.compute.internal - utilization 0.013750 I1002 20:15:22.725108 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.725117 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.725128 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.725138 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.725150 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725160 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725171 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725183 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725195 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725202 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725213 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725220 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725232 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725242 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725253 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725263 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725276 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:22.725283 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:22.725294 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:22.725307 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:22.725319 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:22.725330 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:22.725348 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:15:22.725355 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:15:22.725369 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:22.725379 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:22.725390 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:22.725400 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:22.726079 1 static_autoscaler.go:382] ip-10-42-188-61.us-west-2.compute.internal is unneeded since 2019-10-02 20:14:51.984016616 +0000 UTC m=+11368.095330264 duration 30.705927604s I1002 20:15:22.726097 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:15:32.784346 1 static_autoscaler.go:138] Starting main loop I1002 20:15:32.816407 1 clusterstate.go:225] Scale up in group eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M finished successfully in 1m21.47017124s I1002 20:15:32.816450 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:15:32.816489 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:15:32.816497 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:15:32.816985 1 static_autoscaler.go:311] No schedulable pods I1002 20:15:32.816999 1 static_autoscaler.go:319] No unschedulable pods I1002 20:15:32.817006 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:15:32.817377 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817390 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817399 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817404 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817412 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:15:32.817422 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:15:32.817431 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:15:32.817441 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:15:32.817448 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817453 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817462 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817471 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817479 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:15:32.817485 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:15:32.817495 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:15:32.817504 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:15:32.817510 1 scale_down.go:410] Node ip-10-42-188-61.us-west-2.compute.internal - utilization 0.095945 I1002 20:15:32.817523 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:15:32.817533 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:15:32.817544 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:15:32.817550 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:15:32.817558 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817568 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817577 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817586 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817596 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:32.817634 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:32.817651 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817659 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817668 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817689 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817702 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817712 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817722 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817731 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817742 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817751 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817762 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817770 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817780 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817789 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817800 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817808 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817820 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:32.817829 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:32.817840 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817847 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817858 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:32.817865 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:32.817877 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:15:32.817889 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:15:32.817904 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:32.817915 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:32.817928 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817940 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817950 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:32.817958 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:32.817969 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:32.817978 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:32.817989 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:15:32.817998 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:15:32.818411 1 cluster.go:90] Fast evaluation: ip-10-42-188-61.us-west-2.compute.internal for removal I1002 20:15:32.818427 1 cluster.go:104] Fast evaluation: node ip-10-42-188-61.us-west-2.compute.internal cannot be removed: pod annotated as not safe to evict present: str-debug-pod-mgalgs-1570047238-768f46c7f4-vcdhk I1002 20:15:32.818437 1 scale_down.go:496] 1 nodes found to be unremovable in simulation, will re-check them at 2019-10-02 20:20:32.784319765 +0000 UTC m=+11708.895633469 I1002 20:15:32.818461 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:15:42.884441 1 static_autoscaler.go:138] Starting main loop I1002 20:15:43.086108 1 auto_scaling_groups.go:344] Regenerating instance to ASG map for ASGs: [eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-26747XTQO6YH eksctl-streks3-nodegroup-ng-2a-ami-038a987c6425a84ad-spotty-v1-NodeGroup-1ROTHM2PJJC3T eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1QSTLYBF1CJ5M eksctl-streks3-nodegroup-ng-2b-ami-038a987c6425a84ad-spotty-v1-NodeGroup-GK80456OQZIA eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-m5-2xlarge-NodeGroup-1HAI8RHKZ1X45 eksctl-streks3-nodegroup-ng-2c-ami-038a987c6425a84ad-spotty-v1-NodeGroup-S9U82ABUOL3M] I1002 20:15:43.148383 1 aws_manager.go:255] Refreshed ASG list, next refresh after 2019-10-02 20:16:43.148375902 +0000 UTC m=+11479.259689561 I1002 20:15:43.185059 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:15:43.185129 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:15:43.185141 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:15:43.185711 1 static_autoscaler.go:311] No schedulable pods I1002 20:15:43.185728 1 static_autoscaler.go:319] No unschedulable pods I1002 20:15:43.185737 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:15:43.186219 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:15:43.186242 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186250 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186257 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186260 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186269 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:15:43.186274 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:15:43.186284 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:15:43.186290 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:15:43.186299 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186320 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186333 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186339 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186378 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:15:43.186389 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:15:43.186397 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:15:43.186403 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:15:43.186420 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:15:43.186426 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:15:43.186436 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186442 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186450 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186456 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186465 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:43.186471 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:43.186483 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:15:43.186495 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:15:43.186504 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186512 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186520 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186530 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186537 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186541 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186551 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186560 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186566 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186570 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186577 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186582 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186588 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186592 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186599 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186608 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186620 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:43.186626 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:43.186636 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186642 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186653 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:43.186660 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:43.186672 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:15:43.186678 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:15:43.186691 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:43.186702 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:43.186712 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186722 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186731 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:43.186740 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:43.186751 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:43.186757 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:43.186770 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:15:43.186776 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:15:43.187436 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:15:48.793851 1 reflector.go:370] k8s.io/autoscaler/cluster-autoscaler/utils/kubernetes/listers.go:349: Watch close - *v1.ReplicaSet total 71 items received I1002 20:15:53.284023 1 static_autoscaler.go:138] Starting main loop I1002 20:15:53.324345 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:15:53.324397 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:15:53.324407 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:15:53.324971 1 static_autoscaler.go:311] No schedulable pods I1002 20:15:53.324990 1 static_autoscaler.go:319] No unschedulable pods I1002 20:15:53.325008 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:15:53.325675 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:15:53.325702 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325712 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325721 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.325727 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.325736 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.325746 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.325756 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325765 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325775 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325784 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325794 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325803 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325813 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325819 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325829 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325839 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325851 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:53.325859 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:53.325872 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325878 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.325888 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:53.325895 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:53.325904 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:15:53.325913 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:15:53.325925 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:15:53.325934 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:15:53.325945 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.325956 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.325968 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.325974 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.325984 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.325993 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.326004 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:15:53.326012 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:15:53.326023 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.326032 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.326041 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.326050 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.326060 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:15:53.326069 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:15:53.326081 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:15:53.326092 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:15:53.326101 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.326111 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.326121 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:15:53.326132 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:15:53.326142 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:15:53.326151 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:15:53.326163 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:15:53.326169 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:15:53.326179 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:15:53.326184 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:15:53.326197 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:15:53.326207 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:15:53.326216 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.326225 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.326234 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:15:53.326274 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:15:53.326291 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:15:53.326298 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:15:53.326952 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:16:03.346850 1 static_autoscaler.go:138] Starting main loop I1002 20:16:03.384471 1 static_autoscaler.go:206] 1 unregistered nodes present I1002 20:16:03.384551 1 utils.go:595] No pod using affinity / antiaffinity found in cluster, disabling affinity predicate for this loop I1002 20:16:03.384566 1 static_autoscaler.go:294] Filtering out schedulables I1002 20:16:03.385292 1 static_autoscaler.go:311] No schedulable pods I1002 20:16:03.385313 1 static_autoscaler.go:319] No unschedulable pods I1002 20:16:03.385324 1 static_autoscaler.go:366] Calculating unneeded nodes I1002 20:16:03.386013 1 scale_down.go:379] Scale-down calculation: ignoring 1 nodes unremovable in the last 5m0s I1002 20:16:03.386043 1 scale_down.go:410] Node ip-10-42-119-149.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386053 1 scale_down.go:414] Node ip-10-42-119-149.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386066 1 scale_down.go:410] Node ip-10-42-163-14.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386076 1 scale_down.go:414] Node ip-10-42-163-14.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386085 1 scale_down.go:410] Node ip-10-42-157-26.us-west-2.compute.internal - utilization 0.876250 I1002 20:16:03.386094 1 scale_down.go:414] Node ip-10-42-157-26.us-west-2.compute.internal is not suitable for removal - utilization too big (0.876250) I1002 20:16:03.386104 1 scale_down.go:410] Node ip-10-42-103-194.us-west-2.compute.internal - utilization 0.976250 I1002 20:16:03.386113 1 scale_down.go:414] Node ip-10-42-103-194.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:16:03.386125 1 scale_down.go:410] Node ip-10-42-116-152.us-west-2.compute.internal - utilization 0.935532 I1002 20:16:03.386134 1 scale_down.go:414] Node ip-10-42-116-152.us-west-2.compute.internal is not suitable for removal - utilization too big (0.935532) I1002 20:16:03.386144 1 scale_down.go:410] Node ip-10-42-178-162.us-west-2.compute.internal - utilization 0.788750 I1002 20:16:03.386153 1 scale_down.go:414] Node ip-10-42-178-162.us-west-2.compute.internal is not suitable for removal - utilization too big (0.788750) I1002 20:16:03.386167 1 scale_down.go:410] Node ip-10-42-111-196.us-west-2.compute.internal - utilization 0.926800 I1002 20:16:03.386176 1 scale_down.go:414] Node ip-10-42-111-196.us-west-2.compute.internal is not suitable for removal - utilization too big (0.926800) I1002 20:16:03.386186 1 scale_down.go:410] Node ip-10-42-178-105.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386195 1 scale_down.go:414] Node ip-10-42-178-105.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386204 1 scale_down.go:410] Node ip-10-42-125-41.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386240 1 scale_down.go:414] Node ip-10-42-125-41.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386263 1 scale_down.go:410] Node ip-10-42-99-171.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386274 1 scale_down.go:414] Node ip-10-42-99-171.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386285 1 scale_down.go:410] Node ip-10-42-189-31.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386290 1 scale_down.go:414] Node ip-10-42-189-31.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386298 1 scale_down.go:410] Node ip-10-42-127-104.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386337 1 scale_down.go:414] Node ip-10-42-127-104.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386358 1 scale_down.go:410] Node ip-10-42-107-140.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386368 1 scale_down.go:414] Node ip-10-42-107-140.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386379 1 scale_down.go:410] Node ip-10-42-136-80.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386389 1 scale_down.go:414] Node ip-10-42-136-80.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386440 1 scale_down.go:410] Node ip-10-42-104-236.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386452 1 scale_down.go:414] Node ip-10-42-104-236.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386465 1 scale_down.go:410] Node ip-10-42-174-19.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386472 1 scale_down.go:414] Node ip-10-42-174-19.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386484 1 scale_down.go:410] Node ip-10-42-188-234.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386519 1 scale_down.go:414] Node ip-10-42-188-234.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386538 1 scale_down.go:410] Node ip-10-42-116-150.us-west-2.compute.internal - utilization 0.959447 I1002 20:16:03.386548 1 scale_down.go:414] Node ip-10-42-116-150.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:16:03.386559 1 scale_down.go:410] Node ip-10-42-188-210.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386565 1 scale_down.go:414] Node ip-10-42-188-210.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386577 1 scale_down.go:410] Node ip-10-42-180-33.us-west-2.compute.internal - utilization 0.976250 I1002 20:16:03.386616 1 scale_down.go:414] Node ip-10-42-180-33.us-west-2.compute.internal is not suitable for removal - utilization too big (0.976250) I1002 20:16:03.386633 1 scale_down.go:410] Node ip-10-42-130-4.us-west-2.compute.internal - utilization 0.913750 I1002 20:16:03.386640 1 scale_down.go:414] Node ip-10-42-130-4.us-west-2.compute.internal is not suitable for removal - utilization too big (0.913750) I1002 20:16:03.386653 1 scale_down.go:410] Node ip-10-42-100-95.us-west-2.compute.internal - utilization 0.959447 I1002 20:16:03.386660 1 scale_down.go:414] Node ip-10-42-100-95.us-west-2.compute.internal is not suitable for removal - utilization too big (0.959447) I1002 20:16:03.386671 1 scale_down.go:410] Node ip-10-42-130-209.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386677 1 scale_down.go:414] Node ip-10-42-130-209.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386687 1 scale_down.go:410] Node ip-10-42-96-206.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386694 1 scale_down.go:414] Node ip-10-42-96-206.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386705 1 scale_down.go:410] Node ip-10-42-171-73.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386712 1 scale_down.go:414] Node ip-10-42-171-73.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386725 1 scale_down.go:410] Node ip-10-42-178-177.us-west-2.compute.internal - utilization 0.763750 I1002 20:16:03.386732 1 scale_down.go:414] Node ip-10-42-178-177.us-west-2.compute.internal is not suitable for removal - utilization too big (0.763750) I1002 20:16:03.386743 1 scale_down.go:410] Node ip-10-42-99-66.us-west-2.compute.internal - utilization 0.588750 I1002 20:16:03.386755 1 scale_down.go:414] Node ip-10-42-99-66.us-west-2.compute.internal is not suitable for removal - utilization too big (0.588750) I1002 20:16:03.386765 1 scale_down.go:410] Node ip-10-42-148-62.us-west-2.compute.internal - utilization 0.851250 I1002 20:16:03.386772 1 scale_down.go:414] Node ip-10-42-148-62.us-west-2.compute.internal is not suitable for removal - utilization too big (0.851250) I1002 20:16:03.386787 1 scale_down.go:410] Node ip-10-42-165-250.us-west-2.compute.internal - utilization 0.863750 I1002 20:16:03.386795 1 scale_down.go:414] Node ip-10-42-165-250.us-west-2.compute.internal is not suitable for removal - utilization too big (0.863750) I1002 20:16:03.386816 1 scale_down.go:410] Node ip-10-42-166-59.us-west-2.compute.internal - utilization 0.953120 I1002 20:16:03.386822 1 scale_down.go:414] Node ip-10-42-166-59.us-west-2.compute.internal is not suitable for removal - utilization too big (0.953120) I1002 20:16:03.387549 1 static_autoscaler.go:393] Scale down status: unneededOnly=true lastScaleUpTime=2019-10-02 20:14:11.083995883 +0000 UTC m=+11327.195309552 lastScaleDownDeleteTime=2019-10-02 19:49:17.786137041 +0000 UTC m=+9833.897450687 lastScaleDownFailTime=2019-10-02 17:06:04.23696368 +0000 UTC m=+40.348277308 scaleDownForbidden=false isDeleteInProgress=false I1002 20:16:04.190236 1 reflector.go:370] k8s.io/client-go/informers/factory.go:132: Watch close - *v1.Node total 244 items received