Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: update resource request and limits across containers #212

Merged
merged 2 commits into from
Jun 27, 2022

Conversation

sp98
Copy link
Contributor

@sp98 sp98 commented Jun 16, 2022

Reference doc


Testing:

  1. 50 POD/PVC
  • No OOMKilled error observed. But looks like lvmd container might have restarted in the topolvm-node pod.
  • It took 20 minutes (approximately double the current time) to create 50 pods.

NAME                                               READY   STATUS    RESTARTS       AGE
lvm-operator-controller-manager-5d69d47698-b5qm8   3/3     Running   0              49m
topolvm-controller-55d8fd4665-cxlbh                5/5     Running   0              48m
topolvm-node-f2vbw                                 4/4     Running   2 (4m6s ago)   48m
vg-manager-dr65q                                   1/1     Running   0              48m
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Pod lvm-operator-controller-manager-5d69d47698-b5qm8 between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0030 |     0.0103 |     0.0054
	 MEM (min|max|avg) Mib    :    50.4141 |    53.8828 |    52.0765
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container kube-rbac-proxy between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :     9.2578 |     9.2773 |     9.2716
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container manager between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0025 |     0.0092 |     0.0046
	 MEM (min|max|avg) Mib    :    24.5664 |    25.7930 |    25.1808
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container metricsexporter between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0027 |     0.0006
	 MEM (min|max|avg) Mib    :    16.1836 |    18.8750 |    17.6241
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Pod topolvm-controller-55d8fd4665-cxlbh between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0059 |     0.0681 |     0.0181
	 MEM (min|max|avg) Mib    :   124.3398 |   133.3516 |   130.0202
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container liveness-probe between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :     8.5508 |     9.1797 |     8.7374
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container topolvm-controller between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0023 |     0.0317 |     0.0090
	 MEM (min|max|avg) Mib    :    40.6523 |    43.1602 |    42.4560
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-provisioner between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0008 |     0.0321 |     0.0068
	 MEM (min|max|avg) Mib    :    33.9336 |    37.8086 |    35.6828
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-resizer between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0065 |     0.0017
	 MEM (min|max|avg) Mib    :    27.3398 |    32.3438 |    30.2547
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-snapshotter between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0003
	 MEM (min|max|avg) Mib    :    12.7852 |    13.0273 |    12.8892
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Pod topolvm-node-f2vbw between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0044 |     0.1464 |     0.0899
	 MEM (min|max|avg) Mib    :    64.3477 |   201.3359 |   108.6380
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container csi-registrar between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :    12.6367 |    12.8750 |    12.7168
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container liveness-probe between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :     7.6797 |     8.2422 |     7.9346
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container lvmd between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0005 |     0.1368 |     0.0781
	 MEM (min|max|avg) Mib    :    22.1797 |   127.1211 |    44.1463
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container topolvm-node between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0020 |     0.0373 |     0.0114
	 MEM (min|max|avg) Mib    :     0.0000 |    53.2891 |    43.8404
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Pod vg-manager-dr65q between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0003 |     0.0022 |     0.0009
	 MEM (min|max|avg) Mib    :    20.1328 |    21.3594 |    20.6117
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Container vg-manager between 2022-06-17 14:30:36 +0530 IST and 2022-06-17 14:50:09 +0530 IST
	 CPU (min|max|avg) seconds:     0.0003 |     0.0022 |     0.0009
	 MEM (min|max|avg) Mib    :    20.1328 |    21.3594 |    20.6117
--------------------------------------------------------------------------------
  1. Updated CPU request and limit for provisioner and lvm container. Tested with 20, 40, 45 and 50 pod/pvcs. No pod restart observed.
Usage report: 20 pods in namespace openshift-storage using 20 PVCs with Storage Class <odf-lvm-vg1>
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Pod lvm-operator-controller-manager-959d89f47-9mbvd between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0023 |     0.0099 |     0.0057
	 MEM (min|max|avg) Mib    :    55.4609 |    59.1016 |    56.7630
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container metricsexporter between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0054 |     0.0008
	 MEM (min|max|avg) Mib    :    19.2031 |    22.5391 |    20.2455
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container kube-rbac-proxy between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0007 |     0.0002
	 MEM (min|max|avg) Mib    :     9.7031 |     9.7031 |     9.7031
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container manager between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0017 |     0.0069 |     0.0047
	 MEM (min|max|avg) Mib    :    26.3281 |    27.3672 |    26.8143
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Pod topolvm-controller-cf7f49c87-jzw7c between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0057 |     0.0365 |     0.0186
	 MEM (min|max|avg) Mib    :   105.5195 |   117.2305 |   113.3366
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-resizer between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0042 |     0.0020
	 MEM (min|max|avg) Mib    :    24.2852 |    26.4141 |    25.4326
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-snapshotter between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0009 |     0.0003
	 MEM (min|max|avg) Mib    :    12.9141 |    13.0703 |    12.9880
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container liveness-probe between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :    10.7695 |    11.2578 |    11.0451
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container topolvm-controller between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0026 |     0.0226 |     0.0098
	 MEM (min|max|avg) Mib    :    35.0352 |    36.6680 |    35.6567
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-provisioner between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0012 |     0.0210 |     0.0063
	 MEM (min|max|avg) Mib    :    22.3594 |    29.8359 |    28.2142
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Pod topolvm-node-4pslc between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0014 |     0.1961 |     0.1027
	 MEM (min|max|avg) Mib    :    73.6875 |   120.6641 |    97.0545
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container csi-registrar between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0004 |     0.0001
	 MEM (min|max|avg) Mib    :     6.8750 |     7.0234 |     6.9332
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container liveness-probe between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0006 |     0.0002
	 MEM (min|max|avg) Mib    :     9.0391 |     9.0586 |     9.0485
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container lvmd between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.1828 |     0.0931
	 MEM (min|max|avg) Mib    :    19.9688 |    57.2578 |    36.9173
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container topolvm-node between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0012 |     0.0169 |     0.0093
	 MEM (min|max|avg) Mib    :    37.7500 |    47.3242 |    44.1556
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Pod vg-manager-jhd8k between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0005 |     0.0016 |     0.0009
	 MEM (min|max|avg) Mib    :    20.7266 |    21.2734 |    21.0947
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Container vg-manager between 2022-06-20 17:49:16 +0530 IST and 2022-06-20 17:54:48 +0530 IST
	 CPU (min|max|avg) seconds:     0.0005 |     0.0016 |     0.0009
	 MEM (min|max|avg) Mib    :    20.7266 |    21.2734 |    21.0947
--------------------------------------------------------------------------------


-------------------------------------------

Usage report: 40 pods in namespace openshift-storage using 40 PVCs with Storage Class <odf-lvm-vg1>
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Pod lvm-operator-controller-manager-959d89f47-9mbvd between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0025 |     0.0093 |     0.0055
	 MEM (min|max|avg) Mib    :    55.2617 |    58.6016 |    56.5464
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container kube-rbac-proxy between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0007 |     0.0002
	 MEM (min|max|avg) Mib    :     9.7031 |     9.7031 |     9.7031
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container manager between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0025 |     0.0077 |     0.0048
	 MEM (min|max|avg) Mib    :    26.6406 |    27.9570 |    27.4265
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container metricsexporter between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0021 |     0.0006
	 MEM (min|max|avg) Mib    :    18.5703 |    21.2734 |    19.4167
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Pod topolvm-controller-cf7f49c87-jzw7c between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0057 |     0.0567 |     0.0220
	 MEM (min|max|avg) Mib    :   114.2461 |   121.3867 |   117.8356
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-resizer between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0072 |     0.0021
	 MEM (min|max|avg) Mib    :    25.4414 |    28.4453 |    26.6300
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-snapshotter between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0008 |     0.0003
	 MEM (min|max|avg) Mib    :    12.9648 |    13.0469 |    12.9968
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container liveness-probe between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0010 |     0.0003
	 MEM (min|max|avg) Mib    :    10.8867 |    11.1797 |    11.0144
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container topolvm-controller between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0028 |     0.0461 |     0.0115
	 MEM (min|max|avg) Mib    :    35.9258 |    37.4180 |    36.4629
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-provisioner between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0014 |     0.0265 |     0.0078
	 MEM (min|max|avg) Mib    :    28.8047 |    32.9297 |    30.7315
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Pod topolvm-node-4pslc between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0019 |     0.2095 |     0.1342
	 MEM (min|max|avg) Mib    :    95.5352 |   134.3164 |   111.2110
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container topolvm-node between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0010 |     0.0372 |     0.0116
	 MEM (min|max|avg) Mib    :    44.0742 |    55.6211 |    48.2161
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container csi-registrar between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0005 |     0.0001
	 MEM (min|max|avg) Mib    :     6.8750 |     6.9609 |     6.8969
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container liveness-probe between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0012 |     0.0002
	 MEM (min|max|avg) Mib    :     8.9062 |     9.2148 |     9.0326
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container lvmd between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.1948 |     0.1222
	 MEM (min|max|avg) Mib    :    33.1133 |    67.4180 |    47.0654
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Pod vg-manager-jhd8k between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0003 |     0.0020 |     0.0008
	 MEM (min|max|avg) Mib    :    21.3008 |    21.6484 |    21.5485
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Container vg-manager between 2022-06-20 17:57:15 +0530 IST and 2022-06-20 18:07:00 +0530 IST
	 CPU (min|max|avg) seconds:     0.0003 |     0.0020 |     0.0008
	 MEM (min|max|avg) Mib    :    21.3008 |    21.6484 |    21.5485
--------------------------------------------------------------------------------

------------------------------------

Usage report: 45 pods in namespace openshift-storage using 45 PVCs with Storage Class <odf-lvm-vg4>
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Pod lvm-operator-controller-manager-74f564cd98-tk969 between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0026 |     0.0087 |     0.0053
	 MEM (min|max|avg) Mib    :    47.7812 |    53.7305 |    51.8880
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container kube-rbac-proxy between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :    13.2188 |    13.2188 |    13.2188
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container manager between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0023 |     0.0078 |     0.0045
	 MEM (min|max|avg) Mib    :    23.4102 |    24.5430 |    24.0906
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container metricsexporter between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0033 |     0.0006
	 MEM (min|max|avg) Mib    :    10.8398 |    15.9727 |    14.5787
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Pod topolvm-controller-65489bfd78-qcwkr between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0022 |     0.0586 |     0.0206
	 MEM (min|max|avg) Mib    :   104.4688 |   122.5000 |   118.6119
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-snapshotter between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0008 |     0.0002
	 MEM (min|max|avg) Mib    :    12.8086 |    12.9453 |    12.8869
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container liveness-probe between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0008 |     0.0002
	 MEM (min|max|avg) Mib    :     8.3750 |     9.1562 |     8.6872
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container topolvm-controller between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0270 |     0.0102
	 MEM (min|max|avg) Mib    :    35.8281 |    40.7188 |    38.2821
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-provisioner between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0310 |     0.0078
	 MEM (min|max|avg) Mib    :    22.4102 |    33.3125 |    31.8017
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-resizer between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0068 |     0.0022
	 MEM (min|max|avg) Mib    :    25.0469 |    28.6055 |    26.9541
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Pod topolvm-node-5jb5m between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0019 |     0.2135 |     0.1280
	 MEM (min|max|avg) Mib    :    68.3906 |   127.5664 |   100.0111
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container liveness-probe between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0005 |     0.0002
	 MEM (min|max|avg) Mib    :     8.4023 |     8.6953 |     8.5797
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container lvmd between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.1977 |     0.1164
	 MEM (min|max|avg) Mib    :    18.6875 |    53.2031 |    38.3720
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container topolvm-node between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0009 |     0.0291 |     0.0113
	 MEM (min|max|avg) Mib    :    31.9258 |    56.3477 |    43.7996
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container csi-registrar between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0006 |     0.0001
	 MEM (min|max|avg) Mib    :     9.1641 |     9.3516 |     9.2598
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Pod vg-manager-6jlq9 between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0020 |     0.0009
	 MEM (min|max|avg) Mib    :    22.3828 |    22.8438 |    22.6244
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Container vg-manager between 2022-06-21 12:11:45 +0530 IST and 2022-06-21 12:23:34 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0020 |     0.0009
	 MEM (min|max|avg) Mib    :    22.3828 |    22.8438 |    22.6244
-------------------------------------------------------------------------------

-------------------------------
Usage report: 50 pods in namespace openshift-storage using 50 PVCs with Storage Class <odf-lvm-vg4>
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Pod lvm-operator-controller-manager-74f564cd98-tk969 between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0025 |     0.0088 |     0.0055
	 MEM (min|max|avg) Mib    :    52.2070 |    56.7383 |    54.3104
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container manager between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0024 |     0.0075 |     0.0045
	 MEM (min|max|avg) Mib    :    23.5039 |    24.9023 |    24.4938
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container metricsexporter between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0035 |     0.0007
	 MEM (min|max|avg) Mib    :    14.8125 |    18.8828 |    16.5509
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for lvm-operator-controller-manager deployment's Container kube-rbac-proxy between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0009 |     0.0002
	 MEM (min|max|avg) Mib    :    13.2656 |    13.2656 |    13.2656
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Pod topolvm-controller-65489bfd78-qcwkr between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0056 |     0.0507 |     0.0179
	 MEM (min|max|avg) Mib    :   119.2227 |   128.8984 |   126.3712
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-provisioner between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0009 |     0.0345 |     0.0065
	 MEM (min|max|avg) Mib    :    31.8789 |    38.2969 |    35.6588
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-resizer between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0093 |     0.0018
	 MEM (min|max|avg) Mib    :    25.5039 |    28.5781 |    27.4727
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container csi-snapshotter between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0001 |     0.0009 |     0.0003
	 MEM (min|max|avg) Mib    :    13.1055 |    13.2070 |    13.1620
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container liveness-probe between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0008 |     0.0002
	 MEM (min|max|avg) Mib    :     8.6094 |     9.4883 |     8.8126
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-controller deployment's Container topolvm-controller between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0029 |     0.0271 |     0.0092
	 MEM (min|max|avg) Mib    :    39.6953 |    43.6680 |    41.2651
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Pod topolvm-node-5jb5m between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0019 |     0.2090 |     0.1030
	 MEM (min|max|avg) Mib    :   100.8945 |   137.1836 |   120.3202
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container csi-registrar between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0005 |     0.0001
	 MEM (min|max|avg) Mib    :     9.3086 |     9.4375 |     9.3757
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container liveness-probe between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.0008 |     0.0002
	 MEM (min|max|avg) Mib    :     8.8672 |     9.2617 |     9.0496
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container lvmd between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.1910 |     0.0933
	 MEM (min|max|avg) Mib    :    31.9258 |    62.1250 |    47.2663
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for topolvm-node daemonset's Container topolvm-node between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0010 |     0.0212 |     0.0094
	 MEM (min|max|avg) Mib    :    50.7227 |    59.3789 |    54.6286
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Pod vg-manager-6jlq9 between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0003 |     0.0020 |     0.0009
	 MEM (min|max|avg) Mib    :    22.6367 |    23.5000 |    23.0965
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Report for vg-manager daemonset's Container vg-manager between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0003 |     0.0020 |     0.0009
	 MEM (min|max|avg) Mib    :    22.6367 |    23.5000 |    23.0965
--------------------------------------------------------------------------------

Signed-off-by: Santosh Pillai [email protected]

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 16, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 16, 2022

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@sp98 sp98 force-pushed the update-resources branch 2 times, most recently from d9b5022 to 7b73e0d Compare June 17, 2022 08:25
@sp98 sp98 marked this pull request as ready for review June 20, 2022 06:23
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 20, 2022
@sp98 sp98 changed the title fix: update resoure request and limits across containers [WIP] fix: update resoure request and limits across containers Jun 20, 2022
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 20, 2022
@sp98 sp98 force-pushed the update-resources branch from 7b73e0d to 140c749 Compare June 20, 2022 12:17
@sp98 sp98 requested a review from nbalacha June 20, 2022 12:52
@sp98 sp98 force-pushed the update-resources branch from 140c749 to 2f6931e Compare June 20, 2022 13:01
Copy link
Contributor

@nbalacha nbalacha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add resource limits and requests to the main operator controller pod . See https://github.com/red-hat-storage/ocs-osd-deployer/blob/main/config/manager/manager.yaml for how to do this.

@sp98 sp98 force-pushed the update-resources branch from 2f6931e to 228a06c Compare June 21, 2022 07:32
@nbalacha nbalacha changed the title [WIP] fix: update resoure request and limits across containers [WIP] fix: update resource request and limits across containers Jun 22, 2022
@sp98 sp98 force-pushed the update-resources branch from 228a06c to 8b86cf6 Compare June 22, 2022 07:13
@sp98 sp98 requested a review from nbalacha June 23, 2022 10:05
@sp98 sp98 changed the title [WIP] fix: update resource request and limits across containers fix: update resource request and limits across containers Jun 23, 2022
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 23, 2022
memory: 100Mi
requests:
cpu: 100m
cpu: 30m
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please raise these values. We are well within the cpu limitations.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The metrics-exporter would also need resource definitions.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated manager container to use the old values. Added resource limits and requests for metrics exportor

TopolvmNodeMemLimit = "150Mi"
TopolvmNodeCPURequest = "100m"
TopolvmNodeCPULimit = "150m"

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add separate values for the lvmd. The topolvm-node container uses a lot less. Lvmd can use a request val of 150m and limit of 200m.

Copy link
Contributor Author

@sp98 sp98 Jun 27, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added separate values for lvmd and topolvm-node.
But topolvm-node uses much more when compared to lvmd. For example:

Report for topolvm-node daemonset's Pod topolvm-node-5jb5m between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0019 |     0.2090 |     0.1030
	 MEM (min|max|avg) Mib    :   100.8945 |   137.1836 |   120.3202
Report for topolvm-node daemonset's Container lvmd between 2022-06-21 12:35:20 +0530 IST and 2022-06-21 12:52:12 +0530 IST
	 CPU (min|max|avg) seconds:     0.0000 |     0.1910 |     0.0933
	 MEM (min|max|avg) Mib    :    31.9258 |    62.1250 |    47.2663

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The other results (40 pods, 45 pods) show consistently lower values for the topolvm-node vs the lvmd containers.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

my bad. I was looking at the entire pod. :/
What do you think about the current resource allocation for the lvmd and topolvm-node container ?

Copy link
Contributor

@nbalacha nbalacha Jun 27, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The lvmd container looks fine. The topolvm-node cpu numbers can be reduced to 50 for request and 100 for limit.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The lvm-operator manager cpu numbers can be reduced as well - will it work with say 50 and 100?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please raise the mem request for lvm-operator - lets make it at least 50.

@sp98 sp98 force-pushed the update-resources branch from 8b86cf6 to 4ae806d Compare June 27, 2022 07:13
@sp98 sp98 requested a review from nbalacha June 27, 2022 07:20
Copy link
Member

@iamniting iamniting left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jun 27, 2022
@sp98 sp98 force-pushed the update-resources branch from 4ae806d to 8f2d660 Compare June 27, 2022 13:04
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Jun 27, 2022
@agarwal-mudit
Copy link
Contributor

/cherry-pick release-4.11

@openshift-cherrypick-robot

@agarwal-mudit: once the present PR merges, I will cherry-pick it on top of release-4.11 in a new PR and assign it to you.

In response to this:

/cherry-pick release-4.11

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

memory: 100Mi
requests:
cpu: 100m
cpu: 50m
memory: 20Mi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please raise this.

@sp98 sp98 force-pushed the update-resources branch from 8f2d660 to 89b02ac Compare June 27, 2022 14:43
@openshift-ci openshift-ci bot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 27, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 27, 2022

@sp98: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/lvm-operator-bundle-e2e-aws 89b02ac link false /test lvm-operator-bundle-e2e-aws

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@sp98 sp98 force-pushed the update-resources branch from 89b02ac to de4bb9d Compare June 27, 2022 14:58
@openshift-ci openshift-ci bot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 27, 2022
@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jun 27, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 27, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: iamniting, nbalacha, sp98

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 27, 2022
@openshift-ci openshift-ci bot merged commit 61dcbb6 into openshift:main Jun 27, 2022
@openshift-cherrypick-robot

@agarwal-mudit: new pull request created: #221

In response to this:

/cherry-pick release-4.11

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants