DAOS-14411 dfuse: Add per-container statistics. #12819
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Test-tag: dfuse Required-githooks: true Signed-off-by: Ashley Pittman <[email protected]>
|
Bug-tracker data: |
daosbuild1
reviewed
Aug 10, 2023
ashleypittman
changed the title
|
Test stage Functional on EL 8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-12819/1/testReport/ |
Test-tag: dfuse Allow-unstable-test: true Required-githooks: true
daosbuild1
reviewed
Aug 21, 2023
|
Test stage Functional on EL 8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-12819/2/testReport/ |
Test-tag: dfuse
daosbuild1
reviewed
Aug 25, 2023
Required-githooks: true
Required-githooks: true Signed-off-by: Ashley Pittman <[email protected]>
daosbuild1
reviewed
Aug 29, 2023
Test-tag: dfuse Required-githooks: true
daosbuild1
reviewed
Aug 29, 2023
Required-githooks: true
Required-githooks: true Signed-off-by: Ashley Pittman <[email protected]>
daosbuild1
reviewed
Sep 4, 2023
daosbuild1
reviewed
Sep 15, 2023
Test-tag: dfuse Required-githooks: true Signed-off-by: Ashley Pittman <[email protected]>
daosbuild1
reviewed
Sep 15, 2023
Test-tag: dfuse Required-githooks: true Skip-fault-injection-test: true Signed-off-by: Ashley Pittman <[email protected]>
daosbuild1
reviewed
Sep 15, 2023
ashleypittman
changed the title
Features: dfuse Required-githooks: true Signed-off-by: Ashley Pittman <[email protected]>
daosbuild1
reviewed
Sep 20, 2023
|
Test stage Build RPM on EL 9 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-12819/11/execution/node/403/log |
|
Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-12819/11/execution/node/402/log |
|
This PR adds the container statistics to the non-json output for this command but does not change the json output. I still have more to add (not least the cache parameters) and this command is new since 2.4, my preference would be to add all the new metrics/data just to the c code and then once that's complete extend the json output via modifying the go code, I'd likely need some assistance with that at the time. |
daosbuild1
reviewed
Sep 21, 2023
|
Test stage Functional on EL 8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-12819/13/testReport/ |
Features: dfuse
daosbuild1
reviewed
Sep 25, 2023
|
Test stage Functional Hardware Medium Verbs Provider completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-12819/14/testReport/ |
Features: dfuse
daosbuild1
reviewed
Sep 26, 2023
Required-githooks: true
daosbuild1
reviewed
Oct 2, 2023
|
Test stage Functional Hardware Medium Verbs Provider completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-12819/16/execution/node/1297/log |
Required-githooks: true
daosbuild1
reviewed
Oct 9, 2023
daltonbohning
approved these changes
Oct 12, 2023
Required-githooks: true
daosbuild1
reviewed
Oct 20, 2023
jolivier23
approved these changes
Oct 23, 2023
yyyshi
pushed a commit
to yyyshi/daos
that referenced
this pull request
Nov 22, 2023
Add dfuse operation statistics so it's possible to see what a workload is performing. Keep the statistics per container, log them at INFO on umount, and export them via the daos filesystem query command. Signed-off-by: Ashley Pittman [email protected] Signed-off-by: shiying <[email protected]>
jolivier23
pushed a commit
that referenced
this pull request
Apr 26, 2024
Multiple cherry-picks to add daos fs query feature for fuse statistics. Helpful for understanding and tuning DAOS performance when dfuse is used. DAOS-13625 dfuse: Merge the info and projection_info structs. (#11881) DAOS-13658 dfuse: Add filesystem query command. (#12367) DAOS-12751 control: Add a daos filesystem evict command. (#12331) DAOS-12751 dfuse: Improve evict command. (#12633) DAOS-13625 dfuse: Remove dfuse_projection_info entirely. (#12796) DAOS-13625 dfuse: Replace fs_handle with dfuse_info. (#12894) DAOS-13625 dfuse: Add core inode_lookup() and inode_decref() functions. (#12573) DAOS-14411 dfuse: Add per-container statistics. (#12819) Signed-off-by: Ashley Pittman <[email protected]>
jolivier23
pushed a commit
that referenced
this pull request
Apr 26, 2024
Multiple cherry-picks to add daos fs query feature for fuse statistics. Helpful for understanding and tuning DAOS performance when dfuse is used. DAOS-13625 dfuse: Merge the info and projection_info structs. (#11881) DAOS-13658 dfuse: Add filesystem query command. (#12367) DAOS-12751 control: Add a daos filesystem evict command. (#12331) DAOS-12751 dfuse: Improve evict command. (#12633) DAOS-13625 dfuse: Remove dfuse_projection_info entirely. (#12796) DAOS-13625 dfuse: Replace fs_handle with dfuse_info. (#12894) DAOS-13625 dfuse: Add core inode_lookup() and inode_decref() functions. (#12573) DAOS-14411 dfuse: Add per-container statistics. (#12819) Features: dfuse Required-githooks: true Change-Id: I8ae3cc743697c2434ae0d54b382ee6c585a3b033 Signed-off-by: Ashley Pittman <[email protected]> Signed-off-by: Jeff Olivier <[email protected]>
18 tasks
jolivier23
pushed a commit
that referenced
this pull request
Apr 26, 2024
Multiple cherry-picks to add daos fs query feature for fuse statistics. Helpful for understanding and tuning DAOS performance when dfuse is used. DAOS-13625 dfuse: Merge the info and projection_info structs. (#11881) DAOS-13658 dfuse: Add filesystem query command. (#12367) DAOS-12751 control: Add a daos filesystem evict command. (#12331) DAOS-12751 dfuse: Improve evict command. (#12633) DAOS-13625 dfuse: Remove dfuse_projection_info entirely. (#12796) DAOS-13625 dfuse: Replace fs_handle with dfuse_info. (#12894) DAOS-13625 dfuse: Add core inode_lookup() and inode_decref() functions. (#12573) DAOS-14411 dfuse: Add per-container statistics. (#12819) Features: dfuse Required-githooks: true Change-Id: I8ae3cc743697c2434ae0d54b382ee6c585a3b033 Signed-off-by: Ashley Pittman <[email protected]> Signed-off-by: Jeff Olivier <[email protected]>
jolivier23
pushed a commit
that referenced
this pull request
Apr 26, 2024
Multiple cherry-picks to add daos fs query feature for fuse statistics. Helpful for understanding and tuning DAOS performance when dfuse is used. DAOS-13625 dfuse: Merge the info and projection_info structs. (#11881) DAOS-13658 dfuse: Add filesystem query command. (#12367) DAOS-12751 control: Add a daos filesystem evict command. (#12331) DAOS-12751 dfuse: Improve evict command. (#12633) DAOS-13625 dfuse: Remove dfuse_projection_info entirely. (#12796) DAOS-13625 dfuse: Replace fs_handle with dfuse_info. (#12894) DAOS-13625 dfuse: Add core inode_lookup() and inode_decref() functions. (#12573) DAOS-14411 dfuse: Add per-container statistics. (#12819) DAOS-14411 control: Expose dfuse statistics as yaml. (#13876) Features: dfuse Required-githooks: true Change-Id: I8ae3cc743697c2434ae0d54b382ee6c585a3b033 Signed-off-by: Ashley Pittman <[email protected]> Signed-off-by: Jeff Olivier <[email protected]>
jolivier23
added a commit
that referenced
this pull request
Apr 29, 2024
Multiple cherry-picks to add daos fs query feature for fuse statistics. Helpful for understanding and tuning DAOS performance when dfuse is used. DAOS-13625 dfuse: Merge the info and projection_info structs. (#11881) DAOS-13658 dfuse: Add filesystem query command. (#12367) DAOS-12751 control: Add a daos filesystem evict command. (#12331) DAOS-12751 dfuse: Improve evict command. (#12633) DAOS-13625 dfuse: Remove dfuse_projection_info entirely. (#12796) DAOS-13625 dfuse: Replace fs_handle with dfuse_info. (#12894) DAOS-13625 dfuse: Add core inode_lookup() and inode_decref() functions. (#12573) DAOS-14411 dfuse: Add per-container statistics. (#12819) DAOS-14411 control: Expose dfuse statistics as yaml. (#13876) Changed base branch to google/2.4 for daos_build test Change-Id: I8ae3cc743697c2434ae0d54b382ee6c585a3b033 Signed-off-by: Ashley Pittman <[email protected]> Signed-off-by: Jeff Olivier <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add dfuse operation statistics so it's possible to see what a
workload is performing. Keep the statistics per container,
log them at INFO on umount, and export them via the daos
filesystem query command.
Signed-off-by: Ashley Pittman [email protected]