Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Support UI to monitor the health status of Iceberg tables #9314

Open
nqvuong1998 opened this issue Aug 9, 2024 · 4 comments
Open

Comments

@nqvuong1998
Copy link

Description

Nessie should be able to assess the health of a table and alert users to any issues. The assessment of a table's health may involve two factors:

  • File Status: This includes the condition of data files and metadata files in the table. Overly fragmented files and an excessive number of delete files can indicate poor query performance.
  • Data Quality: The data in the table should adhere to user-defined rules.

Expected Use Cases

To monitor Iceberg workloads

Requested Changes in public API

No response

@nqvuong1998
Copy link
Author

cc @snazy @ajantha-bhat

@dimas-b
Copy link
Member

dimas-b commented Aug 9, 2024

Hi @nqvuong1998 : By "UI" do you mean the Nessie OSS UI or some general / custom UI?

@nqvuong1998
Copy link
Author

Hi @dimas-b ,
Currently, the Nessie OSS UI only supports displaying branches and commits. It would be beneficial to include table metrics such as snapshots, partitions, and files to assess the health of a table and alert users to potential issues.

@dimas-b
Copy link
Member

dimas-b commented Aug 9, 2024

Well, the Nessie OSS UI does not really have people who can improve it ATM 🤷 ... but contributions are certainly welcome.

For day-to-day activities, the new CLI is actually more feature-rich than the Web UI and hopefully easier to maintain.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants