[ENH] - Add JupyterHub specific Grafana pre-configured dashboards

[iameskild]

Feature description

It would be great to have these monitoring dashboard already pre-configured:
https://github.com/jupyterhub/grafana-dashboards

Value and/or benefit

Although there are existing monitoring dashboards, these would make the first experience with monitoring potentially worthwhile and gives an idea of what is possible.

Anything else?

Add to Nebari Docs - Grafana 101

[Adam-D-Lewis]

I'm working on this. Some dashboards in the latest version of the jupyterhub dashboard repo (https://github.com/jupyterhub/grafana-dashboards/tree/803ffa9b458fa325946de90eee288b065de46bc9) won't work until we upgrade jupyterhub to 3.1+(https://jupyterhub.readthedocs.io/en/3.0.0/reference/metrics.html)

[Adam-D-Lewis]

So I had to manually render the dashboards, the process was:

• git clone https://github.com/jupyterhub/grafana-dashboards
• install grafonnet locally
• create a grafana admin api key and export to the GRAFANA_TOKEN env var
• I modified deploy.py

def deploy_dashboard(dashboard_path, folder_uid, api, global_dash=False):
    db = build_dashboard(dashboard_path, api, global_dash)

    if not db:
        return

    db = layout_dashboard(db)
    db = populate_template_variables(api, db)

    data = {
        'dashboard': db,
        'folderId': folder_uid,
        'overwrite': True
    }
    import json
    with open(f"rendered/{db['title'].lower().replace(' ','_')}.json", 'w') as f:
        f.write(json.dumps(db, indent=4))
    # breakpoint()
    # api('/dashboards/db', data)

• run modified deploy.py from the cloned repo

[Adam-D-Lewis]

Some of the dashboards don't work on nebari bc we are on a old version of jupyterhub, some of the pods have different labels, etc. so we need to figure out how we want handle it. Fork the repo? Something else?

[Adam-D-Lewis]

Okay, I just rendered the dashboards locally and then made modifications as needed so they would work with Nebari. I deleted an NFS dashboard that showed how much disk space Jupyterhub users were using b/c I think it would require rewriting the whole thing, but that would be useful information to add eventually. I also deleted a dashboard that showed all the memory and compute requests/limits by each JHub user for the same reason, but again it may be nice to add at some point.

[Adam-D-Lewis]

Fixed by https://github.com/nebari-dev/nebari/pull/1723/commits

[pavithraes]

I'm working on this. Some dashboards in the latest version of the jupyterhub dashboard repo (jupyterhub/grafana-dashboards@803ffa9) won't work until we upgrade jupyterhub to 3.1+(jupyterhub.readthedocs.io/en/3.0.0/reference/metrics.html)

Re-opeining - we now have jupyterhub to 3.1+, so it's worth revisiting https://jupyterhub.readthedocs.io/en/3.0.0/reference/metrics.html