Upgrade JupyterHub to 2.0 or greater

[iameskild]

This issue will act as a central place for us to discuss and document what it would take to upgrade JupyterHub to version 2.0 or greater; JupyterHub 4.0 was just released earlier this year . We are currently running on quite an old version (1.5) and sooner or later this will likely cause us issues.

Z2JH has documented what is required to upgrade from 1.* to 2.*.

[Adam-D-Lewis]

https://jupyterhub.readthedocs.io/en/latest/reference/changelog.html#id75 could be useful as well

One problem I already see is all our jupyterhub services are admins at the moment and we'll need to change that.

It should also be noted that Z2JH has documented what is required to upgrade from 1.* to 2.*.

Note that Z2JH v2 uses Jupyterhub 3. They migrated directly from jupyterhub 1.x to 3.x.

[Adam-D-Lewis]

Looks like we'll have to drop support for CDSDashboards if we want to do this soon. ideonate/cdsdashboards#96

[Adam-D-Lewis]

Managed to build an image with jupyterhub 3 that didn't throw any errors on startup of the hub pod on nebari at least
nebari-dev/nebari-docker-images@78ecfe0

[Adam-D-Lewis]

The Z2JH jupyterhub docker image changed from a base Ubuntu image to a base debian-bullseye image. This may force us to change our image, but not sure yet - https://github.com/jupyterhub/zero-to-jupyterhub-k8s/blob/2.0.0/images/hub/Dockerfile.

[Adam-D-Lewis]

Seeing this error, looks like I'll need to upgrade jupyterlab image as well - jupyterhub version 3.1.1 != jupyterhub-singleuser version 1.5.0. This could cause failure to authenticate and result in redirect loops! Update: Fixed by upgrading jupyterhub version on jupyterlab pod.

[Adam-D-Lewis]

I thought that these services will need to be adjusted in order to work in the latest jupyterhub, but they still seem to work for the moment despite admin being deprecated.

services = concat([
"dask-gateway"
],
(var.monitoring-enabled ? ["monitoring"] : []),
(var.prefect-enabled ? ["prefect"] : []),
(var.kbatch-enabled ? ["kbatch"] : [])
)

[Adam-D-Lewis]

Okay, I seem to have a working version of Nebari with Jupyterhub 3. I tested the dashboards in grafana, running a small dask cluster on a small computation, creating a conda environment in conda store, creating users manually in keycloak. Only thing that doesn't work is CDSDashboards and idk a way around that til we get a replacement built.

[Adam-D-Lewis]

Related Issue that should probably be included in this PR: #1854

[iameskild]

Closed by #1856