[ENH] - Integrate conda-store 2024.1.1 release

[kcpevey]

Feature description

This issue is to add the latest conda-store release (2024.1.1) to Nebari. There are significant changes in this conda-store release so it will need thorough testing.

Value and/or benefit

Updated conda-store.

Anything else?

No response

[dcmcand]

Testing:
I was able to create and use an environment in my personal namespace as an admin user
I was able to create and use an environment in a shared namepace as an admin user
I was able to create and use an environment in my personal namespace as an non-admin user
I was not able to create an environment in a shared namepace as an non-admin user, but was able to use one from the shared namespace

Anything else that I should test? @kcpevey @dharhas ?

[dcmcand]

• I was able to create and use an environment in my personal namespace as an admin user
• I was able to create and use an environment in a shared namepace as an admin user
• I was able to create and use an environment in my personal namespace as an non-admin user
• I was not able to create an environment in a shared namepace as an non-admin user, but was able to use one from the shared namespace
• I was able to cancel a build of an environment using the FastAPI ui since that functionality is not yet exposed in conda-store-ui ([ENH] - Make build canceling exposed in the UI conda-incubator/conda-store-ui#347)

Yet to do: test a complex environment

[kcpevey]

Took me 28 minutes to solve...

channels:
  - pytorch
  - conda-forge
  - nvidia
dependencies:
  - adjusttext >= 0.7.3
  - apache-beam >= 2.22.0
  - boto3
  - botocore
  - catboost >= 1.1.1
  - click >=8.0.3
  - cma => 3.3.0
  - colour >= 0.1.5
  - conda-lock >= 2.1.1
  - coverage >= 6.5.0
  - datasets >= 2.7.1
  - docutils
  - ffmpeg-python >= 0.2.0
  - flake8 != 0.2.0
  - git-lfs
  - google-cloud-storage
  - h5py >= 3.8.0
  - hypothesis >= 6.61.0
  - jsonschema
  - jupyter >= 1.0.0
  - jupytext >= 1.14.0
  - keras >= 2.10.0
  - kornia != 0.6.12
  - librosa >= 0.10.0
  - lightning
  - loguru
  - matplotlib  >= 3.7.1
  - mlflow
  - nodeenv
  - numpydoc >= 1.5.0
  - pandas >= 2.0
  - papermill >= 2.3.3
  - pluggy
  - protobuf
  - pyarrow >= 7.0.0
  - pydub >= 0.25.1
  - py-lief => 0.12.3
  - pyright >= 1.1.280
  - pytest > 0.2.0, != 7.3.1
  - pytest-cov > 4.0.0
  - pytest-flake8 != 1.1.1
  - pytest-mock > 3.10.0
  - pytest-xdist >= 3.3.1
  - python == 3.10
  - python-levenshtein
  - python-pptx >= 0.6.21
  - pytorch >= 1.13.1
  - ipykernel
  - pip
  - pip:
      - alibi-detect >= 0.11.4
      - huggingface-hub >= 0.11.1
      - hydra-zen
      - IProgress
      - kwcoco >= 0.2.18
      - opencv-python >= 4.5.5.62
      - opencv-python-headless >= 4.5.5.62
      - markdown_it_py
      - mdit_py_plugins
      - prophet >= 1.1.0, <2.0.0
      - pykeops >= 2.0.0, <2.2.0
      - smqtk-classifier >= 0.17.0
      - smqtk-core >= 0.19.0
      - smqtk-descriptors >= 0.16.0
      - smqtk-detection >= 0.19.0
      - smqtk-image-io >= 0.17.1
      - sphinxcontrib_applehelp
      - sphinxcontrib_devhelp
      - sphinxcontrib_htmlhelp
      - sphinxcontrib_qthelp
      - sphinxcontrib_serializinghtml

[dcmcand]

Thanks @kcpevey , testing it now

[dcmcand]

The large env built in 25 minutes on my local install of nebari. I think that this is tested. @kcpevey @dharhas anything else you think we need to look at?

[dharhas]

Only other thing will be testing the GPU build feature that is being developed in

• Pass CONDA_OVERRIDE_CUDA to with_cuda of conda-lock conda-incubator/conda-store#721
• Allow passing variables via raw YAML conda-incubator/conda-store-ui#354

When those are ready. If we think those will make it for this release.