Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use Colab as a base image. #1444

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Use Colab as a base image. #1444

wants to merge 4 commits into from
+222 −597

Commits on Nov 27, 2024

  1. Use Colab as a base image. 

    This change makes a number of major changes:
- Colab is the base image
- uv is the main package install tool
- leveraging requirements.txt instead of many separate installs
- stop building and installing tensorflow/torch/lightbgm/jax since those
  are managed by the Colab base image now

In order to decide what packages to explicitly install I:
- looked at what packages are in the Colab base image
- looked at what packages were in the Kaggle image
- looked at what packages were explicitly mentioned in Kaggle Dockerfile

This may still take a few iterations to get all the right parts in the
image, but this should hopefully make the image much more manageable.

http://b/365782129
    @djherbis
    djherbis committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    0d6c8ed View commit details
    Browse the repository at this point in the history

  2. rm micromamba since its not actually applying to the env

    @djherbis
    djherbis committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    c4ee63d View commit details
    Browse the repository at this point in the history

  3. fix kagglehub

    @djherbis
    djherbis committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    292110d View commit details
    Browse the repository at this point in the history

  4. keep Colab key deps

    @djherbis
    djherbis committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    dc18661 View commit details
    Browse the repository at this point in the history