Enable gitpod integration

[tobiasdiez]

Gitpod allows one to setup a complete dev environment in the cloud. It is free to use for up to 50 hours per month. In this ticket the config necessary for making this work with sagemath is added.

You can try this out by going to https://gitpod.io/#https://github.com/sagemath/sagetrac-mirror/tree/public/build%2Fgitpod.

It currently takes a bit more than 1 hour until everything is setup. After this ticket is merged, we can enable the automatic prebuild using a github app (https://www.gitpod.io/docs/prebuilds#on-github). With this enabled, every push to the develop branch would trigger a prebuild of the complete environment (including the build of all dependencies and cythonizion) so that one has a up-to-date code env in a matter of a few seconds.

---

While setting things up, I noticed a few issues. Not sure if they are known problems or even by design. Please let me know if I should open a ticket for them to improve things.

• gitpod has brew installed on linux by default. Sagemath thinks this is the primary package manager and, e.g., configure suggests to run brew xyz to install new packages. Is brew indeed preferred over apt-get? This is now Prefer Linux package manager over linuxbrew; add nix detection #32753.
• gitpod comes also with pyenv preinstalled. This breaks the build unless one sets pyenv global system. Otherwise all python packages will be installed in the python env set by pyenv. This is now Unbreak the build when pyenv is present #29285.
• Currently gitpod prebuild has a time limit of 1 hour (with the plan to increase it in the future). To improve our build time I propose to add a new make option that uses prebuilt wheels from pypi instead of compiling everything locally. This is now Add make option to use prebuilt wheels from PyPI #32754.
• Maxima doesn't work with the homebrew version of ecl? From Support system installations of ECL and fix the kenzo SPKG build #29617 I got the impression it should work, but it fails with

;;; Loading "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/../lisp-utils/defsystem.lisp"
;;; Loading #P"/home/linuxbrew/.linuxbrew/Cellar/ecl/21.2.1_1/lib/ecl-21.2.1/cmp.fas"
#P"/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/lisp-utils/defsystem.lisp"
> 
("../src/" "./" (MAKE::HOME-SUBDIRECTORY "lisp/systems/")
 "/usr/local/lisp/Registry/")
> 
;;; Loading "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima.system"

;  - Compiling defsystem "maxima" 
;    - Compiling module "package" 
;      - Compiling source file
;        "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp"
;;;
;;; Compiling /workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp.
;;; OPTIMIZE levels: Safety=2, Space=0, Speed=3, Debug=2
;;;
;;; End of Pass 1.
;;; Internal error:
;;;   ** Error code 1 when executing
;;; (EXT:RUN-PROGRAM "gcc-5" ("-I." "-I/home/linuxbrew/.linuxbrew/Cellar/ecl/21.2.1_1/include/" "-I/home/linuxbrew/.linuxbrew/opt/gmp/include" "-I/home/linuxbrew/.linuxbrew/opt/libffi/include" "-I/home/linuxbrew/.linuxbrew/opt/bdw-gc/include" "-D_GNU_SOURCE" "-D_FILE_OFFSET_BITS=64" "-g" "-O2" "-fPIC" "-D_THREAD_SAFE" "-Dlinux" "-O2" "-c" "binary-ecl/maxima-package.c" "-o" "binary-ecl/maxima-package.o")):
;;; exec: No such file or directory
;      - Binary file binary-ecl/maxima-package.fas is old or does not exist. 
;        Compile (and load) source file /workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp instead? y
;      - Should I bother you if this happens again? y
;      - Compiling source file
;        "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp"
;;;
;;; Compiling /workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp.
;;; OPTIMIZE levels: Safety=2, Space=0, Speed=3, Debug=2
;;;
;;; End of Pass 1.
;;; Internal error:
;;;   ** Error code 1 when executing
;;; (EXT:RUN-PROGRAM "gcc-5" ("-I." "-I/home/linuxbrew/.linuxbrew/Cellar/ecl/21.2.1_1/include/" "-I/home/linuxbrew/.linuxbrew/opt/gmp/include" "-I/home/linuxbrew/.linuxbrew/opt/libffi/include" "-I/home/linuxbrew/.linuxbrew/opt/bdw-gc/include" "-D_GNU_SOURCE" "-D_FILE_OFFSET_BITS=64" "-g" "-O2" "-fPIC" "-D_THREAD_SAFE" "-Dlinux" "-O2" "-c" "binary-ecl/maxima-package.c" "-o" "binary-ecl/maxima-package.o")):
;;; exec: No such file or directory
;      - Loading binary file "binary-ecl/maxima-package.fas" 
Condition of type: FILE-ERROR
Filesystem error with pathname #P"/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/binary-ecl/maxima-package.fas".

This should be investigated as part of #29159.

Depends on #33068
Depends on #30933

CC: @mkoeppe @saraedum @koffie

Component: build

Branch/Commit: public/build/gitpod @ 974eb4c

Reviewer: Tobias Diez

Issue created by migration from https://trac.sagemath.org/ticket/32749

[tobiasdiez]

Description changed:

--- 
+++ 
@@ -8,6 +8,6 @@
 ---
 
 While setting things up, I noticed a few issues. Not sure if they are known problems or even by design. Please let me know if I should open a ticket for them to improve things.
-- gitpod has brew installed on linux by default. Sagemath thinks this is the primary package manager and, e.g., configure suggests to run `brew xyz` to install new packages.
+- gitpod has brew installed on linux by default. Sagemath thinks this is the primary package manager and, e.g., configure suggests to run `brew xyz` to install new packages. Is brew indeed preferred over apt-get?
 - gitpod comes also with pyenv preinstalled. This breaks the build unless one sets `pyenv global system`. Otherwise all python packages will be installed in the python env set by pyenv.
 - Curretly gitpod prebuild has a time limit of 1 hour (with the plan to increase it in the future). To improve our build time I propose to add a new `make` option that uses prebuilt wheels from pypi instead of compiling everything locally. 

[tobiasdiez]

Description changed:

--- 
+++ 
@@ -10,4 +10,47 @@
 While setting things up, I noticed a few issues. Not sure if they are known problems or even by design. Please let me know if I should open a ticket for them to improve things.
 - gitpod has brew installed on linux by default. Sagemath thinks this is the primary package manager and, e.g., configure suggests to run `brew xyz` to install new packages. Is brew indeed preferred over apt-get?
 - gitpod comes also with pyenv preinstalled. This breaks the build unless one sets `pyenv global system`. Otherwise all python packages will be installed in the python env set by pyenv.
-- Curretly gitpod prebuild has a time limit of 1 hour (with the plan to increase it in the future). To improve our build time I propose to add a new `make` option that uses prebuilt wheels from pypi instead of compiling everything locally. 
+- Curretly gitpod prebuild has a time limit of 1 hour (with the plan to increase it in the future). To improve our build time I propose to add a new `make` option that uses prebuilt wheels from pypi instead of compiling everything locally.
+- Maxima doesn't work with the homebrew version of ecl? From #29617 I got the impression it should work, but it fails with 
+
+```
+;;; Loading "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/../lisp-utils/defsystem.lisp"
+;;; Loading #P"/home/linuxbrew/.linuxbrew/Cellar/ecl/21.2.1_1/lib/ecl-21.2.1/cmp.fas"
+#P"/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/lisp-utils/defsystem.lisp"
+> 
+("../src/" "./" (MAKE::HOME-SUBDIRECTORY "lisp/systems/")
+ "/usr/local/lisp/Registry/")
+> 
+;;; Loading "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima.system"
+
+;  - Compiling defsystem "maxima" 
+;    - Compiling module "package" 
+;      - Compiling source file
+;        "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp"
+;;;
+;;; Compiling /workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp.
+;;; OPTIMIZE levels: Safety=2, Space=0, Speed=3, Debug=2
+;;;
+;;; End of Pass 1.
+;;; Internal error:
+;;;   ** Error code 1 when executing
+;;; (EXT:RUN-PROGRAM "gcc-5" ("-I." "-I/home/linuxbrew/.linuxbrew/Cellar/ecl/21.2.1_1/include/" "-I/home/linuxbrew/.linuxbrew/opt/gmp/include" "-I/home/linuxbrew/.linuxbrew/opt/libffi/include" "-I/home/linuxbrew/.linuxbrew/opt/bdw-gc/include" "-D_GNU_SOURCE" "-D_FILE_OFFSET_BITS=64" "-g" "-O2" "-fPIC" "-D_THREAD_SAFE" "-Dlinux" "-O2" "-c" "binary-ecl/maxima-package.c" "-o" "binary-ecl/maxima-package.o")):
+;;; exec: No such file or directory
+;      - Binary file binary-ecl/maxima-package.fas is old or does not exist. 
+;        Compile (and load) source file /workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp instead? y
+;      - Should I bother you if this happens again? y
+;      - Compiling source file
+;        "/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp"
+;;;
+;;; Compiling /workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/maxima-package.lisp.
+;;; OPTIMIZE levels: Safety=2, Space=0, Speed=3, Debug=2
+;;;
+;;; End of Pass 1.
+;;; Internal error:
+;;;   ** Error code 1 when executing
+;;; (EXT:RUN-PROGRAM "gcc-5" ("-I." "-I/home/linuxbrew/.linuxbrew/Cellar/ecl/21.2.1_1/include/" "-I/home/linuxbrew/.linuxbrew/opt/gmp/include" "-I/home/linuxbrew/.linuxbrew/opt/libffi/include" "-I/home/linuxbrew/.linuxbrew/opt/bdw-gc/include" "-D_GNU_SOURCE" "-D_FILE_OFFSET_BITS=64" "-g" "-O2" "-fPIC" "-D_THREAD_SAFE" "-Dlinux" "-O2" "-c" "binary-ecl/maxima-package.c" "-o" "binary-ecl/maxima-package.o")):
+;;; exec: No such file or directory
+;      - Loading binary file "binary-ecl/maxima-package.fas" 
+Condition of type: FILE-ERROR
+Filesystem error with pathname #P"/workspace/sagetrac-mirror/local/var/tmp/sage/build/maxima-5.45.0.p0/src/src/binary-ecl/maxima-package.fas".
+```

[mkoeppe]

comment:3

Use of linuxbrew is entirely untested; see #29159

[mkoeppe]

comment:4

The problem with ecl is clearly due to a broken ecl package in linuxbrew - it tries to use a nonexisting compiler.

[mkoeppe]

comment:5

Probably build/bin/sage-guess-package-system should be changed so that brew is only tested after the Linux package managers.

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

6bb485f	Do not install ecl from brew
1ea950d	Cleanup gitpod config
d792c6b	Add docs

[sagetrac-git]

Changed commit from bd1fe07 to d792c6b

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

1ae507d

Remove uunnecessary changes to sage-venv

[sagetrac-git]

Changed commit from d792c6b to 1ae507d

[tobiasdiez]

Changed work issues from Cleanup config, add vs extensions and add docs to none

[tobiasdiez]

comment:8

Thanks for the feedback. I've now removed the linuxbrew install of ecl and opened tickets for the other things. So this is now ready for review.