Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error on Apple M1 chip #167

Open
LysanderT opened this issue Sep 16, 2023 · 3 comments
Open

Error on Apple M1 chip #167

LysanderT opened this issue Sep 16, 2023 · 3 comments

Comments

@LysanderT
Copy link

when running python install.py --neurips23track filter --algorithm faiss and after waiting for 40 minutes, it finally output:

What's Next?
  View summary of image vulnerabilities and recommendations → docker scout quickview
Building algorithm images... with (1) processes
Building neurips23-filter-faiss...
docker build  --rm -t neurips23-filter-faiss -f neurips23/filter/faiss/Dockerfile .
[+] Building 1413.5s (8/15)                                                                                                                                  docker:desktop-linux
 => [internal] load build definition from Dockerfile                                                                                                                         0.0s
 => => transferring dockerfile: 990B                                                                                                                                         0.0s
 => [internal] load .dockerignore                                                                                                                                            0.0s
 => => transferring context: 103B                                                                                                                                            0.0s
 => [internal] load metadata for docker.io/library/neurips23:latest                                                                                                          0.0s
 => [ 1/11] FROM docker.io/library/neurips23                                                                                                                                 0.0s
 => [internal] load build context                                                                                                                                            0.0s
 => => transferring context: 4.86kB                                                                                                                                          0.0s
 => [ 2/11] RUN apt update && apt install -y wget swig                                                                                                                      22.7s
 => [ 3/11] RUN wget https://repo.anaconda.com/archive/Anaconda3-2023.03-0-Linux-x86_64.sh                                                                                1388.3s
 => ERROR [ 4/11] RUN bash Anaconda3-2023.03-0-Linux-x86_64.sh -b                                                                                                            2.3s
------
 > [ 4/11] RUN bash Anaconda3-2023.03-0-Linux-x86_64.sh -b:
0.163 PREFIX=/root/anaconda3
2.243 Unpacking payload ...
2.246 qemu-x86_64: Could not open '/lib64/ld-linux-x86-64.so.2': No such file or directory
------
Dockerfile:5
--------------------
   3 |     RUN apt update && apt install -y wget swig
   4 |     RUN wget https://repo.anaconda.com/archive/Anaconda3-2023.03-0-Linux-x86_64.sh
   5 | >>> RUN bash Anaconda3-2023.03-0-Linux-x86_64.sh -b
   6 |
   7 |     ENV PATH /root/anaconda3/bin:$PATH
--------------------
ERROR: failed to solve: process "/bin/sh -c bash Anaconda3-2023.03-0-Linux-x86_64.sh -b" did not complete successfully: exit code: 255


Install Status:
{'neurips23-filter-faiss': 'fail'}
@maumueller
Copy link
Collaborator

Could you try the suggested solutions here: https://stackoverflow.com/questions/71040681/qemu-x86-64-could-not-open-lib64-ld-linux-x86-64-so-2-no-such-file-or-direc? In particular, try adding --platform=linux/amd64 to our base image.

I'm not sure whether the whole setup will make much sense from a performance point of view, since you will emulate x86 on your ARM-based CPU, but for testing it should probably work.

@ingberam
Copy link
Collaborator

ingberam commented Oct 9, 2023

@LysanderT Confirming that the issue exists on my M1 laptop.
If what @maumueller suggested does not work, please let us know and we will try to come up with a way to run things locally on an M1 laptop for this track.
Also, I would suggest testing on a linux VM (and an intel CPU).

@cadurosar
Copy link
Contributor

Hey, just to say that at least for the sparse track --platform=linux/amd64 made it work (even if it is kinda slow). I can make a pull request later showing how I did it.

Also, I expect to send a pull request soon (hopefully tomorrow?) with our entry for the sparse track with 3 measurements to try to give you an idea of the differences (azure, my M1 and our best CPU server)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants