Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Example setups with benchmarks #11

Open
AlexCheema opened this issue Jul 16, 2024 · 7 comments
Open

Example setups with benchmarks #11

AlexCheema opened this issue Jul 16, 2024 · 7 comments
Labels
documentation Improvements or additions to documentation

Comments

@AlexCheema
Copy link
Contributor

AlexCheema commented Jul 16, 2024 •
edited
Loading

Users want to know exactly which setups work, how to set them up, and what the benchmarks are.

A simple benchmark we can do is Mac Minis. We have 4 of them, so we can just progressively add Mac minis and measure the tok/sec.

Ref:

Screenshot 2024-07-16 at 09 11 37
@AlexCheema
Copy link
Contributor Author

Request: Raspberry Pi. We could bundle it with Coral USB TPU (https://coral.ai/products/) which could be super cost effective home ai inference.

Screenshot 2024-07-16 at 10 24 06

@AlexCheema
Copy link
Contributor Author

List of supported hardware:

Screenshot 2024-07-16 at 13 46 40

@AlexCheema
Copy link
Contributor Author

2x4090 on exo vs bunch of 4090s in one pc

IMG_0076

@audkar
Copy link

audkar commented Jul 17, 2024

We could bundle it with Coral USB TPU

Coral is a little bit hard to get nowadays

There is also this partnership https://www.raspberrypi.com/news/raspberry-pi-ai-kit-available-now-at-70/

@AlexCheema AlexCheema added the documentation Improvements or additions to documentation label Jul 18, 2024
@AlexCheema
Copy link
Contributor Author

The people want to know how fast it is.

IMG_7523

@AlexCheema
Copy link
Contributor Author

Screenshot 2024-07-19 at 02 22 29

@AlexCheema
Copy link
Contributor Author

IMG_0093

lipere123 pushed a commit to lipere123/exo that referenced this issue Oct 11, 2024
@risingsunomi
Merge pull request exo-explore#11 from risingsunomi/exo-fork-update
43a1f61 
Exo fork update
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@audkar @AlexCheema