Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Smarter model downloading #16

Open
AlexCheema opened this issue Jul 17, 2024 · 1 comment
Open

Smarter model downloading #16

AlexCheema opened this issue Jul 17, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@AlexCheema
Copy link
Contributor

See: #14

Right now, every device downloads the entire model which is unnecessary. The design of exo makes things like this particularly difficult since all nodes are equal and p2p.
@AlexCheema AlexCheema mentioned this issue Jul 17, 2024
Closed
@AlexCheema AlexCheema added the enhancement New feature or request label Jul 18, 2024
@AlexCheema AlexCheema mentioned this issue Jul 19, 2024
Closed
AlexCheema added a commit that referenced this issue Jul 23, 2024
@AlexCheema
smart model downloading for mlx #16
3a230f3
AlexCheema added a commit that referenced this issue Jul 23, 2024
@AlexCheema
Revert "smart model downloading for mlx #16"
5496cd8 
This reverts commit 3a230f3.
This was referenced Jul 23, 2024
Closed
Open
@AlexCheema
Copy link
Contributor Author

Two things needed:

  1. Sticky node ids. (To keep shards sticky)
  2. Filter files to download based on shards.

This was referenced Jul 30, 2024
Open
Closed
AlexCheema added a commit that referenced this issue Jul 31, 2024
@AlexCheema
async model downloading with download progress. fixes #102. related: #16
d6a7e46 
 #104
AlexCheema added a commit that referenced this issue Jul 31, 2024
@AlexCheema
sticky node ids #16
0bfb8e3
AlexCheema added a commit that referenced this issue Aug 1, 2024
@AlexCheema
add support for selective model downloading. related: #16
4faa6c0
@AlexCheema AlexCheema mentioned this issue Aug 5, 2024
Merged
AlexCheema added a commit that referenced this issue Aug 7, 2024
@AlexCheema
make a separate ShardDownloader abstract class w HFShardDownloader. t…
476a714 
…his opens up plugging in different methods of downloading model shards e.g. #79 / #16
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
smart model downloading for mlx exo-explore#16
bc2ab3f
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
Revert "smart model downloading for mlx exo-explore#16"
435b13b 
This reverts commit bc2ab3f.
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
async model downloading with download progress. fixes exo-explore#102.…
d598613 
… related: exo-explore#16 exo-explore#104
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
sticky node ids exo-explore#16
e7ccbaa
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
add support for selective model downloading. related: exo-explore#16
2fb5845
dan-online pushed a commit to bytebolt-media/exo that referenced this issue Aug 28, 2024
@AlexCheema
make a separate ShardDownloader abstract class w HFShardDownloader. t…
709c57e 
…his opens up plugging in different methods of downloading model shards e.g. exo-explore#79 / exo-explore#16
lipere123 pushed a commit to lipere123/exo that referenced this issue Oct 11, 2024
@risingsunomi
Merge pull request exo-explore#16 from risingsunomi/pr139-dev-oct24
47ff4b3 
Pr139 dev oct24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AlexCheema