Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Precompilation doesn't mix with distribution anymore #22252

Closed
Keno opened this issue Jun 6, 2017 · 4 comments · Fixed by #22588
Closed

Precompilation doesn't mix with distribution anymore #22252

Keno opened this issue Jun 6, 2017 · 4 comments · Fixed by #22588
Labels
compiler:precompilation Precompilation of modules parallelism Parallel or distributed computation

Comments

@Keno
Copy link
Member

Keno commented Jun 6, 2017

I started julia for a distributed cluster using julia --machinefile [file]. However, I was unable to load any package, getting error messages like this from every node:

WARNING: Node state is inconsistent: node 10 failed to load cache from /home/juliaclusteradmin/.julia/lib/v0.6/Celeste.ji. Got:
WARNING: can only precompile from node 1

rsyncing my entire .julia to every node worked fine. However, the workers should be pulling the packages from node 1.
@ararslan ararslan added parallelism Parallel or distributed computation compiler:precompilation Precompilation of modules labels Jun 6, 2017
@andreasnoack
Copy link
Member

@vtjnash Any thoughts here? Basically, I cannot load any packages on workers that don't share the same package folder as the master. This also seems equally broken on 0.4 and 0.5. If I start all processes with --compilecache=no it works fine.

@vtjnash
Copy link
Sponsor Member

vtjnash commented Jun 27, 2017 •
edited
Loading

dup #22252

@vtjnash vtjnash closed this as completed Jun 27, 2017
@vtjnash vtjnash reopened this Jun 27, 2017
@vtjnash
Copy link
Sponsor Member

vtjnash commented Jun 27, 2017

I think the issue may have been resolved by #21695?

@andreasnoack
Copy link
Member

Just updated and I still see the issue.

@vtjnash vtjnash mentioned this issue Jun 28, 2017
Merged
@ararslan ararslan mentioned this issue Aug 17, 2018
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
compiler:precompilation Precompilation of modules parallelism Parallel or distributed computation
Projects
None yet
Milestone
No milestone
4 participants
@vtjnash @andreasnoack @Keno @ararslan