Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance issue when writing large data #53

Closed
darkbaby123 opened this issue Nov 28, 2017 · 3 comments
Closed

Performance issue when writing large data #53

darkbaby123 opened this issue Nov 28, 2017 · 3 comments

Comments

@darkbaby123
Copy link

For some reason I need to generate a very large excel file, which has 700 cols and 13,000 rows. On my 4 core server it takes nearly 30 minutes to write file.

Because the file is created at the very end of the process (and is fast), I guess the bottle neck is on generating the XML in memory. But I'm not sure if it's an Elixir performance issue or this library's. I also have several steps to transform the data to %Worksheet{} (without stream), and it's very fast.

@unti1x
Copy link
Collaborator

unti1x commented Nov 29, 2017

Looks pretty similar to #22.

@darkbaby123
Copy link
Author

Is write_to_memory/2 used to generate excel without file writing? I'll try that. BTW can you recommend some ways to do benchmark in Elixir?

@unti1x
Copy link
Collaborator

unti1x commented Nov 29, 2017

Yep, that it is.
You can profile elixir app the same way as erlang or use something like ExProf.

@unti1x unti1x marked this as a duplicate of #22 Nov 30, 2017
@unti1x unti1x closed this as completed Nov 30, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants