Loading 1GB of Json Data

[carsonch]

There are about 1 million documents in the JSON file and the script just fails to render the table. As a result Firefox crashed after loading for couple of seconds. Is there a solution by changing certain portions of the code or is the problem a limitation of the browser?

We really like your work and hope we can keep using your product for our big data project.

Thanks
Carson

[raaffaaeell]

Hello there carsonch, I don't know if you read about some issues here, but this one might give you some insights about your problem #36

Cheers, hope it helps.

[carsonch]

Thank you for your reply. I will try the solutions listed in that page.

Thanks
Carson

On Wed, Aug 20, 2014 at 6:35 PM, raaffaaeell [email protected]
wrote:

Hello there carsonch, I don't know if you read about some issues here, but
this one might give you some insights about your problem #36
#36

Cheers, hope it helps.

—
Reply to this email directly or view it on GitHub
#203 (comment)
.

[raysuelzer]

I know this isn't a productive comment, but I laughed out loud when I read this.

I will go out on a limb here and say that jQuery and Firefox are not the best tools to be manipulating, counting, and querying 1GB of data. Event Excel slows down at those file sizes. I'd love to be proven wrong.

[carsonch]

Well I agree with you, but when you are in a limited budget, you have to see what you can do to be cost efficient—
Sent from Mailbox

On Wed, Aug 27, 2014 at 7:17 PM, Raymond Suelzer [email protected]
wrote:

I know this isn't a productive comment, but I laughed out loud when I read this.

I will go out on a limb here and say that jQuery and Firefox are not the best tools to be manipulating, counting, and querying 1GB of data. Event Excel slows down at those file sizes. I'd love to be proven wrong.

Reply to this email directly or view it on GitHub:
#203 (comment)

[nicolaskruchten]

Unfortunately this is definitely a browser issue, and in fact many non-browser systems (R, SciPy, Excel) will also choke or slow down a lot manipulating a million-plus row dataset :(