Bug when importing dataset exported previously (--new_uids flag fix this issue). #4996
Labels
area/import-export
Issues related to data import and export.
area/live-loader
Issues related to live loading.
area/performance
Performance related issues.
kind/bug
Something is broken.
status/accepted
We accept to investigate/work on it.
What version of Dgraph are you using?
v20.03.0-beta.20200320 (Local build, due #4995)
Have you tried reproducing the issue with the latest release?
Yes
What is the hardware spec (RAM, OS)?
macOS Catalina, 32GB of RAM
Steps to reproduce the issue (command/config used to run Dgraph).
1 - import the dataset
2 - export it (JSON and RDF, both tested equally)
3 - Create a new env and reimport the dataset exported.
At the time of the load, it goes well. However, over the course of seconds, the number of N-Quads/s drops dramatically to
0
. However, the load continues to log zero N-Quads/s. Even so, the system accuses that there is writing. Writing at 40 MB/s, but it doesn't finish. Until the moment I kill the load, the system continues to write at 40 MB/s.The way I temporarily resolved was to use the
--new_uids
flag. With this flag the load was extremely fast. Getting to do 103800 N-Quads/s. What was impressive, twice as performative as normal.When using the
--new_uids
flag, it makes me sure that the problem comes from the fact that we are using predefined UIDs instead of requesting new UIDs.Expected behaviour and actual result.
Expected
Actual
The text was updated successfully, but these errors were encountered: