Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

importer simultaneously importing a large number of data files causes one layer to exit #219

Closed
dbacyj opened this issue Nov 18, 2022 · 3 comments
Assignees
Labels
process/fixed Process of bug type/bug Type: something is unexpected

Comments

@dbacyj
Copy link

dbacyj commented Nov 18, 2022

A total of more than 500 files,The error is as follows:
image

@yixinglu
Copy link
Contributor

seems related to #95

@veezhang could you help to debug this?

@veezhang
Copy link
Contributor

seems related to #95

@veezhang could you help to debug this?

👌

@veezhang
Copy link
Contributor

panic: send on closed channel

goroutine 241 [running]:
github.com/vesoft-inc/nebula-importer/pkg/reader.(*Batch).requestClient(0x400071a200)
        /home/runner/work/nebula-importer/nebula-importer/pkg/reader/batch.go:66 +0x128
github.com/vesoft-inc/nebula-importer/pkg/reader.(*Batch).Add(0x400071a200, 0x1, 0x40b0caeb60, 0x2, 0x2, 0x25)
        /home/runner/work/nebula-importer/nebula-importer/pkg/reader/batch.go:36 +0xc8
github.com/vesoft-inc/nebula-importer/pkg/reader.(*FileReader).Read(0x40001bc050, 0x0, 0x0, 0x0)
        /home/runner/work/nebula-importer/nebula-importer/pkg/reader/reader.go:166 +0x504
github.com/vesoft-inc/nebula-importer/pkg/cmd.(*Runner).Run.func2(0x40002998f0, 0x4000331080, 0x40001bc050, 0x40002001b0, 0x26)
        /home/runner/work/nebula-importer/nebula-importer/pkg/cmd/runner.go:74 +0x28
created by github.com/vesoft-inc/nebula-importer/pkg/cmd.(*Runner).Run
        /home/runner/work/nebula-importer/nebula-importer/pkg/cmd/runner.go:73 +0x5bc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
process/fixed Process of bug type/bug Type: something is unexpected
Projects
None yet
Development

No branches or pull requests

4 participants