Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[error] writeRequests: Unable to truncate file: "/data/eventlog/000001.vlog" error: mremap size mismatch: requested: 1074437932 got: 2147483646 #97

Closed
atlas-comstock opened this issue Jun 3, 2022 · 2 comments
Closed

[error] writeRequests: Unable to truncate file: "/data/eventlog/000001.vlog" error: mremap size mismatch: requested: 1074437932 got: 2147483646 #97

atlas-comstock opened this issue Jun 3, 2022 · 2 comments

Comments

@atlas-comstock
Copy link
Collaborator

atlas-comstock commented Jun 3, 2022 •
edited
Loading

When instance ingesting SQS msg and compact to ORC file, it crashed after 20mins.

2022/06/03 07:11:57 [error] writeRequests: Unable to truncate file: "/data/eventlog/000001.vlog" error: mremap size mismatch: requested: 1074437932 got: 2147483646
2022/06/03 07:11:57 [error] ServerError: target=storage/disk/disk.go.160, reason=Internal Server Error, msg=unable to append due to Unable to truncate file: "/data/eventlog/000001.vlog" error: mremap size mismatch: requested: 1074437932 got: 2147483646
2022/06/03 07:13:14 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:13:14 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:13:14 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:14:14 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:14:14 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:14:14 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:15:14 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:15:14 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:15:14 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:16:14 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:16:14 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:16:14 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:17:15 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:17:15 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:17:15 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:18:15 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:18:15 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:18:15 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:19:15 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:19:15 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:19:15 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:20:15 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:20:15 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:20:15 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:21:16 [error] Unable to read: Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:21:16 [error] Key: [6 163 5 141 0 0 0 0 0 0 0 0 0 0 9 170], Version : 3208, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1202413 Offset:1043162081}
2022/06/03 07:21:16 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:22:06 [error] writeRequests: Unable to truncate file: "/data/eventlog/000002.vlog" error: mremap size mismatch: requested: 1074096225 got: 2147483646
2022/06/03 07:22:06 [error] ServerError: target=storage/disk/disk.go.160, reason=Internal Server Error, msg=unable to append due to Unable to truncate file: "/data/eventlog/000002.vlog" error: mremap size mismatch: requested: 1074096225 got: 2147483646
panic: runtime error: slice bounds out of range [1074096225:0]

goroutine 218270 [running]:
github.com/dgraph-io/badger/v3.(*valueLog).write.func2(0x403137e330, 0x403137e330, 0x40107e2120)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/value.go:826 +0x1bc
github.com/dgraph-io/badger/v3.(*valueLog).write(0x40003b33f8, 0x4083065f40, 0x1, 0xa, 0x0, 0x0)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/value.go:884 +0x388
github.com/dgraph-io/badger/v3.(*DB).writeRequests(0x40003b3200, 0x4083065f40, 0x1, 0xa, 0x1d94600, 0x0)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/db.go:816 +0x74
github.com/dgraph-io/badger/v3.(*DB).doWrites.func1(0x4083065f40, 0x1, 0xa)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/db.go:887 +0x4c
created by github.com/dgraph-io/badger/v3.(*DB).doWrites
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/db.go:940 +0x350
@atlas-comstock
Copy link
Collaborator Author 

2022/06/03 07:11:51 [error] writeRequests: Unable to truncate file: "/data/eventlog/000001.vlog" error: mremap size mismatch: requested: 1073911873 got: 2147483646
2022/06/03 07:11:51 [error] ServerError: target=storage/disk/disk.go.160, reason=Internal Server Error, msg=unable to append due to Unable to truncate file: "/data/eventlog/000001.vlog" error: mremap size mismatch: requested: 1073911873 got: 2147483646
2022/06/03 07:13:10 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:13:10 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:13:10 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:14:14 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:14:14 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:14:14 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:15:17 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:15:17 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:15:17 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:16:21 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:16:21 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:16:21 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:17:34 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:17:34 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:17:34 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:18:46 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:18:46 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:18:46 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:19:50 [error] Unable to read: Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 Error: file with ID: 1 not found
2022/06/03 07:19:50 [error] Key: [53 48 0 120 0 0 0 0 0 0 0 0 0 0 8 138], Version : 2828, meta: 66, userMeta: 0 valuePointer: {Fid:1 Len:1592503 Offset:1061259076}
2022/06/03 07:19:50 [error] ServerError: target=storage/compact/compact.go.102, reason=Internal Server Error, msg=compact: unable to read a buffer due to EOF
2022/06/03 07:20:01 [error] writeRequests: Unable to truncate file: "/data/eventlog/000002.vlog" error: mremap size mismatch: requested: 1074595673 got: 2147483646
2022/06/03 07:20:01 [error] ServerError: target=storage/disk/disk.go.160, reason=Internal Server Error, msg=unable to append due to Unable to truncate file: "/data/eventlog/000002.vlog" error: mremap size mismatch: requested: 1074595673 got: 2147483646
panic: runtime error: slice bounds out of range [1074595673:0]

goroutine 180032 [running]:
github.com/dgraph-io/badger/v3.(*valueLog).write.func2(0x4058cf5b00, 0x4058cf5b00, 0x4000288240)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/value.go:826 +0x1bc
github.com/dgraph-io/badger/v3.(*valueLog).write(0x40005d93f8, 0x40160cf680, 0x1, 0xa, 0x0, 0x0)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/value.go:884 +0x388
github.com/dgraph-io/badger/v3.(*DB).writeRequests(0x40005d9200, 0x40160cf680, 0x1, 0xa, 0x1d94600, 0x0)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/db.go:816 +0x74
github.com/dgraph-io/badger/v3.(*DB).doWrites.func1(0x40160cf680, 0x1, 0xa)
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/db.go:887 +0x4c
created by github.com/dgraph-io/badger/v3.(*DB).doWrites
        /go/pkg/mod/github.com/dgraph-io/badger/[email protected]/db.go:940 +0x350

@atlas-comstock atlas-comstock mentioned this issue Jun 6, 2022
Closed
@atlas-comstock
Copy link
Collaborator Author

Fix in #98

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@atlas-comstock