Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BackupableDBTest.CorruptionsTest failed #66

Closed
FanShengzen opened this issue Jan 30, 2014 · 7 comments
Closed

BackupableDBTest.CorruptionsTest failed #66

FanShengzen opened this issue Jan 30, 2014 · 7 comments

Comments

@FanShengzen
Copy link

==== Test BackupableDBTest.CorruptionsTest
Created bg thread 0x2b414669c700
utilities/backupable/backupable_db_test.cc:588: Assertion failure file_manager_->FileExists(backupdir_ + "/meta/2")
#0 ./backupable_db_test() [0x41b38b] ~basic_string /usr/include/c++/4.8/bits/basic_string.h:539
#1 ./backupable_db_test() [0x41bff4] ~_Test_CorruptionsTest /home/jfan/dev/offlinedb/rocksdb/utilities/backupable/backupable_db_test.cc:522
#2 ./backupable_db_test() [0x4be6eb] rocksdb::test::RunAllTests() /home/jfan/dev/offlinedb/rocksdb/util/testharness.cc:46
#3 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x2b41460f6ed5] ?? ??:0
#4 ./backupable_db_test() [0x4132fe] _start ??:?

make: *** [check] Error 1

on Ubuntu 13.10 after resolved dependencies following instructions of INSTALL.md. Built successfully but unit test failed in above test.

@FanShengzen
Copy link
Author

The unit test code seems not self contained. Failure due to backupdir_+/meta/2 does not exist when assertion checked by unit test code.

@iamjinlei
Copy link

Did you run the test on the latest checkout?

@FanShengzen
Copy link
Author

Yes. It was check out two days ago. - Jerry

From: Lei Jin [mailto:[email protected]]
Sent: Thursday, January 30, 2014 12:29 PM
To: facebook/rocksdb
Cc: Jerry Fan
Subject: Re: [rocksdb] BackupableDBTest.CorruptionsTest failed (#66)

Did you run the test on the latest checkout?


Reply to this email directly or view it on GitHubhttps://github.com//issues/66#issuecomment-33710998.

@iamjinlei
Copy link

Can you rebase and try it again. There was an issue in the test that did not cover a case well. But that got fixed on Tuesday. So I guess you checked out the code before.

@yhchiang
Copy link
Contributor

Sure. I will rebase and try it again.

Sent from my iPhone

On Jan 30, 2014, at 10:07 AM, "Lei Jin" <[email protected]mailto:[email protected]> wrote:

Can you rebase and try it again. There was an issue in the test that did not cover a case well. But that got fixed on Tuesday. So I guess you checked out the code before.


Reply to this email directly or view it on GitHubhttps://urldefense.proofpoint.com/v1/url?u=https://github.com/facebook/rocksdb/issues/66%23issuecomment-33714996&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=D2aV7l4utNljq%2BUxgovK2w%3D%3D%0A&m=LfKO%2FLeU0fXUxZdVb8xRqmErgHbQtugqJSiD5UvEvNk%3D%0A&s=698d1de663f784d59350b40dd4016913b883b760547b5647457b14ccdf9f3390.

@FanShengzen
Copy link
Author

I will rebase and try it again.

From: Lei Jin [mailto:[email protected]]
Sent: Thursday, January 30, 2014 1:07 PM
To: facebook/rocksdb
Cc: Jerry Fan
Subject: Re: [rocksdb] BackupableDBTest.CorruptionsTest failed (#66)

Can you rebase and try it again. There was an issue in the test that did not cover a case well. But that got fixed on Tuesday. So I guess you checked out the code before.


Reply to this email directly or view it on GitHubhttps://github.com//issues/66#issuecomment-33714996.

@FanShengzen
Copy link
Author

After rebased, it works now. Issue closed.

DorianZheng pushed a commit to DorianZheng/rocksdb that referenced this issue Jan 18, 2019
* tools: use provided options instead of the default (facebook#4839)

Summary:
The current implementation hardcode the default options in different
places, which makes it impossible to support other environments (like
encrypted environment).
Pull Request resolved: facebook#4839

Differential Revision: D13573578

Pulled By: sagar0

fbshipit-source-id: 76b58b4b758902798d10ff2f52d9f39abff015e7

* Fix skip WAL for whole write_group when leader's callback fail (facebook#4838)

Summary:
The original implementation has two problems:

1. https://github.com/facebook/rocksdb/blob/f0dda35d7de1fd56e0b7c96376ca8aff2a6364fd/db/db_impl_write.cc#L478
https://github.com/facebook/rocksdb/blob/f0dda35d7de1fd56e0b7c96376ca8aff2a6364fd/db/write_thread.h#L231

If the callback status of leader of the write_group fails, then the whole write_group will not write to WAL, this may cause data loss.

2. https://github.com/facebook/rocksdb/blob/f0dda35d7de1fd56e0b7c96376ca8aff2a6364fd/db/write_thread.h#L130
The annotation says that Writer.status is the status of memtable inserter, but the original implementation use it for another case which is not consistent with the original design. Looks like we can still reuse Writer.status, but we should modify the annotation, so Writer.status is not only the status of memtable inserter.
Pull Request resolved: facebook#4838

Differential Revision: D13574070

Pulled By: yiwu-arbug

fbshipit-source-id: a2a2aefcfd329c4c6a91652bf090aaf1ce119c4b
ajkr pushed a commit to ajkr/rocksdb that referenced this issue Oct 29, 2019
facebook#5553)

Fixes facebook#66

This is a cherry-pick from Facebook's master.

Summary:
- Provide assignment operator in CompactionStats
- Provide a copy constructor for FileDescriptor
- Remove std::move from "return std::move(t)" in BoundedQueue
Pull Request resolved: facebook#5553

Differential Revision: D16230170

fbshipit-source-id: fd7c6e52390b2db1be24141e25649cf62424d078
Nazgolze pushed a commit to Nazgolze/rocksdb-1 that referenced this issue Sep 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants