Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not read/write the APPEND_REF key when calling write/append with incomplete=True on the V1 API #1937

Closed
alexowens90 opened this issue Oct 22, 2024 · 0 comments · Fixed by #1985
Assignees
Labels
bug Something isn't working

Comments

@alexowens90
Copy link
Collaborator

alexowens90 commented Oct 22, 2024

Calling write/append with incomplete=True eventually calls version_store.append_incomplete. This method reads the APPEND_REF key, modifies the next_key field of the TimeSeriesDescriptor, and then writes it back to storage again.
This is pointless, as compact_incompletes as accessible to users ignores the linked-list structure, and collects APPEND_DATA keys via iteration. In addition, in a truly parallel write/append, the linked list would not be in the correct order anyway.
Calling write with parallel=True does the correct thing. Namely, writing APPEND_DATA keys without touching the linked-list structure. Both write and append with incomplete=True should be modified to do the same thing.
The functionality to write linked-list structures of APPEND_DATA keys is useful for testing though, so this should be moved to the LibraryTool.

@alexowens90 alexowens90 added the bug Something isn't working label Oct 22, 2024
@alexowens90 alexowens90 changed the title Do not read/write the APPEND_REF key when calling append with incomplete=True on the V1 API Do not read/write the APPEND_REF key when calling write/append with incomplete=True on the V1 API Oct 22, 2024
@alexowens90 alexowens90 self-assigned this Nov 4, 2024
grusev pushed a commit that referenced this issue Nov 25, 2024
)

#### Reference Issues/PRs
Fixes #1937 

#### What does this implement or fix?
See ticket for details. Being able to create the append ref linked-list
structure is useful for testing, so moved this to the `LibraryTool`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant