-
Notifications
You must be signed in to change notification settings - Fork 2.6k
fix: serialization of pipeline_outputs in pipeline snapshot
#10096
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub. 1 Skipped Deployment
|
|
@Amnah199 this is technically a breaking change b/c existing pipeline snapshots would no longer be loadable right? |
…rialize-pipleine-outputs
|
@sjrl you are right! Its a breaking change. Do you think I should try to make it backward compatible and log a warning before we decide to remove that support in next releases? |
|
Not an expert on this topic, but I'll try to review... @Amnah199 let's make it backward compatible (if possible) and add tests to show existing pipeline snapshots are still loadable. |
Pull Request Test Coverage Report for Build 19826642961Warning: This coverage report may be inaccurate.This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.
Details
💛 - Coveralls |
sjrl
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me!
Remove temporary deserialization logic for old pipeline_outputs format in pipeline snapshots. This backward-compatibility layer was introduced in PR deepset-ai#10096 and marked for removal in Haystack 2.23.0. BREAKING CHANGE: Pipeline snapshots created before Haystack 2.17.0 will no longer deserialize correctly. Users must recreate snapshots with the current Haystack version or manually migrate to the new serialization schema. Changes: - Remove conditional deserialization check in Pipeline.run() - Remove test_load_pipeline_snapshot_with_old_pipeline_outputs_format test - Add breaking change documentation with migration instructions The new format uses 'serialization_schema' and 'serialized_data' fields, consistent with other pipeline state serialization. Closes deepset-ai#10168 Ref deepset-ai#10096
Remove temporary deserialization logic for old pipeline_outputs format in pipeline snapshots. This backward-compatibility layer was introduced in PR deepset-ai#10096 and marked for removal in Haystack 2.23.0. BREAKING CHANGE: Pipeline snapshots created before Haystack 2.17.0 will no longer deserialize correctly. Users must recreate snapshots with the current Haystack version or manually migrate to the new serialization schema. Changes: - Remove conditional deserialization check in Pipeline.run() - Remove test_load_pipeline_snapshot_with_old_pipeline_outputs_format test - Add breaking change documentation with migration instructions The new format uses 'serialization_schema' and 'serialized_data' fields, consistent with other pipeline state serialization. Closes deepset-ai#10168 Ref deepset-ai#10096
…at (#10249) Remove temporary deserialization logic for old pipeline_outputs format in pipeline snapshots. This backward-compatibility layer was introduced in PR #10096 and marked for removal in Haystack 2.23.0. BREAKING CHANGE: Pipeline snapshots created before Haystack 2.17.0 will no longer deserialize correctly. Users must recreate snapshots with the current Haystack version or manually migrate to the new serialization schema. Changes: - Remove conditional deserialization check in Pipeline.run() - Remove test_load_pipeline_snapshot_with_old_pipeline_outputs_format test - Add breaking change documentation with migration instructions The new format uses 'serialization_schema' and 'serialized_data' fields, consistent with other pipeline state serialization. Closes #10168 Ref #10096 Co-authored-by: Stefano Fiorucci <[email protected]>
Related Issues
pipeline_outputswhen creating aPipelineSnapshot#9872Proposed Changes:
pipeline_outputsin pipeline snapshot.pipeline_outputsfrom pipeline snapshot #10168How did you test it?
Updated tests
Locally tested with the example in the issue
Notes for the reviewer
Checklist
fix:,feat:,build:,chore:,ci:,docs:,style:,refactor:,perf:,test:and added!in case the PR includes breaking changes.