Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DynamoDB: table exports #7839

Merged
merged 8 commits into from
Jul 28, 2024
Merged

Conversation

rita-cheung
Copy link
Contributor

Implemented 3 dynamodb functions:

  • export_table_to_point_in_time
  • list_export
  • describe_export

backup.append(json_item)
self.processed_bytes += len(json_item)
self.item_count = len(backup)
content = gzip_compress(json.dumps(backup).encode("utf-8"))
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this doesn't exactly match the way aws does the export - is this important?

self.s3_prefix = s3_prefix
self.status = "IN_PROGRESS"
self.export_format = export_format
self.export_type = export_type
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't built anything for incremental export, is what is exported important here? I'm not even sure how we would go about supporting incremental exports as we'd need to be taking snapshots of the table and everything's stored in memory so I've just left it to perform the same as the full export.

@bartonip
Copy link

@bblommers anything i can do to speed up this being merged?

@rita-cheung
Copy link
Contributor Author

@bblommers the tests should be fixed now

@bpandola
Copy link
Collaborator

@rita-cheung Looks like the linter is failing. Make sure to run make format

@rita-cheung
Copy link
Contributor Author

@bpandola fixed

Copy link

codecov bot commented Jul 28, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.36%. Comparing base (6f3a2ec) to head (5b6fc90).
Report is 56 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #7839      +/-   ##
==========================================
+ Coverage   94.34%   94.36%   +0.01%     
==========================================
  Files        1107     1114       +7     
  Lines       93980    94968     +988     
==========================================
+ Hits        88665    89613     +948     
- Misses       5315     5355      +40     
Flag Coverage Δ
servertests 29.16% <22.01%> (-0.16%) ⬇️
unittests 94.33% <100.00%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@rita-cheung
Copy link
Contributor Author

@bpandola I added some tests to improve code coverage

@bpandola
Copy link
Collaborator

@rita-cheung Thank you for this high-quality contribution to moto. Well done!

@bpandola bpandola added this to the 5.0.12 milestone Jul 28, 2024
@bpandola bpandola merged commit 81d226e into getmoto:master Jul 28, 2024
45 checks passed
Copy link
Contributor

This is now part of moto >= 5.0.12.dev42

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants