Skip to content

[Improvement]: The time overhead for file deletion during maintenance is significant #2710

@xxubai

Description

@xxubai

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

Reduce the time overhead of deletion during maintenance (Mixed and Iceberg format)

How should we improve?

  1. Support SupportsBulkOperations if needed
  2. Batch delete files, it is very useful for S3 delete operations. refer to AWS: Add SupportBulkOperation interface. S3FileIO implementation will perform a batch deletion using RemoveObjects API iceberg#4052

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions