Support write large checkpoint in Delta Lake

[chenjian2664]

Description

Close #25011

Additional context and related issues

Release notes

( ) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
(x) Release notes are required, with the following suggested text:

## Delta Lake
* Fix query failures when writing to delta tables. ({issue}`25011`)

[chenjian2664]

wondering how to add test

[raunaqmorarka]

wondering how to add test

Try adding a unit test which has sufficient entries to go over PageBuilder size threshold

[chenjian2664]

wondering how to add test

Try adding a unit test which has sufficient entries to go over PageBuilder size threshold

How to know the entries size is sufficient is enough or not, is 1k insert enough?
for instance:

        int size = 1024;
        try (TestTable table = newTrinoTable("test_large_checkpoint", "(data int) WITH (checkpoint_interval = %d)".formatted(size))) {
            for (int i = 0; i < size; i++) {
                System.out.println("current: " + i);
                assertUpdate("INSERT INTO " + table.getName() + " VALUES 1", 1);
            }

            assertQuery("SELECT COUNT(*) FROM " + table.getName(), "VALUES " + size);
        }

does it make sense?

[raunaqmorarka]

wondering how to add test

Try adding a unit test which has sufficient entries to go over PageBuilder size threshold

How to know the entries size is sufficient is enough or not, is 1k insert enough? for instance:

        int size = 1024;
        try (TestTable table = newTrinoTable("test_large_checkpoint", "(data int) WITH (checkpoint_interval = %d)".formatted(size))) {
            for (int i = 0; i < size; i++) {
                System.out.println("current: " + i);
                assertUpdate("INSERT INTO " + table.getName() + " VALUES 1", 1);
            }

            assertQuery("SELECT COUNT(*) FROM " + table.getName(), "VALUES " + size);
        }

does it make sense?

Just use a debugger to see when the page builder gets full and use some size significantly above that

[findinpath]

do we maybe need

try{
   flush();
} finally {
    writer.close();
}