[CLI] Fix cluster logs with over 5000 entries

[nmiculinic]

What does this PR do?

Fixes https://linear.app/lightning-ai/issue/GRID-10410/very-large-limits-say-10000-dont-work-error-400 partially.

Today if you try to fetch gridv1.Cluster logs in the CLI and want more than 5000 lines it'll brake due to internal limitations. This PR implements batching, thus we're fetching 5000 by 5000 log lines from the API server.

Does your PR introduce any breaking changes? If yes, please list them.

No

Before submitting

• Was this discussed/approved via a GitHub issue? (not for typos and docs)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure your PR does only one thing, instead of bundling different changes together?
• Did you make sure to update the documentation with your changes? (if necessary)
• Did you write any new necessary tests? (not for typos and docs)
• Did you verify new and existing tests pass locally with your changes?
• Did you list all the breaking changes introduced by this pull request?
• Did you update the CHANGELOG? (not for typos, docs, test updates, or minor internal changes/refactors)

PR review

Anyone in the community is welcome to review the PR.
Before you start reviewing, make sure you have read the review guidelines. In short, see the following bullet-list:

• Is this pull request ready for review? (if not, please submit in draft mode)
• Check that all items from Before submitting are resolved
• Make sure the title is self-explanatory and the description concisely explains the PR
• Add labels and milestones (and optionally projects) to the PR so it can be classified

Limitations

• if 2 log lines are on the same microsecond and on the batch boundary, the second one will be lost. This is rare to happen, thus it's going in. This is limitation for python datetime, since it works with microsecond and not nanosecond precision for timedelta.

Test plan

• CI
• Locally tested to fetch newly created n-020 cluster logs

Did you have fun?

Make sure you had fun coding 🙃

cc @Borda

[tchaton]

LGTM once last comments are addressed.

[nmiculinic]

This is blocked on prod release which support nanosecond precision timestamps for logs

[codecov]

Codecov Report

Merging #14458 (088e0ab) into master (692f0f3) will increase coverage by 1%.
The diff coverage is 33%.

❗ Current head 088e0ab differs from pull request most recent head bbfea2f. Consider uploading reports for the commit bbfea2f to get more accurate results

@@            Coverage Diff            @@
##           master   #14458     +/-   ##
=========================================
+ Coverage      84%      85%     +1%     
=========================================
  Files         391      327     -64     
  Lines       28306    25860   -2446     
=========================================
- Hits        23764    21945   -1819     
+ Misses       4542     3915    -627     

[dmitsf]

🚀