feat: replicate persistent cache task when task needs persistent replicas

[gaius-qi]

Description

This pull request includes changes to the scheduler/resource/persistentcache package to add new functionalities and improve existing ones. The most important changes include adding a new method to load hosts randomly, modifying existing methods to use Redis transactions, and updating data types for task attributes.

New functionalities:

• scheduler/resource/persistentcache/host_manager.go: Added LoadRandom method to load hosts randomly through the set of Redis. [1] [2]
• scheduler/resource/persistentcache/peer_manager.go: Added LoadPersistentAllByTaskID method to return all persistent peers by task ID. [1] [2]
• scheduler/scheduling/scheduling.go: Implemented FindReplicatePersistentCacheHosts to find replicate persistent cache hosts for a task. [1] [2]

Improvements to existing methods:

• scheduler/resource/persistentcache/host_manager.go: Modified Store and Delete methods to use Redis transactions for better consistency. [1] [2]
• scheduler/resource/persistentcache/peer_manager.go: Updated Delete method to use Redis transactions.

Data type updates:

• scheduler/resource/persistentcache/task.go: Changed data types for PieceLength, ContentLength, and TotalPieceCount from int32/int64 to uint64/uint32. [1] [2]
• scheduler/resource/persistentcache/task_manager.go: Updated related methods to reflect the new data types. [1] [2] [3] [4]

Related Issue

Motivation and Context

Screenshots (if appropriate)

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• Documentation Update (if none of the other choices apply)

Checklist

• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.

[codecov]

Codecov Report

Attention: Patch coverage is 1.66205% with 355 lines in your changes missing coverage. Please review.

Project coverage is 34.34%. Comparing base (9320a7f) to head (855809e).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
scheduler/resource/persistentcache/host_manager.go	0.00%	109 Missing ⚠️
scheduler/scheduling/scheduling.go	2.80%	104 Missing ⚠️
scheduler/service/service_v2.go	0.00%	86 Missing ⚠️
scheduler/resource/persistentcache/peer_manager.go	0.00%	16 Missing ⚠️
scheduler/resource/persistentcache/task_manager.go	0.00%	11 Missing ⚠️
...uler/resource/persistentcache/host_manager_mock.go	0.00%	9 Missing ⚠️
...uler/resource/persistentcache/peer_manager_mock.go	0.00%	9 Missing ⚠️
scheduler/scheduling/mocks/scheduling_mock.go	0.00%	5 Missing ⚠️
...uler/resource/persistentcache/task_manager_mock.go	0.00%	4 Missing ⚠️
scheduler/scheduling/evaluator/evaluator_base.go	60.00%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3784      +/-   ##
==========================================
- Coverage   34.58%   34.34%   -0.25%     
==========================================
  Files         337      337              
  Lines       38549    38789     +240     
==========================================
- Hits        13332    13321      -11     
- Misses      24376    24625     +249     
- Partials      841      843       +2     

Flag	Coverage Δ
unittests	34.34% <1.66%> (-0.25%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
scheduler/resource/persistentcache/task.go	0.00% <ø> (ø)
scheduler/scheduling/evaluator/evaluator.go	68.88% <ø> (ø)
scheduler/scheduling/evaluator/evaluator_base.go	83.83% <60.00%> (ø)
...uler/resource/persistentcache/task_manager_mock.go	0.00% <0.00%> (ø)
scheduler/scheduling/mocks/scheduling_mock.go	44.61% <0.00%> (ø)
...uler/resource/persistentcache/host_manager_mock.go	40.35% <0.00%> (-7.57%)	⬇️
...uler/resource/persistentcache/peer_manager_mock.go	0.00% <0.00%> (ø)
scheduler/resource/persistentcache/task_manager.go	0.00% <0.00%> (ø)
scheduler/resource/persistentcache/peer_manager.go	0.00% <0.00%> (ø)
scheduler/service/service_v2.go	49.13% <0.00%> (-1.41%)	⬇️
... and 2 more

... and 3 files with indirect coverage changes