fix(usage): reap orphaned pending-request details (unbounded memory leak) - #4107

fix(usage): reap orphaned pending-request details (unbounded memory leak)#4107

diegosouzapw merged 3 commits into

cheaper-inference:release/v3.8.28cheaper-inference/OmniRoute:release/v3.8.28from

artickc:fix/usage-pending-requests-leakartickc/OmniRoute:fix/usage-pending-requests-leakCopy head branch name to clipboard