feat: Implement mathematical modeling for streaming API timeouts

[BingqingLyu]

This PR addresses GitHub issue QwenLM#239 by implementing a comprehensive mathematical model for predicting and preventing streaming API timeouts. Key changes include:\n\n- Created StreamingTimeoutModel with adaptive timeout calculations based on request characteristics\n- Enhanced OpenAIContentGenerator with improved timeout handling and error messaging\n- Added CLI options for configuring timeout and retry behavior\n- Added configuration recommendations based on request analysis\n- Included comprehensive tests for the new timeout model\n- Added documentation explaining the modeling approach\n\nThe solution transforms a frustrating timeout issue into an opportunity for intelligent, adaptive system behavior that improves the user experience for large and complex requests.

[BingqingLyu]

Conflict Group 1

This PR shares modified functions with 15 other PR(s): #10, #112, #113, #114, #117, #14, #17, #18, #22, #31, #36, #46, #7, #86, #88.

These PRs should be reviewed as a batch — merging one may affect the others.

Function	File	Also modified by
parseApprovalModeValue	config.ts	#10, #112, #113, #114, #117, #22, #36, #46, #86, #88
parseArguments	config.ts	#10, #112, #113, #114, #117, #14, #17, #18, #22, #31, #36, #46, #7, #86, #88

graph LR
    PR21["PR #21"]
    FparseApprovalModeValue_6977["parseApprovalModeValue<br>config.ts"]
    PR21 -->|modifies| FparseApprovalModeValue_6977
    PR10["PR #10"]
    PR10 -->|modifies| FparseApprovalModeValue_6977
    PR112["PR #112"]
    PR112 -->|modifies| FparseApprovalModeValue_6977
    PR113["PR #113"]
    PR113 -->|modifies| FparseApprovalModeValue_6977
    PR114["PR #114"]
    PR114 -->|modifies| FparseApprovalModeValue_6977
    PR117["PR #117"]
    PR117 -->|modifies| FparseApprovalModeValue_6977
    PR22["PR #22"]
    PR22 -->|modifies| FparseApprovalModeValue_6977
    PR36["PR #36"]
    PR36 -->|modifies| FparseApprovalModeValue_6977
    PR46["PR #46"]
    PR46 -->|modifies| FparseApprovalModeValue_6977
    PR86["PR #86"]
    PR86 -->|modifies| FparseApprovalModeValue_6977
    PR88["PR #88"]
    PR88 -->|modifies| FparseApprovalModeValue_6977
    FparseArguments_6977["parseArguments<br>config.ts"]
    PR21 -->|modifies| FparseArguments_6977
    PR10 -->|modifies| FparseArguments_6977
    PR112 -->|modifies| FparseArguments_6977
    PR113 -->|modifies| FparseArguments_6977
    PR114 -->|modifies| FparseArguments_6977
    PR117 -->|modifies| FparseArguments_6977
    PR14["PR #14"]
    PR14 -->|modifies| FparseArguments_6977
    PR17["PR #17"]
    PR17 -->|modifies| FparseArguments_6977
    PR18["PR #18"]
    PR18 -->|modifies| FparseArguments_6977
    PR22 -->|modifies| FparseArguments_6977
    PR31["PR #31"]
    PR31 -->|modifies| FparseArguments_6977
    PR36 -->|modifies| FparseArguments_6977
    PR46 -->|modifies| FparseArguments_6977
    PR7["PR #7"]
    PR7 -->|modifies| FparseArguments_6977
    PR86 -->|modifies| FparseArguments_6977
    PR88 -->|modifies| FparseArguments_6977

Loading

---

Posted by codegraph-ai conflict detection.

[github-actions]

This pull request has had no activity for 60 days and is being marked as stale. It will be closed in another 30 days if no further activity occurs. To keep it open, push a new commit or leave a comment. Maintainers may apply pinned, status/blocked, status/on-hold, or status/ready-for-merge to exempt it from auto-close.