Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

backup request可以支持下游错误率高于一定阈值时不生效吗? #2668

Open
NuttyNull opened this issue Jun 20, 2024 · 4 comments

Comments

@NuttyNull
Copy link

是不是可以一定程度防止雪崩?

@xiaoma2015
Copy link
Contributor

我们是对backuprequest做了优化处理,只允许x%的请求发起backuprequest,并且backuprequest的阈值不是固定值,而是跟随延时的P99或者P95一起波动

@icexin
Copy link

icexin commented Jul 3, 2024

我们是对backuprequest做了优化处理,只允许x%的请求发起backuprequest,并且backuprequest的阈值不是固定值,而是跟随延时的P99或者P95一起波动

有代码吗?这个需求挺常见的

@chenBright
Copy link
Contributor

容灾方面是不是可以全面一点?
(周期或者滑动窗口)统计请求的成功率,根据成功率可以做以下策略:

  1. lb选实例时,减少访问可用性弱的实例;
  2. 减少重试(包括backup request)。
  3. 其他,待补充。

@icexin
Copy link

icexin commented Jul 13, 2024

https://grpc.io/docs/guides/request-hedging/ grpc也有类似的请求策略,叫Hedged Request,为了防止雪崩,做了一个类似令牌的限制策略

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants