Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Too many duplicated tcp connections from aggregated apiserver to one member cluster #5574

Open
lcw2 opened this issue Sep 20, 2024 · 7 comments · May be fixed by #5615
Open

Too many duplicated tcp connections from aggregated apiserver to one member cluster #5574

lcw2 opened this issue Sep 20, 2024 · 7 comments · May be fixed by #5615
Assignees
Labels
kind/bug Categorizes issue or PR as related to a bug. kind/feature Categorizes issue or PR as related to a new feature.

Comments

@lcw2
Copy link

lcw2 commented Sep 20, 2024

What happened:
image
As the requests to access the aggregated API server increase, the number of connections will grow more, sometimes, the number of connection is 3000

What you expected to happen:
a hostIP should have a tcp connection

How to reproduce it (as minimally and precisely as possible):
Execute tosfedctl get pods requests concurrently, then monitor the number of connections.

Anything else we need to know?:
I think the root case is,

image

every reqeust will create a httptransport, so can't reuse a TCP connection.

Environment:

  • Karmada version: 0.9
  • kubectl-karmada or karmadactl version (the result of kubectl-karmada version or karmadactl version):
  • Others:
@lcw2 lcw2 added the kind/bug Categorizes issue or PR as related to a bug. label Sep 20, 2024
@lcw2 lcw2 changed the title too much deplicate tcp connection about same hostIP in aggregated apiserver pod too much deplicate tcp connections from aggragted-apiserver to one member cluster Sep 20, 2024
@lcw2 lcw2 changed the title too much deplicate tcp connections from aggragted-apiserver to one member cluster too much duplicated tcp connections from aggragted-apiserver to one member cluster Sep 20, 2024
@lcw2 lcw2 changed the title too much duplicated tcp connections from aggragted-apiserver to one member cluster Too many duplicated tcp connections from aggregated apiserver to one member cluster Sep 20, 2024
@XiShanYongYe-Chang
Copy link
Member

Hi @lcw2, thanks for your feedback. Would you like to try to modify the logic to reuse TCP connections?

In addition, can you provide your detailed test procedure, I want to test it too.

@lcw2
Copy link
Author

lcw2 commented Sep 21, 2024

run this script:
#!/bin/bash while true do karmadactl --kubeconfig xxxxxxx get pods sleep 0.1 done

  1. docker ps | grep aggregated-apiserver
  2. docker inspect $containerID | grep Pid
  3. nsenter -n -t $Pid
  4. netstat -anp | grep <IP of member's cluster >

@lcw2
Copy link
Author

lcw2 commented Sep 21, 2024

/assign lcw2

@XiShanYongYe-Chang
Copy link
Member

@lcw2 Thanks a lot~

@XiShanYongYe-Chang
Copy link
Member

/kind feature

@karmada-bot karmada-bot added the kind/feature Categorizes issue or PR as related to a new feature. label Sep 23, 2024
@yanfeng1992
Copy link
Member

ping @lcw2 Any progress?

@lcw2
Copy link
Author

lcw2 commented Sep 26, 2024

@yanfeng1992 I'm coding , wait some days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes issue or PR as related to a bug. kind/feature Categorizes issue or PR as related to a new feature.
Projects
Status: No status
Development

Successfully merging a pull request may close this issue.

4 participants