/me/sites times out for users with thousands of sites

[dsas]

Quick summary

See the parent issue for more information

/me/sites returns a HTTP 504 - gateway timeout for users with ~3000 sites.

/me/sites doesn't currently have pagination uggcf%3N%2S%2Suers.yv%2S%3Suggcf%3N%2S%2Sbcratebx.n8p.pbz%2Sfbhepr%2Skers%2Sjcpbz%2Schoyvp.ncv%2Serfg%2Sjcpbz%2Qwfba%2Qraqcbvagf%2Spynff.jcpbz%2Qwfba%2Qncv%2Qzr%2Qfvgrf%2Qraqcbvag.cuc%3Se%3Q5o812359%236-og It does have some performance instrumentation with statsd.

Steps to reproduce

1. Switch to the user mentioned in the first message here: p1732188303637839-slack-C07GZ2UA3TN
2. Open up developer tools and switch to the network tab
3. Go to /sites
4. In the network tab, filter for sites and wait

What you expected to happen

A list of sites

What actually happened

A HTTP 504

Impact

One

Available workarounds?

No and the platform is unusable

If the above answer is "Yes...", outline the workaround.

No response

Platform (Simple and/or Atomic)

No response

Logs or notes

No response

[github-actions]

OpenAI suggested the following labels for this issue:

• [Feature Group] Site Performance: The issue discusses a timeout problem, which is directly related to the performance of the site when users have a large number of sites.
• [Feature] API: The problem likely arises from server-side API calls when fetching a list of sites, indicating an issue with how the API handles large data sets.
• [Feature] User & Account Settings (/me): The /me/sites endpoint suggests that this issue pertains to user-specific settings or data retrieval.
• [Feature] Site Navigation: Navigating the site's content becomes problematic due to the timeout issue, affecting overall user experience.

[ouikhuan]

Hi @dsas, I'm following up on the conversation here: p1732188303637839-slack-C07GZ2UA3TN and also from the p2 post here: pfVjQF-qC-p2 where we mention we'll have a data request to find out more about that, so we can consider how to prioritise this issue. Before reaching out to data team, I'd like to double check with you and see if there's any conversations/p2 going on with the data team at the moment? Or it's fine for us to reach out to data team and do a request directly?

[dsas]

Haven't reached out yet @ouikhuan , it strikes me that it might have come up before but I haven't looked yet. I'm afk today but I'll look and ask tomorrow if no-one beats me to it.

[dsas]

Commented here: pfVjQF-qC-p2#comment-147

[github-actions]

Support References

This comment is automatically generated. Please do not edit it.

• pfVjQF-qC-p2#comment-147

[jordesign]

Adjusting this priority to Normal - as a good fix to have, but not affecting too many users.