Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: adds CELERY_BROKER_TRANSPORT_OPTIONS #410

Conversation

gabor-boros
Copy link
Member

@gabor-boros gabor-boros commented Sep 28, 2021

Description

Cherry-pick of https://github.com/edx/edx-platform/pull/28849

The release of Redis 6 introduced the ability to share this service among multiple accounts, securing the access to specific keys using a username/password and ACLs. Celery uses kombu to provide Redis brokering for the message queues, but kombu was missing a couple of key enhancements to support multi-tenant redis.

This PR allows to configure the broker transport options to enjoy the benefits of the above-mentioned updates.

Supporting information

OpenCraft wants to use multi-tenant Redis for their shared hosting service, so we can stop maintaining RabbitMQ.

Deadline

None

Other information

The initial PR that partially contained these changes: https://github.com/edx/edx-platform/pull/28020

Reviewers

which can be configured from the lms/studio environment

refactor: raise ImproperlyConfigured on TypeError
Signed-off-by: Gabor Boros <[email protected]>
Copy link
Member

@Agrendalath Agrendalath left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved in edx#28849.

Copy link
Member

@pomegranited pomegranited left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@pomegranited
Copy link
Member

@gabor-boros Your upstream change has been merged 🎉 so this one can be merged too.

@gabor-boros gabor-boros merged commit 84f7258 into opencraft-release/koa.3 Oct 1, 2021
@gabor-boros gabor-boros deleted the gabor/celery-broker-transport-opts-oc-koa3 branch October 1, 2021 06:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants