Skip to content

[FS-1845] Deploy RabbitMQ on k8s for CI#3236

Merged
elland merged 54 commits intodevelopfrom
backend-notifications-begins
May 4, 2023
Merged

[FS-1845] Deploy RabbitMQ on k8s for CI#3236
elland merged 54 commits intodevelopfrom
backend-notifications-begins

Conversation

@akshaymankar
Copy link
Member

@akshaymankar akshaymankar commented Apr 19, 2023

The scope changed from the discussions. The work will now be split into two PRs, this one deals with CI infrastructure only, the next one incorporates it into Brig.

@akshaymankar akshaymankar changed the title Backend notifications begins Send onUserDeleteConnections notification using rabbitmq Apr 19, 2023
@zebot zebot added the ok-to-test Approved for running tests in CI, overrides not-ok-to-test if both labels exist label Apr 19, 2023
@elland elland force-pushed the backend-notifications-begins branch from 23b7a63 to 9cbefca Compare April 20, 2023 13:02
@fisx
Copy link
Contributor

fisx commented Apr 21, 2023

I'm a bit skeptical about making this a separate service. There is a lot of overlap between the code in federator and in notification-pusher (the requests that are currently going to federator will be pushed to the queue in some form by federator, and then picked up by notification-pusher, is that the plan? So the forwarding is currently done by federator, and will be done by notification-pusher in the future?). And I don't think scalability will become a problem if we do everything in one scalable service rather than several.

I am all for separating concerns, but I would prefer doing that using module boundaries rather than microservices.

@akshaymankar akshaymankar force-pushed the backend-notifications-begins branch from 337cba4 to 6fa2603 Compare April 24, 2023 11:09
@akshaymankar
Copy link
Member Author

I'm a bit skeptical about making this a separate service. There is a lot of overlap between the code in federator and in notification-pusher (the requests that are currently going to federator will be pushed to the queue in some form by federator, and then picked up by notification-pusher, is that the plan? So the forwarding is currently done by federator, and will be done by notification-pusher in the future?). And I don't think scalability will become a problem if we do everything in one scalable service rather than several.

I am all for separating concerns, but I would prefer doing that using module boundaries rather than microservices.

The idea is that this service will make calls to federator, which will do its thing as usual. The new service will not duplicate code in federator. The idea of why this service should be separate is simple: This is not an HTTP service, it is a background worker. There was a plan to make federator's internal service into haskell library and make federated calls directly from brig, galley and cargohold which follows the reasoning of not making another HTTP calls instead of a function call, but I am not sure why it was not followed. Even if we do that plan, I would say this new service should be running as a separate process as it not being an http server is significant enough change to warrant different scaling and process management.

@elland elland force-pushed the backend-notifications-begins branch from 7f4f7a6 to 48d1327 Compare April 25, 2023 07:35
Copy link
Contributor

@mdimjasevic mdimjasevic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's still a draft PR, but given that I was asked to review, I'd expect another change log apart from the one mentioning renaming in Helm charts.

@elland elland force-pushed the backend-notifications-begins branch from a6334da to f6f43ab Compare May 3, 2023 12:59
@elland elland force-pushed the backend-notifications-begins branch from c157d5b to e9a5812 Compare May 4, 2023 11:33
@elland elland changed the title Send onUserDeleteConnections notification using rabbitmq [FS-1845] Deploy RabbitMQ on k8s for CI May 4, 2023
@elland elland marked this pull request as ready for review May 4, 2023 12:15
@fisx fisx mentioned this pull request May 4, 2023
6 tasks
@elland elland merged commit fe9dad4 into develop May 4, 2023
@elland elland deleted the backend-notifications-begins branch May 4, 2023 14:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ok-to-test Approved for running tests in CI, overrides not-ok-to-test if both labels exist

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants