Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark operator refactor #170

Merged
merged 8 commits into from
Apr 3, 2023
Merged

Spark operator refactor #170

merged 8 commits into from
Apr 3, 2023

Conversation

vara-bonthu
Copy link
Collaborator

@vara-bonthu vara-bonthu commented Mar 31, 2023

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.

1/ Spark Operator refactor to use upstream EKS Module
2/ Addons updated with https://github.com/aws-ia/terraform-aws-eks-blueprints-addons module
3/ New add-ons sub module created only for Data on EKS Blueprints to avoid duplicating the code for commonly used add-ons workshop/modules/terraform-aws-eks-data-addons.
4/ Apache YuniKorn add-on update to 1.2.0
5/ Spark Operator add-n updated to latest version 1.1.27
6/ Spark Event logs Live UI added with ALB Controller and NGINX ingress

Closes #149

Motivation

More

  • Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
  • Mandatory for new blueprints. Yes, I have added a example to support my blueprint PR
  • Mandatory for new blueprints. Yes, I have updated the website/docs or website/blog section for this feature
  • Yes, I ran pre-commit run -a with this PR. Link for installing pre-commit locally

For Moderators

  • E2E Test successfully complete before merge?

Additional Notes

@vara-bonthu vara-bonthu temporarily deployed to DoEKS Test March 31, 2023 23:30 — with GitHub Actions Inactive
@vara-bonthu vara-bonthu temporarily deployed to DoEKS Test April 2, 2023 19:13 — with GitHub Actions Inactive
@vara-bonthu vara-bonthu marked this pull request as ready for review April 2, 2023 19:15
@vara-bonthu vara-bonthu requested a review from a team as a code owner April 2, 2023 19:15
@vara-bonthu vara-bonthu temporarily deployed to DoEKS Test April 2, 2023 19:23 — with GitHub Actions Inactive
Copy link
Contributor

@jihed jihed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@vara-bonthu vara-bonthu merged commit df38f29 into main Apr 3, 2023
@vara-bonthu vara-bonthu deleted the spark-operator-refactor branch April 3, 2023 10:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Rework] Migrate Spark Operator blueprint to use latest V5 EKS Blueprints
2 participants