Skip to content

Improve the performance and validation of validate-fbc task#1953

Merged
arewm merged 2 commits into
konflux-ci:mainfrom
arewm:reduce-validate-fbc-resources
Feb 20, 2025
Merged

Improve the performance and validation of validate-fbc task#1953
arewm merged 2 commits into
konflux-ci:mainfrom
arewm:reduce-validate-fbc-resources

Conversation

@arewm

@arewm arewm commented Feb 18, 2025

Copy link
Copy Markdown
Member

Reduce the resources required for the validate-fbc task

The computation of differential related images has been improved by removing jq operations which require large arrays to be loaded.

related: konflux-ci/konflux-test#364

Improve validation handling for FBC

  • Check to make sure that a valid base image tag is found
  • Properly catch failure to retrieve differential base iamges

resolves: KONFLUX-6943

The computation of differential related images has been improved by
removing jq operations which require large arrays to be loaded.

related: konflux-ci/konflux-test#364

Signed-off-by: arewm <arewm@users.noreply.github.com>
@arewm arewm requested review from a team as code owners February 18, 2025 19:07
@arewm arewm changed the title Reduce the resources required for the validate-fbc task Improve the performance and validation of validate-fbc task Feb 18, 2025
@arewm arewm force-pushed the reduce-validate-fbc-resources branch from a9f6648 to 13f40af Compare February 18, 2025 20:43
@arewm arewm force-pushed the reduce-validate-fbc-resources branch from 13f40af to ca3a275 Compare February 19, 2025 04:54
@arewm arewm requested a review from a team as a code owner February 19, 2025 04:54
Comment thread .tekton/pull-request.yaml Outdated

@yashvardhannanavati yashvardhannanavati left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One minor comment. lgtm code wise!

@arewm arewm force-pushed the reduce-validate-fbc-resources branch 4 times, most recently from 37d974f to a6e779e Compare February 20, 2025 13:51
@arewm arewm removed the request for review from a team February 20, 2025 14:16
@arewm

arewm commented Feb 20, 2025

Copy link
Copy Markdown
Member Author

@konflux-ci/integration-service-maintainers @konflux-ci/operator-foundry , CI has now passed on this task update. Would you be able to review? We can work to further reduce the memory requirements in the future.

Do you want me to try to reduce the memory requirements as they are? I suspect that some FBC components might need more memory than others due to the size of their generated fragments and the number of related images (this will therefore also increase as the age of a catalog increases as the number of package versions and therefore the number of related images will increase).

@arewm arewm enabled auto-merge February 20, 2025 14:20
Comment thread task/validate-fbc/0.1/validate-fbc.yaml
Comment thread task/validate-fbc/0.1/validate-fbc.yaml Outdated
Comment thread task/validate-fbc/0.1/validate-fbc.yaml Outdated
@arewm arewm force-pushed the reduce-validate-fbc-resources branch from a6e779e to a16e461 Compare February 20, 2025 16:02
* Check to make sure that a valid base image tag is found
* Properly catch failure to retrieve differential base iamges

resolves: KONFLUX-6943

Signed-off-by: arewm <arewm@users.noreply.github.com>
@arewm arewm force-pushed the reduce-validate-fbc-resources branch from a16e461 to bbef1d4 Compare February 20, 2025 16:02
@arewm arewm added this pull request to the merge queue Feb 20, 2025
Merged via the queue into konflux-ci:main with commit ff27de0 Feb 20, 2025
@arewm arewm deleted the reduce-validate-fbc-resources branch February 20, 2025 18:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants