Skip to content

Fix chunksize bug for large cache size in data cache#1954

Merged
mattcary merged 3 commits into
kubernetes-sigs:masterfrom
Sneha-at:data-cache-bugs
Feb 27, 2025
Merged

Fix chunksize bug for large cache size in data cache#1954
mattcary merged 3 commits into
kubernetes-sigs:masterfrom
Sneha-at:data-cache-bugs

Conversation

@Sneha-at
Copy link
Copy Markdown
Contributor

@Sneha-at Sneha-at commented Feb 25, 2025

What type of PR is this?

Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:

/kind api-change
/kind bug
/kind cleanup
/kind design
/kind documentation
/kind failing-test
/kind feature
/kind flake

What this PR does / why we need it:
Data cache : Setting up caching would error out for large cache size as LVM has a limit on number of chunks that could be used, this PR fixes that issue by calculating dynamic cache size
Which issue(s) this PR fixes:

Fixes #
Internal error, unreleased feature
Special notes for your reviewer:

Does this PR introduce a user-facing change?:

NONE

@k8s-ci-robot k8s-ci-robot added release-note-none Denotes a PR that doesn't merit a release note. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. labels Feb 25, 2025
@k8s-ci-robot k8s-ci-robot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label Feb 25, 2025
@Sneha-at Sneha-at force-pushed the data-cache-bugs branch 2 times, most recently from 4e1cdf2 to 9310f46 Compare February 25, 2025 21:51
sunnylovestiramisu
sunnylovestiramisu reviewed Feb 25, 2025
View reviewed changes
Comment thread pkg/gce-pd-csi-driver/cache.go
sunnylovestiramisu
sunnylovestiramisu reviewed Feb 25, 2025
View reviewed changes
Comment thread pkg/gce-pd-csi-driver/cache.go
@k8s-ci-robot k8s-ci-robot added needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Feb 26, 2025
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Feb 26, 2025
sunnylovestiramisu
sunnylovestiramisu reviewed Feb 26, 2025
View reviewed changes
Comment thread pkg/gce-pd-csi-driver/cache_test.go
expChunkSize: "160KiB", //range defined in fetchChunkSizeKiB - min 160 KiB
expErr: true,
},
// cacheSize is validated in storage class parameter so assuming invalid cacheSize (like negative, 0) would not be passed to the function
Copy link
Copy Markdown
Contributor

@sunnylovestiramisu sunnylovestiramisu Feb 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does cacheSize in StorageClass has the >=0 check? In the past there were bugs in Hyperdisk SC parameters that actually take in < 0 params. Though an error will be returned from GCE.

@sunnylovestiramisu
Copy link
Copy Markdown
Contributor

sunnylovestiramisu commented Feb 26, 2025

/retest

sunnylovestiramisu
sunnylovestiramisu reviewed Feb 26, 2025
View reviewed changes
Comment thread pkg/common/utils.go Outdated
return fmt.Errorf("invalid data-cache-mode %s. Only \"writeback\" and \"writethrough\" is a valid input", s)
}

func ValidateDataCacheSize(size int64) error {
Copy link
Copy Markdown
Contributor

@sunnylovestiramisu sunnylovestiramisu Feb 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can be a more generic function like ValidateNonNegativeInt, it can be used in a few other places. "Input should be set to > 0, got %d".

Copy link
Copy Markdown
Contributor

@sunnylovestiramisu sunnylovestiramisu Feb 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And unit tests.

@sunnylovestiramisu
Copy link
Copy Markdown
Contributor

sunnylovestiramisu commented Feb 26, 2025

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 26, 2025
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

k8s-ci-robot commented Feb 26, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Sneha-at, sunnylovestiramisu

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 26, 2025
@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 26, 2025
@sunnylovestiramisu
Copy link
Copy Markdown
Contributor

sunnylovestiramisu commented Feb 26, 2025

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 26, 2025
@Sneha-at
Copy link
Copy Markdown
Contributor Author

Sneha-at commented Feb 26, 2025

/test pull-gcp-compute-persistent-disk-csi-driver-verify

@k8s-ci-robot
Copy link
Copy Markdown
Contributor

k8s-ci-robot commented Feb 26, 2025

@Sneha-at: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-gcp-compute-persistent-disk-csi-driver-e2e-windows-2019 e94c263 link false /test pull-gcp-compute-persistent-disk-csi-driver-e2e-windows-2019
pull-gcp-compute-persistent-disk-csi-driver-kubernetes-integration e94c263 link true /test pull-gcp-compute-persistent-disk-csi-driver-kubernetes-integration

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@Sneha-at
Copy link
Copy Markdown
Contributor Author

Sneha-at commented Feb 26, 2025

/test pull-gcp-compute-persistent-disk-csi-driver-kubernetes-integration

@mattcary
Copy link
Copy Markdown
Contributor

mattcary commented Feb 27, 2025

The k8s integration failure is only the known snapshot flake, I'll force-merge

@mattcary mattcary merged commit 58c8eaf into kubernetes-sigs:master Feb 27, 2025
@cemakd cemakd mentioned this pull request Jul 1, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sunnylovestiramisu sunnylovestiramisu sunnylovestiramisu left review comments

@songjiaxun songjiaxun Awaiting requested review from songjiaxun

Assignees

@sunnylovestiramisu sunnylovestiramisu

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. release-note-none Denotes a PR that doesn't merit a release note. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@Sneha-at @sunnylovestiramisu @k8s-ci-robot @mattcary