Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[juicefs] fix worker cache when set option #2563

Merged

Conversation

zwwhdls
Copy link
Member

@zwwhdls zwwhdls commented Feb 6, 2023

Signed-off-by: zwwhdls [email protected]

Ⅰ. Describe what this PR does

When set cache-dir in worker options, juicefs worker will use different caches with fuse pod, and mount cache-dir in hostPath.

Ⅱ. Does this pull request fix one issue?

fixes #2564

Ⅲ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

@codecov
Copy link

codecov bot commented Feb 6, 2023

Codecov Report

Merging #2563 (89b03ac) into master (7520dfd) will increase coverage by 0.09%.
The diff coverage is 84.41%.

@@            Coverage Diff             @@
##           master    #2563      +/-   ##
==========================================
+ Coverage   67.44%   67.54%   +0.09%     
==========================================
  Files         368      368              
  Lines       21319    21412      +93     
==========================================
+ Hits        14379    14462      +83     
- Misses       5247     5256       +9     
- Partials     1693     1694       +1     
Impacted Files Coverage Δ
pkg/ddc/juicefs/transform.go 70.83% <25.00%> (-2.70%) ⬇️
pkg/ddc/juicefs/transform_fuse.go 81.25% <25.00%> (-1.11%) ⬇️
pkg/ddc/juicefs/transform_volume.go 94.17% <91.30%> (-5.83%) ⬇️
pkg/ddc/eac/types.go 100.00% <0.00%> (ø)
api/v1alpha1/eacruntime_types.go 11.11% <0.00%> (ø)
pkg/ddc/eac/transform.go 61.97% <0.00%> (+2.28%) ⬆️
pkg/webhook/certificate_builder.go 84.09% <0.00%> (+4.54%) ⬆️
pkg/ddc/base/syncs.go 54.54% <0.00%> (+8.20%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@zwwhdls
Copy link
Member Author

zwwhdls commented Feb 6, 2023

/test fluid-e2e

- mountPath: /root/script
name: script
{{- range $name, $mount := .Values.cacheDirs }}
- name: cache-dir-{{ $name }}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update changelog and chart version. thanks.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@cheyang
Copy link
Collaborator

cheyang commented Feb 7, 2023

/lgtm
/approve

@fluid-e2e-bot
Copy link

fluid-e2e-bot bot commented Feb 7, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cheyang

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fluid-e2e-bot fluid-e2e-bot bot merged commit b8f6049 into fluid-cloudnative:master Feb 7, 2023
uniqueni pushed a commit to uniqueni/fluid that referenced this pull request Feb 8, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Feb 14, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Feb 18, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Feb 18, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
Signed-off-by: cheyang <[email protected]>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Mar 23, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Mar 23, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
Signed-off-by: cheyang <[email protected]>
cheyang added a commit that referenced this pull request Mar 27, 2023
* [juicefs] fix worker cache when set option (#2563)

* fix worker cache when set option

Signed-off-by: zwwhdls <[email protected]>

* update changelog in chart

Signed-off-by: zwwhdls <[email protected]>

* fix unittest

Signed-off-by: zwwhdls <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
Signed-off-by: cheyang <[email protected]>

* fix multi cache dir (#2639)

* fix multi cache dir

Signed-off-by: zwwhdls <[email protected]>

* fix unit test

---------

Signed-off-by: zwwhdls <[email protected]>
Signed-off-by: cheyang <[email protected]>

* [Enhancement]CSI plugin checks mount point liveness before binding mount points (#2703)

* Clean up broken mount point when NodeStageVolume

Signed-off-by: dongyun.xzh <[email protected]>

* Check mount point aliveness when NodePublishVolume

Signed-off-by: dongyun.xzh <[email protected]>

* Clean up broken mount point when NodeStageVolume

Signed-off-by: dongyun.xzh <[email protected]>

* Fix cleaning logic

Signed-off-by: dongyun.xzh <[email protected]>

---------

Signed-off-by: dongyun.xzh <[email protected]>
Signed-off-by: cheyang <[email protected]>

* Prettify error messages for exec.Commands in Fluid (#2718)

* Prettify error log message when calling NodePublishVolume

Signed-off-by: dongyun.xzh <[email protected]>

* Prettify error logs when calling helm-related funcs

Signed-off-by: dongyun.xzh <[email protected]>

* Use instead `errors.As`

Signed-off-by: dongyun.xzh <[email protected]>

* Use instead `errors.As`

Signed-off-by: dongyun.xzh <[email protected]>

* Set higher log level for helm exec

Signed-off-by: dongyun.xzh <[email protected]>

---------

Signed-off-by: dongyun.xzh <[email protected]>
Signed-off-by: cheyang <[email protected]>

* update mount to check mountinfo, To #48327952

Signed-off-by: cheyang <[email protected]>

* update mount to check mountinfo, To #48327952

Signed-off-by: cheyang <[email protected]>

* Build docker images for v0.8.5, To #48327952

Signed-off-by: cheyang <[email protected]>

---------

Signed-off-by: zwwhdls <[email protected]>
Signed-off-by: cheyang <[email protected]>
Signed-off-by: dongyun.xzh <[email protected]>
Co-authored-by: Weiwei <[email protected]>
Co-authored-by: TzZtzt <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Juice worker uses wrong cache when setting cache dir
2 participants