Running on network based CSI (rook-ceph)

[pavel1337]

Hi there, thanks for great software. I am considering running it for heavy load application. Do you have any suggestions on storage system for it? I have tried rook-ceph and it seems slow.

[ymmt2005]

We are using local SSD.
With moco, mysql can replicate data between servers so rook/ceph is not necessary.

[pavel1337]

My main concern is with scaling the storage. Using rook-ceph is kind of easy in this regard. I can separately add storage to ceph cluster, and then just increase capacity of PVC for moco mysqlcluster.

But I can't really come up with a plan on how to scale it with SSDs. So let's say I have 3 SSD 500GB each for 3 mysql instances. And after some time there is a need to increase this size up to 1TB. What would be the safest way to do this? My first thoughts are:

1. Change the capacity on mysqlcluster.spec.volumeClaimTemplates...
2. Remove pods/pvcs one by one so mysqlcluster recreates them within availble storage?

Do you have any ideas/experience with that?

[ymmt2005]

We are using TopoLVM (https://github.com/topolvm/topolvm) and pvc-autoresizer (https://github.com/topolvm/pvc-autoresizer) to
automatically create a LVM volume and extend it based on the remaining capacity.

[pavel1337]

Thanks! Will give it a try