Rook ceph

Microk8s

microk8s addons repo update core

Uninstalling - note finalizer change

• https://rook.io/docs/rook/v1.12/Getting-Started/ceph-teardown/#troubleshooting

helm -n rook-ceph uninstall rook-ceph-cluster
helm -n rook-ceph uninstall rook-ceph
for CRD in $(kubectl get crd -n rook-ceph | awk '/ceph.rook.io/ {print $1}'); do     kubectl get -n rook-ceph "$CRD" -o name |     xargs -I {} kubectl patch -n rook-ceph {} --type merge -p '{"metadata":{"finalizers": []}}'; done

Install

helm upgrade --install --namespace rook-ceph rook-ceph rook-release/rook-ceph --set csi.kubeletDirPath="/var/snap/microk8s/common/var/lib/kubelet/"

helm upgrade --install --namespace rook-ceph rook-ceph-cluster \
   --set operatorNamespace=rook-ceph rook-release/rook-ceph-cluster --set cephBlockPoolsVolumeSnapshotClass.enabled="true" \
   --set-string cephBlockPoolsVolumeSnapshotClass.labels."velero\.io/csi-volumesnapshot-class=true"

Bump CPU

host=k8s1; lxc stop $host --force; lxc config set $host limits.cpu=16 limits.memory=32GB; lxc start $host

https://rook.io/v1.11/Storage-Configuration/Ceph-CSI/ceph-csi-snapshot/

https://github.com/ceph/ceph-csi/blob/devel/docs/snap-clone.md#create-rbd-snapshot-and-clone-volume

Add label to snapshot class

https://velero.io/docs/main/csi/

kubectl edit volumesnapshotclass ceph-block

add label

  velero.io/csi-volumesnapshot-class: "true"

Errors & Limitations

• https://github.com/rook/rook/issues/4699

Notes

https://github.com/rook/rook/issues/3203

http://www.xenonstack.com/blog/persistent-storage#:~:text=Ceph%20RBD%20is%20the%20block,pods%20at%20the%20same%20time.