Microceph

Bootstrapping Microceph on LXD

https://github.com/canonical/microceph

https://microk8s.io/docs/how-to-ceph

https://canonical-microceph.readthedocs-hosted.com/en/latest/tutorial/multi-node/

bootstrap

sudo microceph cluster bootstrap
sudo microceph.ceph status
sudo microceph disk list
sudo microceph disk add --wipe /dev/disk/by-id/scsi-SQEMU_QEMU_HARDDISK_lxd_osd1

microceph cluster add microceph2
lxc shell microceph2
microceph cluster join <output from previous command>
sudo microceph disk add --wipe /dev/disk/by-id/scsi-SQEMU_QEMU_HARDDISK_lxd_osd1

Add new node 4 manually

sudo mkdir -p /tank/microceph
sudo truncate -s 1000G /tank/microceph/microceph4.osd1.img
lxc init ubuntu:22.04 microceph4 --vm -c limits.cpu=16 -c limits.memory=32GB
lxc config device override microceph4 root size=64GB
lxc config device add microceph4 osd1 disk source=/tank/microceph/microceph4.osd1.img
lxc start microceph4
lxc shell microceph4
sudo snap install microceph --channel=quincy/stable
sudo microceph cluster join <your token eyJuYW1lIjoib...==>
microceph disk list
sudo microceph disk add --wipe "/dev/disk/by-id/scsi-SQEMU_QEMU_HARDDISK_lxd_osd1"
microceph disk list

Get token from existing cluster member

microceph cluster add microceph4