ZFS

From UVOO Tech Wiki
Revision as of 22:52, 22 April 2019 by imported>Jeremy-busk
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

ZFS on Ubuntu 18.04

sudo apt-get install zfsutils-linux

vim /etc/default/zfs

ZFS_INITRD_POST_MODPROBE_SLEEP='15' # increase longer/shorter if needed 5-15
sudo update-initramfs -u
sudo update-grub

Setup zpool with cache/logs from vdevs

zpool create -f tank mirror sdd sde mirror sdf sdg mirror sdh sdi mirror sdj sdk
sudo zpool add tank mirror nvme2n1 nvme3n1
sudo zpool add tank log mirror nvme0n1 nvme1n1
sudo zpool add tank cache nvme2n1 nvme3n1

sys prep to have default docker and lxd on zfs datasets

sudo systemctl stop lxd lxd.socket
sudo rm -Rf /var/lib/lxd
sudo zfs create tank/lxd

sudo zfs create tank/lxd
sudo zfs set mountpoint=/var/lib/lxd tank/lxd
sudo zfs create tank/libvirt
sudo zfs set mountpoint=/var/lib/libvirt tank/libvirt
sudo zfs create tank/docker
sudo zfs set mountpoint=/var/lib/docker tank/docker
sudo zfs mount -a
sudo apt-get install docker-ce # after you setup from get docker site

install qemu-kvm libvirt

sudo apt-get install libguestfs-tools qemu-kvm libvirt-clients libvirt-daemon-system bridge-utils virt-manager lintian curl wget git

Other

sudo zpool import tank
sudo zfs mount -a
sudo apt-get -y install docker-ce

ZFS Trouble Shooting

nvme smart-log /dev/nvme0n1
nvme smart-log /dev/nvme3n1

both reported no errors

https://docs.huihoo.com/opensolaris/solaris-zfs-administration-guide/html/ch09s06.html

zpool clear ... didn't do anything

zpool status

errors: No known data errors

  pool: tank
 state: DEGRADED
status: One or more devices could not be used because the label is missing or
    invalid.  Sufficient replicas exist for the pool to continue
    functioning in a degraded state.
action: Replace the device using 'zpool replace'.
   see: http://zfsonlinux.org/msg/ZFS-8000-4J
  scan: none requested
config:

    NAME                     STATE     READ WRITE CKSUM
    tank                     DEGRADED     0     0     0
      mirror-0               ONLINE       0     0     0
        sdc                  ONLINE       0     0     0
        sdd                  ONLINE       0     0     0
      mirror-1               ONLINE       0     0     0
        sde                  ONLINE       0     0     0
        sdf                  ONLINE       0     0     0
      mirror-2               ONLINE       0     0     0
        sdg                  ONLINE       0     0     0
        sdh                  ONLINE       0     0     0
      mirror-3               ONLINE       0     0     0
        sdi                  ONLINE       0     0     0
        sdj                  ONLINE       0     0     0
    logs
      mirror-4               DEGRADED     0     0     0
        4221213393078321817  FAULTED      0     0     0  was /dev/nvme3n1
        nvme1n1              ONLINE       0     0     0
    cache
      nvme2n1                ONLINE       0     0     0
      nvme0n1                FAULTED      0     0     0  corrupted data


Use with caution. This example would be mirror

You could remove disk from cache and use that for mirror

zpool remove tank cache nvme0n1

replace drive using singular(not two dev names) command

zpool replace tank nvme3n1

auto used free nvme0n1 from pool if none available it may just replace itself

Failed Drives

ZFS Intent Log & ARC/L2Arch