Differences between revisions 4 and 37 (spanning 33 versions)
Revision 4 as of 2017-10-10 22:27:42
Size: 739
Editor: shran
Comment:
Revision 37 as of 2024-01-29 20:16:56
Size: 2223
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
== KVM Host Disk Layout == = KVM Host Disk Layout =
Line 3: Line 3:
This disk layout has several layers. It uses btrfs on top of lvm on top of luks encryption on top of raid on top of the disks partitions This disk layout has several layers. It uses btrfs, on top of LVM, on top of luks encryption, on top of raid, on top of the disk partitions.
Line 5: Line 5:
=== KVM Host === == Hardware ==
Two 16G SSD disks are used for the KVM Host. Four 6T SATA disks are used for the KVM Guests filesystem images.

Mark your disks! Spend time finding your disks S/N. Put a physical sticker on the disk. In the future this will help you identify a failing disk.

=== KVM Host Disks ===
Line 11: Line 16:
sda1 256M
sda2 15360M
sda1 512M
sda2   512M
sda3
15360M
Line 15: Line 21:
sdb1 256M
sdb2 15360M
sdb1 512M
sdb2   512M
sdb3
15360M
Line 23: Line 30:
md1 raid1 (sda2, sdb2) md1 raid1 (sda3, sdb3)
Line 35: Line 42:
md1_crypt lvm (vg1) md1_crypt lvm (vg_system)
Line 38: Line 45:
==== LVM volumes ==== ==== LVM Volumes ====
Initially the swap partition was 256MM, but it ran full and was increased to 1G. That ran full as well, so a swap partition on the second volume was added too. It seems the KVM host happily swaps and will use many gigabytes of swap if the swap partition is there. The consequence is that the guests are slower to respond. So I recommend only swapping if you are really running out of memory.
Line 41: Line 49:
vg1 root 2G (/dev/vg1/root)
vg1 swap 512M (/dev/vg1/swap)
vg_system root 4G (/dev/vg_system/root)
vg_system swap 256M (/dev/vg_system/swap)
Line 45: Line 53:
==== Filesystems and mountpoints ==== ==== Filesystems and Mountpoints ====
I use btrfs myself, and have chosen this for its stability, but any modern filesystem should be sufficient.
Line 47: Line 57:
/dev/vg1/root / (btrfs)
/dev/md0 /boot (btrfs)
/dev/vg1/swap (swap)
/dev/vg_system/root / (btrfs)
/dev/md0       /boot (btrfs)
/dev/vg_system/swap (swap)
Line 51: Line 61:

=== KVM Host Disks for Guest Filesystem Images ===

==== Physical Disks and Partitions ====

kvm01:
{{{
sdc 3T
sdc1 2792G
...
}}}

kvm02:
{{{
sdc 6T
sdc1 5588G

sdd 6T
sdd1 5588G

sde 6T
sde1 5588G

sdf 6T
sdf1 5588G
}}}

==== Raid ====

{{{
md2 raid10 (sdc1, sdd1, sde1, sdf1)
}}}

==== Luks ====

{{{
md2 luks (md2_crypt)
}}}

==== LVM ====

{{{
md2_crypt lvm (vg_storage)
}}}

==== LVM Volumes ====

{{{
vg_storage media 4G (/dev/vg_storage/media)
}}}

==== Filesystems and Mountpoints ====
{{{
/dev/vg_storage/media /mnt/media (btrfs)
}}}

KVM Host Disk Layout

This disk layout has several layers. It uses btrfs, on top of LVM, on top of luks encryption, on top of raid, on top of the disk partitions.

Hardware

Two 16G SSD disks are used for the KVM Host. Four 6T SATA disks are used for the KVM Guests filesystem images.

Mark your disks! Spend time finding your disks S/N. Put a physical sticker on the disk. In the future this will help you identify a failing disk.

KVM Host Disks

Physical Disks and Partitions

sda     16G
sda1   512M
sda2   512M
sda3 15360M

sdb     16G
sdb1   512M
sdb2   512M
sdb3 15360M

Raid

md0 raid1 (sda1, sdb1)
md1 raid1 (sda3, sdb3)

Luks

md1 luks (md1_crypt)

LVM

md1_crypt lvm (vg_system)

LVM Volumes

Initially the swap partition was 256MM, but it ran full and was increased to 1G. That ran full as well, so a swap partition on the second volume was added too. It seems the KVM host happily swaps and will use many gigabytes of swap if the swap partition is there. The consequence is that the guests are slower to respond. So I recommend only swapping if you are really running out of memory.

vg_system root 4G   (/dev/vg_system/root)
vg_system swap 256M (/dev/vg_system/swap)

Filesystems and Mountpoints

I use btrfs myself, and have chosen this for its stability, but any modern filesystem should be sufficient.

/dev/vg_system/root /     (btrfs)
/dev/md0            /boot (btrfs)
/dev/vg_system/swap       (swap)

KVM Host Disks for Guest Filesystem Images

Physical Disks and Partitions

kvm01:

sdc     3T
sdc1 2792G
...

kvm02:

sdc     6T
sdc1 5588G

sdd     6T
sdd1 5588G

sde     6T
sde1 5588G

sdf     6T
sdf1 5588G

Raid

md2 raid10 (sdc1, sdd1, sde1, sdf1)

Luks

md2 luks (md2_crypt)

LVM

md2_crypt lvm (vg_storage)

LVM Volumes

vg_storage media 4G (/dev/vg_storage/media)

Filesystems and Mountpoints

/dev/vg_storage/media /mnt/media (btrfs)

None: KVM Host Disk Layout (last edited 2024-01-29 20:16:56 by Kristian Kallenberg)