Skip to content

VDO for compression and deduplication? #12345

@morsik

Description

@morsik

Feature Request

VDO for storing container images.

Description

I have my current Kubernetes cluster configured in this way:

root@dhc-05 ~ # df -h | grep mapper
/dev/mapper/data-rook        7.8G  671M  6.8G   9% /var/lib/rook
/dev/mapper/data-containerd  503G   37G  441G   8% /var/lib/containerd
/dev/mapper/data-kubelet     503G  4.4M  478G   1% /var/lib/kubelet
root@dhc-05 ~ # lvs
  LV             VG   Attr       LSize   Pool           Origin Data%  Meta%  Move Log Cpy%Sync Convert
  containerd     data Vwi-aotz-- 512.00g vdodata_tpool0        10.65
  kubelet        data Vwi-aotz-- 512.00g vdodata_tpool0        1.82
  rook           data Vwi-aotz--   8.00g vdodata_tpool0        12.40
  vdodata_tpool0 data twi-aotz--   1.00t                       6.33   12.44
  vdopool        data dwi------- 800.00g                       4.53
root@dhc-05 ~ # vdostats --human-readable
Device                  Size      Used Available Use% Space saving%
data-vdopool-vpool    800.0G     80.1G    719.9G  10%           50%

It would be nice for Talos to also compress & deduplicate /var/lib/containerd (or whatever it uses) to save disk space. Many container images contain very similar software even when not sharing layers (due to slight updates to image), and compressing them saves a lot of disk space.

This could be just extension in Factory so people can choose this or not, but it may need additional commands to verify VDO usage and custom additional config.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions