blkid binary from >sys-apps/util-linux-2.33.2 no longer recognizes md-raid (linux-raid) device that is LUKS formatted. The result is failure to boot the system if the raid device is crypt_root (manually specificy /dev/mdXXX allows the system to continue to boot) and failure to list it with blkid while the system is running (lsblk lists it fine). Downgrading to =sys-apps/util-linux-2.33.2 fixes the issue. To note, the versions of util-linux that are greater than sys-apps/util-linux-2.33.2 were compiled with cryptsetup use flag but still failed to list the device. Info about raid array and the LUKS partition: # mdadm --detail --verbose /dev/md1 /dev/md1: Version : 1.2 Creation Time : Fri May 24 09:51:52 2019 Raid Level : raid1 Array Size : 167640064 (159.87 GiB 171.66 GB) Used Dev Size : 167640064 (159.87 GiB 171.66 GB) Raid Devices : 2 Total Devices : 2 Persistence : Superblock is persistent Update Time : Fri Sep 11 14:43:17 2020 State : active Active Devices : 2 Working Devices : 2 Failed Devices : 0 Spare Devices : 0 Consistency Policy : resync Name : della:1 UUID : 2f24d0e2:c5d528f5:a443c4ad:a25cab6d Events : 283545 Number Major Minor RaidDevice State 6 8 6 0 active sync /dev/sda6 2 8 22 1 active sync /dev/sdb6 # cryptsetup luksDump /dev/md1 LUKS header information for /dev/md1 Version: 1 Cipher name: aes Cipher mode: xts-plain64 Hash spec: sha256 Payload offset: 4096 MK bits: 512 Here is how blkid from =sys-apps/util-linux-2.33.2 lists the volume: # blkid | grep e1188 /dev/md1: UUID="e11887f5-4104-4a9e-9c53-7e1d904a0b28" TYPE="crypto_LUKS" Same command with any of the later versions of util-linux produces no output, though the device is there. Reproducible: Always Steps to Reproduce: 1. On a system that makes use of dm-raid and dm-crypt(cryptsetup), setup a raid1 array and format it in LUKS1 (version 1) format. 2. Upgrade util-linux to anything after version sys-apps/util-linux-2.33.2 3. run blkid and see how your dm-raid device is not listed in the output (but lsblk shows it for comparison) Actual Results: The assembled raid device is not visible to blkid utility. Expected Results: Even when running with versions greater than sys-apps/util-linux-2.33.2, blkid should continue to detect the raid device. Portage 3.0.4 (python 3.7.8-final-0, default/linux/amd64/17.1/desktop, gcc-10.2.0, glibc-2.31-r6, 5.8.7-gentoo-x86_64 x86_64) ================================================================= System uname: Linux-5.8.7-gentoo-x86_64-x86_64-Intel-R-_Xeon-R-_CPU_E5-1607_v3_@_3.10GHz-with-gentoo-2.7 KiB Mem: 32812056 total, 1172628 free KiB Swap: 8378364 total, 8331772 free Timestamp of repository gentoo: Fri, 11 Sep 2020 08:00:01 +0000 Head commit of repository gentoo: b3c035d4f5883f12deb1e704bfa8843cf7f2df3e sh bash 5.0_p18 ld GNU ld (Gentoo 2.33.1 p2) 2.33.1 distcc 3.3.3 x86_64-pc-linux-gnu [enabled] ccache version 3.7.11 [disabled] app-shells/bash: 5.0_p18::gentoo dev-java/java-config: 2.3.1::gentoo dev-lang/perl: 5.30.3::gentoo dev-lang/python: 2.7.18-r1::gentoo, 3.6.11-r2::gentoo, 3.7.8-r2::gentoo, 3.8.5::gentoo dev-util/ccache: 3.7.11::gentoo dev-util/cmake: 3.18.2::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.7::gentoo sys-apps/openrc: 0.42.1::gentoo sys-apps/sandbox: 2.18::gentoo sys-devel/autoconf: 2.13-r1::gentoo, 2.69-r5::gentoo sys-devel/automake: 1.11.6-r3::gentoo, 1.13.4-r2::gentoo, 1.16.1-r1::gentoo sys-devel/binutils: 2.33.1-r1::gentoo sys-devel/gcc: 10.2.0-r1::gentoo sys-devel/gcc-config: 2.3.1::gentoo sys-devel/libtool: 2.4.6-r6::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 5.4-r1::gentoo (virtual/os-headers) sys-libs/glibc: 2.31-r6::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 sync-rsync-extra-opts: sync-rsync-verify-max-age: 24 sync-rsync-verify-metamanifest: yes sync-rsync-verify-jobs: 1 nikolay_local location: /usr/local/portage masters: gentoo crossdev location: /usr/local/portage-crossdev masters: gentoo priority: 10 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="@FREE" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -march=haswell -mmmx -msse -msse2 -msse3 -mssse3 -mcx16 -msahf -mmovbe -maes -mpclmul -mpopcnt -mabm -mfma -mbmi -mbmi2 -mavx -mavx2 -msse4.2 -msse4.1 -mlzcnt -mrdrnd -mf16c -mfsgsbase -mfxsr -mxsave -mxsaveopt --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=10240 -mtune=haswell" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /etc/stunnel/stunnel.conf /usr/share/easy-rsa /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.2/ext-active/ /etc/php/apache2-php7.3/ext-active/ /etc/php/apache2-php7.4/ext-active/ /etc/php/cgi-php7.2/ext-active/ /etc/php/cgi-php7.3/ext-active/ /etc/php/cgi-php7.4/ext-active/ /etc/php/cli-php7.2/ext-active/ /etc/php/cli-php7.3/ext-active/ /etc/php/cli-php7.4/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O2 -pipe -march=haswell -mmmx -msse -msse2 -msse3 -mssse3 -mcx16 -msahf -mmovbe -maes -mpclmul -mpopcnt -mabm -mfma -mbmi -mbmi2 -mavx -mavx2 -msse4.2 -msse4.1 -mlzcnt -mrdrnd -mf16c -mfsgsbase -mfxsr -mxsave -mxsaveopt --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=10240 -mtune=haswell" DISTDIR="/usr/portage/distfiles" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distcc distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="https://mirror.leaseweb.com/gentoo/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo/" INSTALL_MASK="/usr/share/locale -/usr/share/locale/en" LANG="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j30 -l8" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl acpi alsa amd64 berkdb branding bzip2 cairo cdda cdr cli crypt cups dbus dri dts dvd dvdr elogind emboss encode exif flac gdbm gif gpm gtk gui iconv icu jpeg lcms libglvnd libnotify libtirpc mad mmx mng mp3 mp4 mpeg multilib ncurses nls nptl ogg opengl openmp pam pango pcre pdf png policykit ppds pulseaudio qt5 readline sdl seccomp spell split-usr sse sse2 ssl startup-notification svg tcpd tiff truetype udev udisks unicode upower usb vorbis wxwidgets x264 xattr xcb xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="mouse keyboard libinput" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python2_7 python3_7" QEMU_SOFTMMU_TARGETS="i386 x86_64 arm aarch64" QEMU_USER_TARGETS="arm aarch64" RUBY_TARGETS="ruby25" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
I cannot reproduce. I compared - blkid - lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID output between util-linux-2.33.2 and 2.36. Only difference is added "BLOCK_SIZE" in 2.36. > # blkid | grep cry > /dev/md127: UUID="6edcbea7-bb2c-4e22-9839-9f682f6fd51f" TYPE="crypto_LUKS" > > # mdadm --detail --verbose /dev/md127 > /dev/md127: > Version : 1.2 > Creation Time : Tue Jan 1 21:07:42 2013 > Raid Level : raid1 > Array Size : 20838311 (19.87 GiB 21.34 GB) > Used Dev Size : 20838311 (19.87 GiB 21.34 GB) > Raid Devices : 2 > Total Devices : 2 > Persistence : Superblock is persistent > > Update Time : Fri Sep 11 17:41:08 2020 > State : clean > Active Devices : 2 > Working Devices : 2 > Failed Devices : 0 > Spare Devices : 0 > > Consistency Policy : resync > > Name : setup:Bank > UUID : 0b135d52:ab241210:4144798f:025b1b94 > Events : 1295 > > Number Major Minor RaidDevice State > 0 8 2 0 active sync /dev/sda2 > 1 8 18 1 active sync /dev/sdb2 > Please post full output of `blkid` and `lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID` for both util-linux versions. Also post `emerge --info sys-apps/util-linux | tail -n 8` output.
Just for completeness, > # cryptsetup luksDump /dev/md127 > LUKS header information for /dev/md127 > > Version: 1 > Cipher name: aes > Cipher mode: xts-plain64 > Hash spec: sha512 > Payload offset: 4096 > MK bits: 512 > [...]
Hi Thomas, This may be some isolated corner case with this specific device and perhaps the version of the utils it was built with, here is the information you have requested: === util-linux-2.33.2 === blkid: /dev/sda1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01" /dev/sda3: UUID="82fe17dd-375e-47e6-933b-cdfe36b820d7" TYPE="crypto_LUKS" PARTUUID="95c9cb16-03" /dev/sda5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="3fe60d75-881f-1e44-8e4c-f073dc545342" TYPE="linux_raid_member" PARTUUID="95c9cb16-05" /dev/sda6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="fe71b6a8-d685-e50b-61d8-546f1122fe6f" TYPE="linux_raid_member" PARTUUID="95c9cb16-06" /dev/sda7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="599ab990-1a8e-dcc5-7e78-966d67cbeab8" TYPE="linux_raid_member" PARTUUID="95c9cb16-07" /dev/sdb1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01" /dev/sdb5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="21deb9af-76af-a43b-8aae-b7194217bd7b" TYPE="linux_raid_member" PARTUUID="95c9cb16-05" /dev/sdb6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="660cd809-687b-04c8-3c52-548f2bf7a8fb" TYPE="linux_raid_member" PARTUUID="95c9cb16-06" /dev/sdb7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="6f871b3e-8e0c-9aaf-a428-25e7cad51a0b" TYPE="linux_raid_member" PARTUUID="95c9cb16-07" /dev/sdc: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="4bdc8ac3-958a-920e-0154-c34159247cf4" TYPE="linux_raid_member" /dev/md0: UUID="156bec29-8040-442d-94db-91f8c92bd90e" TYPE="ext4" /dev/sdd: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="55626bcf-63b1-3f7a-7385-739f201054e6" TYPE="linux_raid_member" /dev/md127: UUID="84487b92-c275-4438-8284-1b085721bc7e" TYPE="swap" /dev/md1: UUID="e11887f5-4104-4a9e-9c53-7e1d904a0b28" TYPE="crypto_LUKS" /dev/md126: UUID="12af8fd4-7c2e-4161-b510-ea94698d2dec" TYPE="crypto_LUKS" /dev/md125: UUID="8ca5be35-9c99-4332-bd83-4a017c3098ac" TYPE="crypto_LUKS" /dev/mapper/root: UUID="57e79155-c611-46c7-9c2c-867256a55d5d" TYPE="ext4" /dev/mapper/wscryptdata: UUID="efff5332-04af-452d-9677-b8469f66e7bf" TYPE="ext4" /dev/mapper/wscryptssdp3: UUID="158ea560-15f3-4ab7-8a66-5f08d3e0ca9b" TYPE="vdo" /dev/mapper/wscryptssd: UUID="0acc0360-c278-470f-95b9-5a582c3f823e" TYPE="vdo" /dev/mapper/vdo_wscryptssd: UUID="fbae96cf-9328-4824-b340-1c7e12910559" TYPE="ext4" /dev/mapper/vdo_wscryptssdp3: UUID="15a01a20-7843-4ad7-9758-bdcba460f9fb" TYPE="ext4" lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID: NAME KNAME FSTYPE PARTUUID UUID sda sda ├─sda1 sda1 linux_raid_member 95c9cb16-01 518ffed5-9c69-6d67-56a8-912f4a2054b8 │ └─md0 md0 ext4 156bec29-8040-442d-94db-91f8c92bd90e ├─sda2 sda2 95c9cb16-02 ├─sda3 sda3 crypto_LUKS 95c9cb16-03 82fe17dd-375e-47e6-933b-cdfe36b820d7 │ └─wscryptssdp3 dm-2 vdo 158ea560-15f3-4ab7-8a66-5f08d3e0ca9b │ └─vdo_wscryptssdp3 dm-5 ext4 15a01a20-7843-4ad7-9758-bdcba460f9fb ├─sda5 sda5 linux_raid_member 95c9cb16-05 e9fefec9-3ecc-2035-0438-8184f47798f7 │ └─md127 md127 swap 84487b92-c275-4438-8284-1b085721bc7e ├─sda6 sda6 linux_raid_member 95c9cb16-06 2f24d0e2-c5d5-28f5-a443-c4ada25cab6d │ └─md1 md1 crypto_LUKS e11887f5-4104-4a9e-9c53-7e1d904a0b28 │ └─root dm-0 ext4 57e79155-c611-46c7-9c2c-867256a55d5d └─sda7 sda7 linux_raid_member 95c9cb16-07 514d5aa7-9451-1cbc-3bc0-a391f9a75956 └─md126 md126 crypto_LUKS 12af8fd4-7c2e-4161-b510-ea94698d2dec └─wscryptssd dm-3 vdo 0acc0360-c278-470f-95b9-5a582c3f823e └─vdo_wscryptssd dm-4 ext4 fbae96cf-9328-4824-b340-1c7e12910559 sdb sdb ├─sdb1 sdb1 linux_raid_member 95c9cb16-01 518ffed5-9c69-6d67-56a8-912f4a2054b8 │ └─md0 md0 ext4 156bec29-8040-442d-94db-91f8c92bd90e ├─sdb2 sdb2 95c9cb16-02 ├─sdb5 sdb5 linux_raid_member 95c9cb16-05 e9fefec9-3ecc-2035-0438-8184f47798f7 │ └─md127 md127 swap 84487b92-c275-4438-8284-1b085721bc7e ├─sdb6 sdb6 linux_raid_member 95c9cb16-06 2f24d0e2-c5d5-28f5-a443-c4ada25cab6d │ └─md1 md1 crypto_LUKS e11887f5-4104-4a9e-9c53-7e1d904a0b28 │ └─root dm-0 ext4 57e79155-c611-46c7-9c2c-867256a55d5d └─sdb7 sdb7 linux_raid_member 95c9cb16-07 514d5aa7-9451-1cbc-3bc0-a391f9a75956 └─md126 md126 crypto_LUKS 12af8fd4-7c2e-4161-b510-ea94698d2dec └─wscryptssd dm-3 vdo 0acc0360-c278-470f-95b9-5a582c3f823e └─vdo_wscryptssd dm-4 ext4 fbae96cf-9328-4824-b340-1c7e12910559 sdc sdc linux_raid_member ec81b49e-b5c7-688f-c10b-1bb755dd1e25 └─md125 md125 crypto_LUKS 8ca5be35-9c99-4332-bd83-4a017c3098ac └─wscryptdata dm-1 ext4 efff5332-04af-452d-9677-b8469f66e7bf sdd sdd linux_raid_member ec81b49e-b5c7-688f-c10b-1bb755dd1e25 └─md125 md125 crypto_LUKS 8ca5be35-9c99-4332-bd83-4a017c3098ac └─wscryptdata dm-1 ext4 efff5332-04af-452d-9677-b8469f66e7bf === util-linux-2.36 === blkid: /dev/sda1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01" /dev/sda3: UUID="82fe17dd-375e-47e6-933b-cdfe36b820d7" TYPE="crypto_LUKS" PARTUUID="95c9cb16-03" /dev/sda5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="3fe60d75-881f-1e44-8e4c-f073dc545342" TYPE="linux_raid_member" PARTUUID="95c9cb16-05" /dev/sda6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="fe71b6a8-d685-e50b-61d8-546f1122fe6f" TYPE="linux_raid_member" PARTUUID="95c9cb16-06" /dev/sda7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="599ab990-1a8e-dcc5-7e78-966d67cbeab8" TYPE="linux_raid_member" PARTUUID="95c9cb16-07" /dev/sdb1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01" /dev/sdb5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="21deb9af-76af-a43b-8aae-b7194217bd7b" TYPE="linux_raid_member" PARTUUID="95c9cb16-05" /dev/sdb6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="660cd809-687b-04c8-3c52-548f2bf7a8fb" TYPE="linux_raid_member" PARTUUID="95c9cb16-06" /dev/sdb7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="6f871b3e-8e0c-9aaf-a428-25e7cad51a0b" TYPE="linux_raid_member" PARTUUID="95c9cb16-07" /dev/sdc: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="4bdc8ac3-958a-920e-0154-c34159247cf4" TYPE="linux_raid_member" /dev/md0: UUID="156bec29-8040-442d-94db-91f8c92bd90e" BLOCK_SIZE="1024" TYPE="ext4" /dev/sdd: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="55626bcf-63b1-3f7a-7385-739f201054e6" TYPE="linux_raid_member" /dev/md127: UUID="84487b92-c275-4438-8284-1b085721bc7e" TYPE="swap" /dev/md126: UUID="12af8fd4-7c2e-4161-b510-ea94698d2dec" TYPE="crypto_LUKS" /dev/md125: UUID="8ca5be35-9c99-4332-bd83-4a017c3098ac" TYPE="crypto_LUKS" /dev/mapper/root: UUID="57e79155-c611-46c7-9c2c-867256a55d5d" BLOCK_SIZE="4096" TYPE="ext4" /dev/mapper/wscryptdata: UUID="efff5332-04af-452d-9677-b8469f66e7bf" BLOCK_SIZE="4096" TYPE="ext4" /dev/mapper/wscryptssdp3: UUID="158ea560-15f3-4ab7-8a66-5f08d3e0ca9b" TYPE="vdo" /dev/mapper/wscryptssd: UUID="0acc0360-c278-470f-95b9-5a582c3f823e" TYPE="vdo" /dev/mapper/vdo_wscryptssd: UUID="fbae96cf-9328-4824-b340-1c7e12910559" BLOCK_SIZE="4096" TYPE="ext4" /dev/mapper/vdo_wscryptssdp3: UUID="15a01a20-7843-4ad7-9758-bdcba460f9fb" BLOCK_SIZE="4096" TYPE="ext4" lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID: NAME KNAME FSTYPE PARTUUID UUID sda sda ├─sda1 sda1 linux_raid_member 95c9cb16-01 518ffed5-9c69-6d67-56a8-912f4a2054b8 │ └─md0 md0 ext4 156bec29-8040-442d-94db-91f8c92bd90e ├─sda2 sda2 95c9cb16-02 ├─sda3 sda3 crypto_LUKS 95c9cb16-03 82fe17dd-375e-47e6-933b-cdfe36b820d7 │ └─wscryptssdp3 dm-2 vdo 158ea560-15f3-4ab7-8a66-5f08d3e0ca9b │ └─vdo_wscryptssdp3 dm-5 ext4 15a01a20-7843-4ad7-9758-bdcba460f9fb ├─sda5 sda5 linux_raid_member 95c9cb16-05 e9fefec9-3ecc-2035-0438-8184f47798f7 │ └─md127 md127 swap 84487b92-c275-4438-8284-1b085721bc7e ├─sda6 sda6 linux_raid_member 95c9cb16-06 2f24d0e2-c5d5-28f5-a443-c4ada25cab6d │ └─md1 md1 crypto_LUKS e11887f5-4104-4a9e-9c53-7e1d904a0b28 │ └─root dm-0 ext4 57e79155-c611-46c7-9c2c-867256a55d5d └─sda7 sda7 linux_raid_member 95c9cb16-07 514d5aa7-9451-1cbc-3bc0-a391f9a75956 └─md126 md126 crypto_LUKS 12af8fd4-7c2e-4161-b510-ea94698d2dec └─wscryptssd dm-3 vdo 0acc0360-c278-470f-95b9-5a582c3f823e └─vdo_wscryptssd dm-4 ext4 fbae96cf-9328-4824-b340-1c7e12910559 sdb sdb ├─sdb1 sdb1 linux_raid_member 95c9cb16-01 518ffed5-9c69-6d67-56a8-912f4a2054b8 │ └─md0 md0 ext4 156bec29-8040-442d-94db-91f8c92bd90e ├─sdb2 sdb2 95c9cb16-02 ├─sdb5 sdb5 linux_raid_member 95c9cb16-05 e9fefec9-3ecc-2035-0438-8184f47798f7 │ └─md127 md127 swap 84487b92-c275-4438-8284-1b085721bc7e ├─sdb6 sdb6 linux_raid_member 95c9cb16-06 2f24d0e2-c5d5-28f5-a443-c4ada25cab6d │ └─md1 md1 crypto_LUKS e11887f5-4104-4a9e-9c53-7e1d904a0b28 │ └─root dm-0 ext4 57e79155-c611-46c7-9c2c-867256a55d5d └─sdb7 sdb7 linux_raid_member 95c9cb16-07 514d5aa7-9451-1cbc-3bc0-a391f9a75956 └─md126 md126 crypto_LUKS 12af8fd4-7c2e-4161-b510-ea94698d2dec └─wscryptssd dm-3 vdo 0acc0360-c278-470f-95b9-5a582c3f823e └─vdo_wscryptssd dm-4 ext4 fbae96cf-9328-4824-b340-1c7e12910559 sdc sdc linux_raid_member ec81b49e-b5c7-688f-c10b-1bb755dd1e25 └─md125 md125 crypto_LUKS 8ca5be35-9c99-4332-bd83-4a017c3098ac └─wscryptdata dm-1 ext4 efff5332-04af-452d-9677-b8469f66e7bf sdd sdd linux_raid_member ec81b49e-b5c7-688f-c10b-1bb755dd1e25 └─md125 md125 crypto_LUKS 8ca5be35-9c99-4332-bd83-4a017c3098ac └─wscryptdata dm-1 ext4 efff5332-04af-452d-9677-b8469f66e7bf === emerge --info sys-apps/util-linux | tail -n 8 === sys-apps/util-linux-2.36::gentoo was built with the following: USE="caps cramfs cryptsetup logger ncurses nls pam readline (split-usr) static-libs suid udev unicode -audit -build -fdformat -hardlink -kill -python (-selinux) -slang -su -systemd -test -tty-helpers" ABI_X86="(64) -32 (-x32)" PYTHON_TARGETS="python3_7 -python3_6 -python3_8" FEATURES="config-protect-if-modified parallel-fetch assume-digests news multilib-strict userpriv preserve-libs ebuild-locks binpkg-docompress usersandbox fixlafiles distcc protect-owned unknown-features-warn network-sandbox sfperms userfetch qa-unresolved-soname-deps unmerge-logs distlocks unmerge-orphans binpkg-logs merge-sync usersync ipc-sandbox sandbox strict binpkg-dostrip pid-sandbox"
also, to roll-back to a working blkid binary in my initrd images I needed to create a local ebuild out of genkernel package, so I could specify the working util-linux version there: -VERSION_UTIL_LINUX="2.36" +VERSION_UTIL_LINUX="2.33.2" Otherwise the system continues to fail to find the crypt_root device during boot.
I am wondering if this problem is somehow related to bug 742527 now that you mentioned genkernel and that the difference in output is just line > /dev/md1: UUID="e11887f5-4104-4a9e-9c53-7e1d904a0b28" TYPE="crypto_LUKS" which is missing. Please show us used kernel command-line line (cat /proc/cmdline) and used genkernel option (basically I need to know if you enabled MDADM_CONFIG in used genkernel.conf or if you are passing --mdadm-config to genkernel call).
Hello Thomas, The bug report you mentioned is not related to this. Like I said in the first comment, manually specifying: '/dev/md1' on the boot prompt where it expects a CRYPT_ROOT= device allows the system to continue to boot, thus the raid has been successfully assembled and started already. I believe this answers your question about how genkernel builds the intird images. The problem I am reporting, perhaps a bug for upstream util-linux, is that the blkid binary stopped to list a device, for some reason. Again, I do believe this is a corner case as this is the only device that disappeared. The device is not listed while the system is fully booted or in the beginning of the boot process. The inconvenience being the early boot, which prevents it being passed on to CRYPT_ROOT, even when I specify 'crypt_root=/dev/md1' instead of the UUID. Here is the cmdline: BOOT_IMAGE=/vmlinuz-5.8.9-gentoo-x86_64 root=UUID=57e79155-c611-46c7-9c2c-867256a55d5d ro crypt_root=UUID=e11887f5-4104-4a9e-9c53-7e1d904a0b28 root_trim=yes libata.allow_tpm=1 domdadm dolvm This works fine now that I have downgraded util-linux and genkernel.
Well, I asked the genkernel question because mdadm itself will never create /dev/md1 (mdadm will create /dev/md12X by default). The only way to get /dev/md1 is either adding mdadm.conf where you specified name to initramfs so mdadm knows you want to assign /dev/md1 during assemble or when using <genkernel-4.1 and having some root=/dev/md1 kernel command-line parameter set (this special handling got removed in genkernel-4.1+). So I am actually wondering what's creating /dev/md1 for you. And just to clarify: With latest util-linux where /dev/md1 is missing in output, does /dev/md1 exist at all? Anyway, nobody in Gentoo will be able to help you because nobody is able to reproduce this at the moment. So you will have to ask upstream about that if you believe this is an util-linux problem. When you are able to reproduce I would suggest to start bisecting util-linux which should be straight forward given that we have a live ebuild.
Thanks Thomas, #MDADM_CONFIG="/etc/mdadm.conf" - is commented out in the genkernel.conf and I do not pass --mdadm-config on the command line. /dev/md1 exists with all versions of the utils. It gets assembled properly. It is only 'blkid' binary cannot find it from the later versions of util-linux. I will have to create a bug report upstream for this, feel free to close this, as long as I can later refer the upstream bug in the comments, this should be fine. Thanks for looking into it.
Upstream bug report created: https://github.com/karelzak/util-linux/issues/1151
The issue has been fixed in upstream master, see: https://git.kernel.org/pub/scm/utils/util-linux/util-linux.git/commit/?id=8d3f9430c59416e4c1eddc899578158a7a1ed414 This report can now be closed as resolved.