Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 741654 - >=sys-apps/util-linux-2.34: blkid does not discover LUKS on md-raid device
Summary: >=sys-apps/util-linux-2.34: blkid does not discover LUKS on md-raid device
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal (vote)
Assignee: Gentoo's Team for Core System packages
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2020-09-11 12:51 UTC by Nikolay Kichukov
Modified: 2021-12-25 21:42 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Nikolay Kichukov 2020-09-11 12:51:27 UTC
blkid binary from >sys-apps/util-linux-2.33.2 no longer recognizes md-raid (linux-raid) device that is LUKS formatted. The result is failure to boot the system if the raid device is crypt_root (manually specificy /dev/mdXXX allows the system to continue to boot) and failure to list it with blkid while the system is running (lsblk lists it fine).

Downgrading to =sys-apps/util-linux-2.33.2 fixes the issue.

To note, the versions of util-linux that are greater than sys-apps/util-linux-2.33.2 were compiled with cryptsetup use flag but still failed to list the device.

Info about raid array and the LUKS partition:

# mdadm --detail --verbose /dev/md1
/dev/md1:
           Version : 1.2
     Creation Time : Fri May 24 09:51:52 2019
        Raid Level : raid1
        Array Size : 167640064 (159.87 GiB 171.66 GB)
     Used Dev Size : 167640064 (159.87 GiB 171.66 GB)
      Raid Devices : 2
     Total Devices : 2
       Persistence : Superblock is persistent

       Update Time : Fri Sep 11 14:43:17 2020
             State : active 
    Active Devices : 2
   Working Devices : 2
    Failed Devices : 0
     Spare Devices : 0

Consistency Policy : resync

              Name : della:1
              UUID : 2f24d0e2:c5d528f5:a443c4ad:a25cab6d
            Events : 283545

    Number   Major   Minor   RaidDevice State
       6       8        6        0      active sync   /dev/sda6
       2       8       22        1      active sync   /dev/sdb6

# cryptsetup luksDump /dev/md1
LUKS header information for /dev/md1

Version:        1
Cipher name:    aes
Cipher mode:    xts-plain64
Hash spec:      sha256
Payload offset: 4096
MK bits:        512

Here is how blkid from =sys-apps/util-linux-2.33.2 lists the volume:

# blkid | grep e1188
/dev/md1: UUID="e11887f5-4104-4a9e-9c53-7e1d904a0b28" TYPE="crypto_LUKS"


Same command with any of the later versions of util-linux produces no output, though the device is there.


Reproducible: Always

Steps to Reproduce:
1. On a system that makes use of dm-raid and dm-crypt(cryptsetup), setup a raid1 array and format it in LUKS1 (version 1) format.
2. Upgrade util-linux to anything after version sys-apps/util-linux-2.33.2
3. run blkid and see how your dm-raid device is not listed in the output (but lsblk shows it for comparison)
Actual Results:  
The assembled raid device is not visible to blkid utility.

Expected Results:  
Even when running with versions greater than sys-apps/util-linux-2.33.2, blkid should continue to detect the raid device.

Portage 3.0.4 (python 3.7.8-final-0, default/linux/amd64/17.1/desktop, gcc-10.2.0, glibc-2.31-r6, 5.8.7-gentoo-x86_64 x86_64)
=================================================================
System uname: Linux-5.8.7-gentoo-x86_64-x86_64-Intel-R-_Xeon-R-_CPU_E5-1607_v3_@_3.10GHz-with-gentoo-2.7
KiB Mem:    32812056 total,   1172628 free
KiB Swap:    8378364 total,   8331772 free
Timestamp of repository gentoo: Fri, 11 Sep 2020 08:00:01 +0000
Head commit of repository gentoo: b3c035d4f5883f12deb1e704bfa8843cf7f2df3e
sh bash 5.0_p18
ld GNU ld (Gentoo 2.33.1 p2) 2.33.1
distcc 3.3.3 x86_64-pc-linux-gnu [enabled]
ccache version 3.7.11 [disabled]
app-shells/bash:          5.0_p18::gentoo
dev-java/java-config:     2.3.1::gentoo
dev-lang/perl:            5.30.3::gentoo
dev-lang/python:          2.7.18-r1::gentoo, 3.6.11-r2::gentoo, 3.7.8-r2::gentoo, 3.8.5::gentoo
dev-util/ccache:          3.7.11::gentoo
dev-util/cmake:           3.18.2::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/openrc:          0.42.1::gentoo
sys-apps/sandbox:         2.18::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r5::gentoo
sys-devel/automake:       1.11.6-r3::gentoo, 1.13.4-r2::gentoo, 1.16.1-r1::gentoo
sys-devel/binutils:       2.33.1-r1::gentoo
sys-devel/gcc:            10.2.0-r1::gentoo
sys-devel/gcc-config:     2.3.1::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.4-r1::gentoo (virtual/os-headers)
sys-libs/glibc:           2.31-r6::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: 
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-jobs: 1

nikolay_local
    location: /usr/local/portage
    masters: gentoo

crossdev
    location: /usr/local/portage-crossdev
    masters: gentoo
    priority: 10

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=haswell -mmmx -msse -msse2 -msse3 -mssse3 -mcx16 -msahf -mmovbe -maes -mpclmul -mpopcnt -mabm -mfma -mbmi -mbmi2 -mavx -mavx2 -msse4.2 -msse4.1 -mlzcnt -mrdrnd -mf16c -mfsgsbase -mfxsr -mxsave -mxsaveopt --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=10240 -mtune=haswell"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /etc/stunnel/stunnel.conf /usr/share/easy-rsa /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.2/ext-active/ /etc/php/apache2-php7.3/ext-active/ /etc/php/apache2-php7.4/ext-active/ /etc/php/cgi-php7.2/ext-active/ /etc/php/cgi-php7.3/ext-active/ /etc/php/cgi-php7.4/ext-active/ /etc/php/cli-php7.2/ext-active/ /etc/php/cli-php7.3/ext-active/ /etc/php/cli-php7.4/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -march=haswell -mmmx -msse -msse2 -msse3 -mssse3 -mcx16 -msahf -mmovbe -maes -mpclmul -mpopcnt -mabm -mfma -mbmi -mbmi2 -mavx -mavx2 -msse4.2 -msse4.1 -mlzcnt -mrdrnd -mf16c -mfsgsbase -mfxsr -mxsave -mxsaveopt --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=10240 -mtune=haswell"
DISTDIR="/usr/portage/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distcc distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="https://mirror.leaseweb.com/gentoo/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo/"
INSTALL_MASK="/usr/share/locale -/usr/share/locale/en"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j30 -l8"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acl acpi alsa amd64 berkdb branding bzip2 cairo cdda cdr cli crypt cups dbus dri dts dvd dvdr elogind emboss encode exif flac gdbm gif gpm gtk gui iconv icu jpeg lcms libglvnd libnotify libtirpc mad mmx mng mp3 mp4 mpeg multilib ncurses nls nptl ogg opengl openmp pam pango pcre pdf png policykit ppds pulseaudio qt5 readline sdl seccomp spell split-usr sse sse2 ssl startup-notification svg tcpd tiff truetype udev udisks unicode upower usb vorbis wxwidgets x264 xattr xcb xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="mouse keyboard libinput" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python2_7 python3_7" QEMU_SOFTMMU_TARGETS="i386 x86_64 arm aarch64" QEMU_USER_TARGETS="arm aarch64" RUBY_TARGETS="ruby25" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Thomas Deutschmann (RETIRED) gentoo-dev 2020-09-11 15:50:53 UTC
I cannot reproduce. I compared

- blkid
- lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID

output between util-linux-2.33.2 and 2.36. Only difference is added "BLOCK_SIZE" in 2.36.

> # blkid | grep cry
> /dev/md127: UUID="6edcbea7-bb2c-4e22-9839-9f682f6fd51f" TYPE="crypto_LUKS"
> 
> # mdadm --detail --verbose /dev/md127
> /dev/md127:
>            Version : 1.2
>      Creation Time : Tue Jan  1 21:07:42 2013
>         Raid Level : raid1
>         Array Size : 20838311 (19.87 GiB 21.34 GB)
>      Used Dev Size : 20838311 (19.87 GiB 21.34 GB)
>       Raid Devices : 2
>      Total Devices : 2
>        Persistence : Superblock is persistent
> 
>        Update Time : Fri Sep 11 17:41:08 2020
>              State : clean
>     Active Devices : 2
>    Working Devices : 2
>     Failed Devices : 0
>      Spare Devices : 0
> 
> Consistency Policy : resync
> 
>               Name : setup:Bank
>               UUID : 0b135d52:ab241210:4144798f:025b1b94
>             Events : 1295
> 
>     Number   Major   Minor   RaidDevice State
>        0       8        2        0      active sync   /dev/sda2
>        1       8       18        1      active sync   /dev/sdb2
> 


Please post full output of `blkid` and `lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID` for both util-linux versions. Also post `emerge --info sys-apps/util-linux | tail -n 8` output.
Comment 2 Thomas Deutschmann (RETIRED) gentoo-dev 2020-09-11 15:52:43 UTC
Just for completeness,

> # cryptsetup luksDump /dev/md127
> LUKS header information for /dev/md127
> 
> Version:        1
> Cipher name:    aes
> Cipher mode:    xts-plain64
> Hash spec:      sha512
> Payload offset: 4096
> MK bits:        512
> [...]
Comment 3 Nikolay Kichukov 2020-09-16 10:08:28 UTC
Hi Thomas,

This may be some isolated corner case with this specific device and perhaps the version of the utils it was built with, here is the information you have requested:


=== util-linux-2.33.2 ===

blkid:
/dev/sda1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01"
/dev/sda3: UUID="82fe17dd-375e-47e6-933b-cdfe36b820d7" TYPE="crypto_LUKS" PARTUUID="95c9cb16-03"
/dev/sda5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="3fe60d75-881f-1e44-8e4c-f073dc545342" TYPE="linux_raid_member" PARTUUID="95c9cb16-05"
/dev/sda6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="fe71b6a8-d685-e50b-61d8-546f1122fe6f" TYPE="linux_raid_member" PARTUUID="95c9cb16-06"
/dev/sda7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="599ab990-1a8e-dcc5-7e78-966d67cbeab8" TYPE="linux_raid_member" PARTUUID="95c9cb16-07"
/dev/sdb1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01"
/dev/sdb5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="21deb9af-76af-a43b-8aae-b7194217bd7b" TYPE="linux_raid_member" PARTUUID="95c9cb16-05"
/dev/sdb6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="660cd809-687b-04c8-3c52-548f2bf7a8fb" TYPE="linux_raid_member" PARTUUID="95c9cb16-06"
/dev/sdb7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="6f871b3e-8e0c-9aaf-a428-25e7cad51a0b" TYPE="linux_raid_member" PARTUUID="95c9cb16-07"
/dev/sdc: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="4bdc8ac3-958a-920e-0154-c34159247cf4"  TYPE="linux_raid_member"
/dev/md0: UUID="156bec29-8040-442d-94db-91f8c92bd90e" TYPE="ext4"
/dev/sdd: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="55626bcf-63b1-3f7a-7385-739f201054e6" TYPE="linux_raid_member"
/dev/md127: UUID="84487b92-c275-4438-8284-1b085721bc7e" TYPE="swap"
/dev/md1: UUID="e11887f5-4104-4a9e-9c53-7e1d904a0b28" TYPE="crypto_LUKS"
/dev/md126: UUID="12af8fd4-7c2e-4161-b510-ea94698d2dec" TYPE="crypto_LUKS"
/dev/md125: UUID="8ca5be35-9c99-4332-bd83-4a017c3098ac" TYPE="crypto_LUKS"
/dev/mapper/root: UUID="57e79155-c611-46c7-9c2c-867256a55d5d" TYPE="ext4"
/dev/mapper/wscryptdata: UUID="efff5332-04af-452d-9677-b8469f66e7bf" TYPE="ext4"
/dev/mapper/wscryptssdp3: UUID="158ea560-15f3-4ab7-8a66-5f08d3e0ca9b" TYPE="vdo"
/dev/mapper/wscryptssd: UUID="0acc0360-c278-470f-95b9-5a582c3f823e" TYPE="vdo"
/dev/mapper/vdo_wscryptssd: UUID="fbae96cf-9328-4824-b340-1c7e12910559" TYPE="ext4"
/dev/mapper/vdo_wscryptssdp3: UUID="15a01a20-7843-4ad7-9758-bdcba460f9fb" TYPE="ext4"


lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID:
NAME                   KNAME FSTYPE            PARTUUID                             UUID
sda                    sda                                                          
├─sda1                 sda1  linux_raid_member 95c9cb16-01                          518ffed5-9c69-6d67-56a8-912f4a2054b8
│ └─md0                md0   ext4                                                   156bec29-8040-442d-94db-91f8c92bd90e
├─sda2                 sda2                    95c9cb16-02                          
├─sda3                 sda3  crypto_LUKS       95c9cb16-03                          82fe17dd-375e-47e6-933b-cdfe36b820d7
│ └─wscryptssdp3       dm-2  vdo                                                    158ea560-15f3-4ab7-8a66-5f08d3e0ca9b
│   └─vdo_wscryptssdp3 dm-5  ext4                                                   15a01a20-7843-4ad7-9758-bdcba460f9fb
├─sda5                 sda5  linux_raid_member 95c9cb16-05                          e9fefec9-3ecc-2035-0438-8184f47798f7
│ └─md127              md127 swap                                                   84487b92-c275-4438-8284-1b085721bc7e
├─sda6                 sda6  linux_raid_member 95c9cb16-06                          2f24d0e2-c5d5-28f5-a443-c4ada25cab6d
│ └─md1                md1   crypto_LUKS                                            e11887f5-4104-4a9e-9c53-7e1d904a0b28
│   └─root             dm-0  ext4                                                   57e79155-c611-46c7-9c2c-867256a55d5d
└─sda7                 sda7  linux_raid_member 95c9cb16-07                          514d5aa7-9451-1cbc-3bc0-a391f9a75956
  └─md126              md126 crypto_LUKS                                            12af8fd4-7c2e-4161-b510-ea94698d2dec
    └─wscryptssd       dm-3  vdo                                                    0acc0360-c278-470f-95b9-5a582c3f823e
      └─vdo_wscryptssd dm-4  ext4                                                   fbae96cf-9328-4824-b340-1c7e12910559
sdb                    sdb                                                          
├─sdb1                 sdb1  linux_raid_member 95c9cb16-01                          518ffed5-9c69-6d67-56a8-912f4a2054b8
│ └─md0                md0   ext4                                                   156bec29-8040-442d-94db-91f8c92bd90e
├─sdb2                 sdb2                    95c9cb16-02                          
├─sdb5                 sdb5  linux_raid_member 95c9cb16-05                          e9fefec9-3ecc-2035-0438-8184f47798f7
│ └─md127              md127 swap                                                   84487b92-c275-4438-8284-1b085721bc7e
├─sdb6                 sdb6  linux_raid_member 95c9cb16-06                          2f24d0e2-c5d5-28f5-a443-c4ada25cab6d
│ └─md1                md1   crypto_LUKS                                            e11887f5-4104-4a9e-9c53-7e1d904a0b28
│   └─root             dm-0  ext4                                                   57e79155-c611-46c7-9c2c-867256a55d5d
└─sdb7                 sdb7  linux_raid_member 95c9cb16-07                          514d5aa7-9451-1cbc-3bc0-a391f9a75956
  └─md126              md126 crypto_LUKS                                            12af8fd4-7c2e-4161-b510-ea94698d2dec
    └─wscryptssd       dm-3  vdo                                                    0acc0360-c278-470f-95b9-5a582c3f823e
      └─vdo_wscryptssd dm-4  ext4                                                   fbae96cf-9328-4824-b340-1c7e12910559
sdc                    sdc   linux_raid_member                                      ec81b49e-b5c7-688f-c10b-1bb755dd1e25
└─md125                md125 crypto_LUKS                                            8ca5be35-9c99-4332-bd83-4a017c3098ac
  └─wscryptdata        dm-1  ext4                                                   efff5332-04af-452d-9677-b8469f66e7bf
sdd                    sdd   linux_raid_member                                      ec81b49e-b5c7-688f-c10b-1bb755dd1e25
└─md125                md125 crypto_LUKS                                            8ca5be35-9c99-4332-bd83-4a017c3098ac
  └─wscryptdata        dm-1  ext4                                                   efff5332-04af-452d-9677-b8469f66e7bf


=== util-linux-2.36 ===
blkid:
/dev/sda1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01"
/dev/sda3: UUID="82fe17dd-375e-47e6-933b-cdfe36b820d7" TYPE="crypto_LUKS" PARTUUID="95c9cb16-03"
/dev/sda5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="3fe60d75-881f-1e44-8e4c-f073dc545342" TYPE="linux_raid_member" PARTUUID="95c9cb16-05"
/dev/sda6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="fe71b6a8-d685-e50b-61d8-546f1122fe6f" TYPE="linux_raid_member" PARTUUID="95c9cb16-06"
/dev/sda7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="599ab990-1a8e-dcc5-7e78-966d67cbeab8" TYPE="linux_raid_member" PARTUUID="95c9cb16-07"
/dev/sdb1: UUID="518ffed5-9c69-6d67-56a8-912f4a2054b8" TYPE="linux_raid_member" PARTUUID="95c9cb16-01"
/dev/sdb5: UUID="e9fefec9-3ecc-2035-0438-8184f47798f7" UUID_SUB="21deb9af-76af-a43b-8aae-b7194217bd7b" TYPE="linux_raid_member" PARTUUID="95c9cb16-05"
/dev/sdb6: UUID="2f24d0e2-c5d5-28f5-a443-c4ada25cab6d" UUID_SUB="660cd809-687b-04c8-3c52-548f2bf7a8fb" TYPE="linux_raid_member" PARTUUID="95c9cb16-06"
/dev/sdb7: UUID="514d5aa7-9451-1cbc-3bc0-a391f9a75956" UUID_SUB="6f871b3e-8e0c-9aaf-a428-25e7cad51a0b" TYPE="linux_raid_member" PARTUUID="95c9cb16-07"
/dev/sdc: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="4bdc8ac3-958a-920e-0154-c34159247cf4" TYPE="linux_raid_member"
/dev/md0: UUID="156bec29-8040-442d-94db-91f8c92bd90e" BLOCK_SIZE="1024" TYPE="ext4"
/dev/sdd: UUID="ec81b49e-b5c7-688f-c10b-1bb755dd1e25" UUID_SUB="55626bcf-63b1-3f7a-7385-739f201054e6" TYPE="linux_raid_member"
/dev/md127: UUID="84487b92-c275-4438-8284-1b085721bc7e" TYPE="swap"
/dev/md126: UUID="12af8fd4-7c2e-4161-b510-ea94698d2dec" TYPE="crypto_LUKS"
/dev/md125: UUID="8ca5be35-9c99-4332-bd83-4a017c3098ac" TYPE="crypto_LUKS"
/dev/mapper/root: UUID="57e79155-c611-46c7-9c2c-867256a55d5d" BLOCK_SIZE="4096" TYPE="ext4"
/dev/mapper/wscryptdata: UUID="efff5332-04af-452d-9677-b8469f66e7bf" BLOCK_SIZE="4096" TYPE="ext4"
/dev/mapper/wscryptssdp3: UUID="158ea560-15f3-4ab7-8a66-5f08d3e0ca9b" TYPE="vdo"
/dev/mapper/wscryptssd: UUID="0acc0360-c278-470f-95b9-5a582c3f823e" TYPE="vdo"
/dev/mapper/vdo_wscryptssd: UUID="fbae96cf-9328-4824-b340-1c7e12910559" BLOCK_SIZE="4096" TYPE="ext4"
/dev/mapper/vdo_wscryptssdp3: UUID="15a01a20-7843-4ad7-9758-bdcba460f9fb" BLOCK_SIZE="4096" TYPE="ext4"

lsblk --output NAME,KNAME,FSTYPE,PARTUUID,UUID:
NAME                   KNAME FSTYPE            PARTUUID                             UUID
sda                    sda                                                          
├─sda1                 sda1  linux_raid_member 95c9cb16-01                          518ffed5-9c69-6d67-56a8-912f4a2054b8
│ └─md0                md0   ext4                                                   156bec29-8040-442d-94db-91f8c92bd90e
├─sda2                 sda2                    95c9cb16-02                          
├─sda3                 sda3  crypto_LUKS       95c9cb16-03                          82fe17dd-375e-47e6-933b-cdfe36b820d7
│ └─wscryptssdp3       dm-2  vdo                                                    158ea560-15f3-4ab7-8a66-5f08d3e0ca9b
│   └─vdo_wscryptssdp3 dm-5  ext4                                                   15a01a20-7843-4ad7-9758-bdcba460f9fb
├─sda5                 sda5  linux_raid_member 95c9cb16-05                          e9fefec9-3ecc-2035-0438-8184f47798f7
│ └─md127              md127 swap                                                   84487b92-c275-4438-8284-1b085721bc7e
├─sda6                 sda6  linux_raid_member 95c9cb16-06                          2f24d0e2-c5d5-28f5-a443-c4ada25cab6d
│ └─md1                md1   crypto_LUKS                                            e11887f5-4104-4a9e-9c53-7e1d904a0b28
│   └─root             dm-0  ext4                                                   57e79155-c611-46c7-9c2c-867256a55d5d
└─sda7                 sda7  linux_raid_member 95c9cb16-07                          514d5aa7-9451-1cbc-3bc0-a391f9a75956
  └─md126              md126 crypto_LUKS                                            12af8fd4-7c2e-4161-b510-ea94698d2dec
    └─wscryptssd       dm-3  vdo                                                    0acc0360-c278-470f-95b9-5a582c3f823e
      └─vdo_wscryptssd dm-4  ext4                                                   fbae96cf-9328-4824-b340-1c7e12910559
sdb                    sdb                                                          
├─sdb1                 sdb1  linux_raid_member 95c9cb16-01                          518ffed5-9c69-6d67-56a8-912f4a2054b8
│ └─md0                md0   ext4                                                   156bec29-8040-442d-94db-91f8c92bd90e
├─sdb2                 sdb2                    95c9cb16-02                          
├─sdb5                 sdb5  linux_raid_member 95c9cb16-05                          e9fefec9-3ecc-2035-0438-8184f47798f7
│ └─md127              md127 swap                                                   84487b92-c275-4438-8284-1b085721bc7e
├─sdb6                 sdb6  linux_raid_member 95c9cb16-06                          2f24d0e2-c5d5-28f5-a443-c4ada25cab6d
│ └─md1                md1   crypto_LUKS                                            e11887f5-4104-4a9e-9c53-7e1d904a0b28
│   └─root             dm-0  ext4                                                   57e79155-c611-46c7-9c2c-867256a55d5d
└─sdb7                 sdb7  linux_raid_member 95c9cb16-07                          514d5aa7-9451-1cbc-3bc0-a391f9a75956
  └─md126              md126 crypto_LUKS                                            12af8fd4-7c2e-4161-b510-ea94698d2dec
    └─wscryptssd       dm-3  vdo                                                    0acc0360-c278-470f-95b9-5a582c3f823e
      └─vdo_wscryptssd dm-4  ext4                                                   fbae96cf-9328-4824-b340-1c7e12910559
sdc                    sdc   linux_raid_member                                      ec81b49e-b5c7-688f-c10b-1bb755dd1e25
└─md125                md125 crypto_LUKS                                            8ca5be35-9c99-4332-bd83-4a017c3098ac
  └─wscryptdata        dm-1  ext4                                                   efff5332-04af-452d-9677-b8469f66e7bf
sdd                    sdd   linux_raid_member                                      ec81b49e-b5c7-688f-c10b-1bb755dd1e25
└─md125                md125 crypto_LUKS                                            8ca5be35-9c99-4332-bd83-4a017c3098ac
  └─wscryptdata        dm-1  ext4                                                   efff5332-04af-452d-9677-b8469f66e7bf



=== emerge --info sys-apps/util-linux | tail -n 8 ===

sys-apps/util-linux-2.36::gentoo was built with the following:
USE="caps cramfs cryptsetup logger ncurses nls pam readline (split-usr) static-libs suid udev unicode -audit -build -fdformat -hardlink -kill -python (-selinux) -slang -su -systemd -test -tty-helpers" ABI_X86="(64) -32 (-x32)" PYTHON_TARGETS="python3_7 -python3_6 -python3_8"
FEATURES="config-protect-if-modified parallel-fetch assume-digests news multilib-strict userpriv preserve-libs ebuild-locks binpkg-docompress usersandbox fixlafiles distcc protect-owned unknown-features-warn network-sandbox sfperms userfetch qa-unresolved-soname-deps unmerge-logs distlocks unmerge-orphans binpkg-logs merge-sync usersync ipc-sandbox sandbox strict binpkg-dostrip pid-sandbox"
Comment 4 Nikolay Kichukov 2020-09-16 14:30:56 UTC
also, to roll-back to a working blkid binary in my initrd images I needed to create a local ebuild out of genkernel package, so I could specify the working util-linux version there:

-VERSION_UTIL_LINUX="2.36"
+VERSION_UTIL_LINUX="2.33.2"

Otherwise the system continues to fail to find the crypt_root device during boot.
Comment 5 Thomas Deutschmann (RETIRED) gentoo-dev 2020-09-16 14:45:20 UTC
I am wondering if this problem is somehow related to bug 742527 now that you mentioned genkernel and that the difference in output is just line

> /dev/md1: UUID="e11887f5-4104-4a9e-9c53-7e1d904a0b28" TYPE="crypto_LUKS"

which is missing.

Please show us used kernel command-line line (cat /proc/cmdline) and used genkernel option (basically I need to know if you enabled MDADM_CONFIG in used genkernel.conf or if you are passing --mdadm-config to genkernel call).
Comment 6 Nikolay Kichukov 2020-09-17 08:53:54 UTC
Hello Thomas,

The bug report you mentioned is not related to this.

Like I said in the first comment, manually specifying: '/dev/md1' on the boot prompt where it expects a CRYPT_ROOT= device allows the system to continue to boot, thus the raid has been successfully assembled and started already. I believe this answers your question about how genkernel builds the intird images.

The problem I am reporting, perhaps a bug for upstream util-linux, is that the blkid binary stopped to list a device, for some reason. Again, I do believe this is a corner case as this is the only device that disappeared.

The device is not listed while the system is fully booted or in the beginning of the boot process. The inconvenience being the early boot, which prevents it being passed on to CRYPT_ROOT, even when I specify 'crypt_root=/dev/md1' instead of the UUID.

Here is the cmdline:

BOOT_IMAGE=/vmlinuz-5.8.9-gentoo-x86_64 root=UUID=57e79155-c611-46c7-9c2c-867256a55d5d ro crypt_root=UUID=e11887f5-4104-4a9e-9c53-7e1d904a0b28 root_trim=yes libata.allow_tpm=1 domdadm dolvm

This works fine now that I have downgraded util-linux and genkernel.
Comment 7 Thomas Deutschmann (RETIRED) gentoo-dev 2020-09-17 11:44:54 UTC
Well, I asked the genkernel question because mdadm itself will never create /dev/md1 (mdadm will create /dev/md12X by default). The only way to get /dev/md1 is either adding mdadm.conf where you specified name to initramfs so mdadm knows you want to assign /dev/md1 during assemble or when using <genkernel-4.1 and having some root=/dev/md1 kernel command-line parameter set (this special handling got removed in genkernel-4.1+).

So I am actually wondering what's creating /dev/md1 for you.

And just to clarify: With latest util-linux where /dev/md1 is missing in output, does /dev/md1 exist at all?

Anyway, nobody in Gentoo will be able to help you because nobody is able to reproduce this at the moment. So you will have to ask upstream about that if you believe this is an util-linux problem. When you are able to reproduce I would suggest to start bisecting util-linux which should be straight forward given that we have a live ebuild.
Comment 8 Nikolay Kichukov 2020-09-18 12:50:19 UTC
Thanks Thomas,

#MDADM_CONFIG="/etc/mdadm.conf" - is commented out in the genkernel.conf and I do not pass --mdadm-config on the command line.

/dev/md1 exists with all versions of the utils. It gets assembled properly. It is only 'blkid' binary cannot find it from the later versions of util-linux.

I will have to create a bug report upstream for this, feel free to close this, as long as I can later refer the upstream bug in the comments, this should be fine.

Thanks for looking into it.
Comment 9 Nikolay Kichukov 2020-09-29 09:06:06 UTC
Upstream bug report created:
https://github.com/karelzak/util-linux/issues/1151
Comment 10 Nikolay Kichukov 2020-10-07 12:44:18 UTC
The issue has been fixed in upstream master, see:

https://git.kernel.org/pub/scm/utils/util-linux/util-linux.git/commit/?id=8d3f9430c59416e4c1eddc899578158a7a1ed414

This report can now be closed as resolved.