Bug 489686 – mdraid, root on LVM - array doesn't stop at reboot

• Product: Gentoo Hosted Projects
• Status: UNCONFIRMED ---

[Description NiTr0 2013-10-28 20:38:27 UTC]

I have / on LVM on top of mdraid array.

On each reboot I saw that LVM can't be stopped (because / is still mounted), so md is busy and also can't be stopped. This may cause array data inconsistency.

Reproducible: Always

Steps to Reproduce:
1.Make array, make LVM on top
2. Set root on one of LVM partition, and make system bootable in any form (for ex., separate /boot volume with kernel and initrd)
3. Reboot system
Actual Results:  
mdraid isn't stopped

Expected Results:  
mdraid should stops (or, maybe, switched to read-only + wait some seconds to flush data as workaround - I didn't know, will r/o array continue rebuild process or not).

[Comment 1 Ian Stakenvicius (RETIRED) 2013-11-06 16:13:03 UTC]

Need more info here -- the usual stuff (emerge --info) along with the versions of lvm2, etc., would be a good start.  Also, you are using an initramfs to boot this system?  How was that generated?

[Comment 2 NiTr0 2013-11-08 16:42:51 UTC]

Hi.
I tried to use dracut-0.34-r1, but rolled back to booting w/o kernel with root on separate CF device.
LVM version is 3.1-r2. mdadm - 3.2.6-r1. 

# emerge --info
Portage 2.2.7 (default/linux/amd64/13.0, gcc-4.7.3, glibc-2.15-r3, 3.11.6-gentoo x86_64)
=================================================================
System uname: Linux-3.11.6-gentoo-x86_64-AMD_Athlon-tm-_II_X4_645_Processor-with-gentoo-2.2
KiB Mem:     4050136 total,    190724 free
KiB Swap:    3145724 total,   3109096 free
Timestamp of tree: Fri, 08 Nov 2013 16:00:01 +0000
ld GNU ld (GNU Binutils) 2.23.1
distcc 3.1 x86_64-pc-linux-gnu [disabled]
ccache version 3.1.9 [disabled]
app-shells/bash:          4.2_p45
dev-java/java-config:     2.1.12-r1
dev-lang/python:          2.7.5-r3, 3.2.5-r3
dev-util/ccache:          3.1.9
dev-util/cmake:           2.8.10.2-r2
dev-util/pkgconfig:       0.28
sys-apps/baselayout:      2.2
sys-apps/openrc:          0.11.8
sys-apps/sandbox:         2.6-r1
sys-devel/autoconf:       2.13, 2.69
sys-devel/automake:       1.11.6, 1.12.6, 1.13.4
sys-devel/binutils:       2.23.1
sys-devel/gcc:            4.6.3, 4.7.3-r1
sys-devel/gcc-config:     1.7.3
sys-devel/libtool:        2.4.2
sys-devel/make:           3.82-r4
sys-kernel/linux-headers: 3.9 (virtual/os-headers)
sys-libs/glibc:           2.15-r3
Repositories: gentoo local_overlay
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=amdfam10 -O2 -pipe -mcx16 -msahf -mpopcnt -mabm"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /var/bind /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/apache2-php5.5/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cgi-php5.5/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/php/cli-php5.5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=amdfam10 -O2 -pipe -mcx16 -msahf -mpopcnt -mabm"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="ru_RU.UTF-8"
LC_ALL=""
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j5"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
USE="X a52 aac acl acpi alsa amd64 apache2 apm apng bash-completion berkdb bzip2 cdr cgi cli consolekit cracklib crypt cups curl cvs cxx daemon dbus device-mapper dri dv dvd dynamic encode extensions extras fat ffmpeg fontconfig fortran frei0r fts3 gd gdbm gdu gif git gles2 gnutls gtk gudev hddtemp hwdb iconv icu ieee1394 ipv6 ithreads java jpeg jpeg2k json kde kdenlive libkms lm_sensors matroska melt mercurial minizip mjpeg mmx modules mp3 mpeg mudflap multilib mysql mysqli ncurses nls nptl ogg opengl openmp opus pam pcre perl php png policykit posix postgres postproc python qt qt3support qt4 quicktime readline reiser4 reiserfs samba sdl semantic-desktop session sqlite sse sse2 sse3 ssl stream subversion svg symlink taglib tcpd theora threads tiff toolbar truetype udev unicode usb v4l vnc vorbis wifi wxwidgets x264 xfce xml xmlrpc xulrunner xvfb xvid zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" DRACUT_MODULES="lvm mdraid dmraid" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en_US ru uk" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_2" RUBY_TARGETS="ruby19 ruby18" USERLAND="GNU" VIDEO_CARDS="vesa radeon" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, SYNC, USE_PYTHON

[Comment 3 NiTr0 2013-11-08 16:44:27 UTC]

Sorry, I switched to booting kernel w/o ramdisk, with root on separate device, due to bug #489682

[Comment 4 SpanKY 2013-12-13 06:34:22 UTC]

if your / is on lvm/raid, you can't shut them down, you can only mount them r/o

i don't do this though, so i don't keep track of the magic-incantation-of-the-day as to how this works

[Comment 5 Mike Gilbert 2014-01-16 17:18:07 UTC]

One possible solution would be to implement the functionality systemd implements on shutdown.

http://www.freedesktop.org/wiki/Software/systemd/InitrdInterface/

To quote:

If the executable /run/initramfs/shutdown exists systemd will jump back into the initrd on shutdown. /run/initramfs should be a usable initrd environment to which systemd will pivot back and the "shutdown" executable in it should be able to detach all complex storage that for example was needed to mount the root file system. It's the job of the initrd to set up this directory and executable in the right way so that this works correctly.


This would require some modifications to genkernel and openrc to implement.

[Comment 6 Mike Gilbert 2014-01-16 17:34:39 UTC]

The relevant code in systemd is here:

http://cgit.freedesktop.org/systemd/systemd/tree/src/core/shutdown.c

[Comment 7 William Hubbs 2014-01-16 22:51:03 UTC]

Genkernel isn't really relevant to this bug, I would just need to figure
out how to get OpenRC to respect the same API that systemd/dracut uses.

Once that is done, genkernel would need a separate bug to set up the
appropriate API.