I use Gentoo workstation with XFce DE and eudev (=sys-fs/eudev-1.10-r2). Some time ago I've find workstation _sometimes_ (depending on kernel from rare to often) failing poweroff turning off via GUI menu (i.e. monitor is switched down, but PC box stays on, after hard reset system starts check the only partition, mounted with acl option). Previously I've mixed this issue with bug #458858 but now I've noted it's different one. /etc/fstab: LABEL=backups-dir /usr/backups reiserfs noatime,user,acl 0 1 With =sys-kernel/aufs-sources-3.18.9 this issue appeared oftenly, with =sys-kernel/vanilla-sources-3.18.14 I've caught it oncely on about 10-th boot cycle. Switching off PC from command line (poweroff or shutdown -P) I've never see this issue. What else can I do to debug this issue? $ equery u sys-fs/eudev * Found these USE flags for sys-fs/eudev-1.10-r2: U I - - abi_x86_32 : 32-bit (x86) libraries - - doc : Add extra documentation (API, Javadoc, etc). It is recommended to enable per package instead of globally + + gudev : enable libudev gobject interface + + hwdb : read vendor/device string database and add it to udev database - - introspection : Use dev-libs/gobject-introspection for introspection + + keymap : map custom hardware's multimedia keys + + kmod : enable module loading through libkmod + + modutils : enable module loading support - use modutils calls if kmod not enabled + + openrc : install the OpenRC init scripts - - rule-generator : install legacy rule generator rules and support scripts - note that the functionality within was dropped from sys-fs/udev as it is not stable in all cases; use at your own risk - - static-libs : Build static versions of dynamic libraries as well - - test : Workaround to pull in packages needed to run with FEATURES=test. Portage-2.1.2 handles this internally, so don't set it in make.conf/package.use anymore $ einfo Portage 2.2.18 (python 3.3.5-final-0, default/linux/amd64/13.0, gcc-4.8.4, glibc-2.20-r2, 3.18.9-aufs x86_64) ================================================================= System uname: Linux-3.18.9-aufs-x86_64-AMD_Athlon-tm-_II_X2_250_Processor-with-gentoo-2.2 KiB Mem: 1794220 total, 85172 free KiB Swap: 8000364 total, 7718188 free Timestamp of repository gentoo: Mon, 29 Jun 2015 05:15:01 +0000 sh bash 4.3_p33-r2 ld GNU ld (Gentoo 2.24 p1.4) 2.24 app-shells/bash: 4.3_p33-r2::gentoo dev-java/java-config: 2.2.0::gentoo dev-lang/perl: 5.20.2::gentoo dev-lang/python: 2.7.9-r1::gentoo, 3.3.5-r1::gentoo dev-util/cmake: 3.2.2::gentoo dev-util/pkgconfig: 0.28-r2::gentoo sys-apps/baselayout: 2.2::gentoo sys-apps/openrc: 0.16.4::gentoo sys-apps/sandbox: 2.6-r1::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69::gentoo sys-devel/automake: 1.11.6-r1::gentoo, 1.13.4::gentoo, 1.14.1::gentoo sys-devel/binutils: 2.24-r3::gentoo sys-devel/gcc: 4.8.4::gentoo sys-devel/gcc-config: 1.7.3::gentoo sys-devel/libtool: 2.4.6::gentoo sys-devel/make: 4.1-r1::gentoo sys-kernel/linux-headers: 3.18::gentoo (virtual/os-headers) sys-libs/glibc: 2.20-r2::gentoo Repositories: gentoo location: /usr/portage/gentoo sync-type: rsync priority: -1000 local_hdd location: /usr/portage/local masters: gentoo ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /etc/env.d /usr/share/gnupg/qualified.txt /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.6/ext-active/ /etc/php/cgi-php5.6/ext-active/ /etc/php/cli-php5.6/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--ask --verbose --autounmask=n" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs buildsyspkg config-protect-if-modified distlocks downgrade-backup ebuild-locks fixlafiles merge-sync metadata-transfer news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://mirror.yandex.ru/gentoo-distfiles/ ftp://mirror.yandex.ru/gentoo-distfiles/ http://ftp.corbina.net/pub/Linux/gentoo/ ftp://ftp.corbina.net/pub/Linux/gentoo/" LANG="ru_RU.utf8" LC_ALL="" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j2" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS="--exclude-from=/etc/portage/rsync_excludes" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" USE="X a52 ac3 acl alsa amd64 avi berkdb bold bzip2 cdr cli consolekit cracklib crypt cups cxx dbus djvu dri dvd flac fortran gdbm gif gtk iconv inotify jpeg jpeg2k lock mmx mmxext modules mp3 multilib ncurses nls nptl ogg openmp pam pcre pdf png policykit qt3support readline session sse sse2 ssl tcpd thunar tiff udev udisks unicode utf8 vorbis xcb xulrunner zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="3dnow 3dnowext mmx mmxext popcnt sse sse2 sse3 sse4a" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="ru ru_RU" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" RUBY_TARGETS="ruby20" USERLAND="GNU" VIDEO_CARDS="radeon" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, USE_PYTHON
I have no idea how to assign this bug. If someone has some clue, please feel free to wrangle it.
Can you enable rc_logger in /etc/rc.conf and attach an rc.log taken from when you experience this issue?
Created attachment 406024 [details] rc.log.success.Z (In reply to Mike Gilbert from comment #2) > Can you enable rc_logger in /etc/rc.conf and attach an rc.log taken from > when you experience this issue? Notable details: Issued partition is formatted using less-supported reiser3 filesystem. Disklabel type: dos # blkid | grep backups /dev/sda7: LABEL="backups-dir" UUID="e5a9493f-e7e4-48aa-b54f-59b334985097" TYPE="reiserfs" PARTUUID="daf3daf3-07" # /sbin/fdisk -l | grep sda7 /dev/sda7 104133393 232139249 128005857 61G 83 Linux Now attaching rc.log of succeed poweroff for compare. Getting an issued one will take a time. /usr is also located on separate partition: # mount | grep usr /dev/sda5 on /usr type reiserfs (rw,noatime) Issue appeared on 3.8.13 kernel.
Were you going to provide a log from a failure case?
Created attachment 406240 [details] rc.log_fail.Z (In reply to Mike Gilbert from comment #4) > Were you going to provide a log from a failure case? Not where, but when. The issue is not willingly-reproducable. For recent kernel I've caught it last Friday. rc.log of failed poweroff together with first boot in attached file rc.log_fail.Z Recently used kernel is 3.18.9-aufs. For this kernel description is not correct: according to log umount failed for all partitions listed in /etc/fstab after /usr: /etc/fstab: /dev/sda1 /boot ext2 noauto,noatime 1 2 /dev/sda2 / ext3 noatime 0 1 /dev/sda3 none swap sw 0 0 /dev/sda5 /usr reiserfs noatime 0 1 /dev/sda6 /var reiserfs noatime 0 1 /dev/sda8 /home reiserfs noatime 0 1 LABEL=backups-dir /usr/backups reiserfs noatime,user,acl 0 1 # /sbin/fdisk -l /dev/sda Disk /dev/sda: 232,9 GiB, 250059350016 bytes, 488397168 sectors Units: sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disklabel type: dos Disk identifier: 0xdaf3daf3 Device Boot Start End Sectors Size Id Type /dev/sda1 * 63 128519 128457 62,7M 83 Linux /dev/sda2 128520 8128889 8000370 3,8G 83 Linux /dev/sda3 8128890 24129629 16000740 7,6G 82 Linux swap / Solaris /dev/sda4 24129630 488397167 464267538 221,4G 5 Extended /dev/sda5 24129693 56131109 32001417 15,3G 83 Linux /dev/sda6 56131173 104133329 48002157 22,9G 83 Linux /dev/sda7 104133393 232139249 128005857 61G 83 Linux /dev/sda8 232139313 488397167 256257855 122,2G 83 Linux
> sed: can't read /sys/fs/aufs/config/br[0-9][0-9][0-9]: Not a directory > * Failed to remove branch from aufs please test gentoo-sources.
(In reply to Alex Xu (Hello71) from comment #6) > > sed: can't read /sys/fs/aufs/config/br[0-9][0-9][0-9]: Not a directory > > * Failed to remove branch from aufs > > please test gentoo-sources. You've quoted the different easely reproduceable issue. You probably can easyly get it just by: 1. Boot into aufs-enabled kernel (aufs-sources or install sys-fs/aufs4[kernel-patch] with gentoo-sources); 2. Create an squashfs image and mount it in rw (aufs) mode; 3. Umount it; 4. Poweroff your system with turned on rc.log and monitoring openrc messages you'll see the quoted error. But, probably (I know at least two installation, where you can see quoted error message), but not subject issue. For first times (3.8.13 kernel, on which I've caught this issue first and some kernel updates after) I've used gentoo-sources. I use sys-kernel/aufs-sources[-vanilla], that means "Full sources including the Gentoo patchset plus aufs4 patchset". Of course, I can make a check with gentoo-sources, but exactly before reporting this bug I've reproduced this issue with =sys-kernel/vanilla-sources-3.18.14 (also without aufs support) and shure in reproducability with any gentoo-sources 3.x newer than 3.8.13. But since I've migrated my portage tree into aufs such check (with booting into no-aufs kernel) will break normal emerge --sync, that I don't like.
So, the rc log didn't really provide any especially useful information. It does seem that it is making it like 99% through the power-off process; your filesystems get unmounted, the clock gets updated, and then the logging stops. This happens in both the success and failure cases. Very few things happen in userspace after that point; basically, openrc will kill procs and remount rootfs as read-only. I think this is either a kernel bug or a hardware bug. I'm passing this to the kernel team in case that have any more debugging ideas.
The bug was reproduced after update, with =sys-fs/eudev-3.1.2 on 4.0.5-aufs kernel.
(In reply to Alex Xu (Hello71) from comment #6) > > sed: can't read /sys/fs/aufs/config/br[0-9][0-9][0-9]: Not a directory > > * Failed to remove branch from aufs > > please test gentoo-sources. It's localmount service miss. See bug #560008 for details.
Maybe notable: last time turning off my workstation with poweroff command I regularly see login manager (x11-misc/slim) refused to stop: rc.log: rc shutdown logging started at Mon Nov 9 18:00:27 2015 … * Stopping slim ... * start-stop-daemon: 1 process refused to stop * Error stopping slim [ !! ] * ERROR: xdm failed to stop …
Is this still an issue?
(In reply to Mike Pagano from comment #12) > Is this still an issue? For a time I use cli utils to switch off my workstation. Making re-check of this bug will take a week or two.
Seems to be fixed with =sys-kernel/gentoo-sources-4.9.6-r1.
