Created attachment 336240 [details] Kernel config for 3.7.3 Jan 20 19:28:22 einstein kernel: [ 22.753575] BUG: unable to handle kernel paging request at ffffffffa00ebca8 Jan 20 19:28:22 einstein kernel: [ 22.753820] IP: [<ffffffff810cfd48>] register_ftrace_event+0x218/0x2b0 Jan 20 19:28:22 einstein kernel: [ 22.754004] PGD 16b1067 PUD 16b7063 PMD 2244c6063 PTE 21e760161 Jan 20 19:28:22 einstein kernel: [ 22.754353] Thread overran stack, or stack corrupted Jan 20 19:28:22 einstein kernel: [ 22.754475] Oops: 0003 [#1] SMP Jan 20 19:28:22 einstein kernel: [ 22.754707] Modules linked in: drm(+) backlight fb fbdev iTCO_wdt coretemp lpc_ich crc32c_intel ghash_clmulni_intel aesni_intel mei dcdbas aes_x 86_64 mfd_core serio_raw ablk_helper Jan 20 19:28:22 einstein kernel: [ 22.755921] CPU 0 Jan 20 19:28:22 einstein kernel: [ 22.755983] Pid: 1152, comm: systemd-udevd Not tainted 3.7.3-hardened #1 Dell Inc. Inspiron 620 /0GDG8Y Jan 20 19:28:22 einstein kernel: [ 22.756278] RIP: 0010:[<ffffffff810cfd48>] [<ffffffff810cfd48>] register_ftrace_event+0x218/0x2b0 Jan 20 19:28:22 einstein kernel: [ 22.756518] RSP: 0018:ffff8802247add58 EFLAGS: 00010246 Jan 20 19:28:22 einstein kernel: [ 22.756640] RAX: ffffffff81a7adb8 RBX: ffffffffa002da28 RCX: ffffffffa00ebca0 Jan 20 19:28:22 einstein kernel: [ 22.756764] RDX: 000000000000011b RSI: ffffffffa002da38 RDI: ffffffff81a2fba0 Jan 20 19:28:22 einstein kernel: [ 22.756888] RBP: ffff8802247add68 R08: 0000000000011f00 R09: ffff88022f411f20 Jan 20 19:28:22 einstein kernel: [ 22.757012] R10: 8000000000000000 R11: ffffea000893ecc0 R12: ffffffffa002da00 Jan 20 19:28:22 einstein kernel: [ 22.757135] R13: ffffffffa002dfb8 R14: ffffffffa002da00 R15: ffffffffa002e418 Jan 20 19:28:22 einstein kernel: [ 22.757259] FS: 00000368dc4ab780(0000) GS:ffff88022f400000(0000) knlGS:0000000000000000 Jan 20 19:28:22 einstein kernel: [ 22.757434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jan 20 19:28:22 einstein kernel: [ 22.757555] CR2: ffffffffa00ebca8 CR3: 00000000016a5000 CR4: 00000000000407f0 Jan 20 19:28:22 einstein kernel: [ 22.757679] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jan 20 19:28:22 einstein kernel: [ 22.757804] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jan 20 19:28:22 einstein kernel: [ 22.757929] Process systemd-udevd (pid: 1152, threadinfo ffff88022494ad40, task ffff88022494a850) Jan 20 19:28:22 einstein kernel: [ 22.758110] Stack: Jan 20 19:28:22 einstein kernel: [ 22.758226] ffffffffa002da00 ffffffffa002da00 ffff8802247add88 ffffffff810d6ff5 Jan 20 19:28:22 einstein kernel: [ 22.758631] 0000000000000018 ffffffffa002e080 ffff8802247adda8 ffffffff810d6651 Jan 20 19:28:22 einstein kernel: [ 22.759036] ffffffffa002e080 ffffffffa002dfa0 ffff8802247ade08 ffffffff810d8544 Jan 20 19:28:22 einstein kernel: [ 22.759441] Call Trace: Jan 20 19:28:22 einstein kernel: [ 22.759559] [<ffffffff810d6ff5>] trace_event_raw_init+0x15/0x30 Jan 20 19:28:22 einstein kernel: [ 22.759682] [<ffffffff810d6651>] event_init+0x31/0x90 Jan 20 19:28:22 einstein kernel: [ 22.759803] [<ffffffff810d8544>] trace_module_notify+0x144/0x240 Jan 20 19:28:22 einstein kernel: [ 22.759927] [<ffffffff8169265f>] notifier_call_chain+0x4f/0x80 Jan 20 19:28:22 einstein kernel: [ 22.760051] [<ffffffff810718a3>] __blocking_notifier_call_chain+0x53/0x80 Jan 20 19:28:22 einstein kernel: [ 22.760176] [<ffffffff81071903>] blocking_notifier_call_chain+0x33/0x50 Jan 20 19:28:22 einstein kernel: [ 22.760300] [<ffffffff8109e8a0>] sys_init_module+0x70/0x1f0 Jan 20 19:28:22 einstein kernel: [ 22.760423] [<ffffffff8169709d>] system_call_fastpath+0x18/0x1d Jan 20 19:28:22 einstein kernel: [ 22.760546] [<ffffffff816970c9>] ? sysret_check+0x22/0x5d Jan 20 19:28:22 einstein kernel: [ 22.760667] Code: 00 00 00 48 c7 41 18 70 03 0d 81 e9 de fe ff ff 0f 1f 00 48 c7 41 10 70 03 0d 81 48 8b 4b 28 e9 bf fe ff ff 0f 1f 80 00 00 00 00 <48> c7 41 08 70 03 0d 81 48 8b 4b 28 e9 9c fe ff ff 0f 1f 80 00 Jan 20 19:28:22 einstein kernel: [ 22.764603] RIP [<ffffffff810cfd48>] register_ftrace_event+0x218/0x2b0 Jan 20 19:28:22 einstein kernel: [ 22.764783] RSP <ffff8802247add58> Jan 20 19:28:22 einstein kernel: [ 22.764901] CR2: ffffffffa00ebca8 Jan 20 19:28:22 einstein kernel: [ 22.765019] ---[ end trace 10533a486118b2fb ]--- Booting with 3.6.8 works OK einstein ~ # emerge --info Portage 2.2.0_alpha158 (hardened/linux/amd64, gcc-4.7.2, glibc-2.16.0, 3.6.8-hardened x86_64) ================================================================= System uname: Linux-3.6.8-hardened-x86_64-Intel-R-_Core-TM-_i5-2320_CPU_@_3.00GHz-with-gentoo-2.2 KiB Mem: 8159564 total, 5461108 free KiB Swap: 16777212 total, 16777212 free Timestamp of tree: Sun, 20 Jan 2013 17:45:01 +0000 ld GNU ld (GNU Binutils) 2.23.1 app-shells/bash: 4.2_p42 dev-java/java-config: 2.1.12-r1 dev-lang/python: 2.7.3-r3, 3.2.3-r2 dev-util/cmake: 2.8.10.2-r1 dev-util/pkgconfig: 0.27.1 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.11.8 sys-apps/sandbox: 2.6 sys-devel/autoconf: 2.13, 2.69 sys-devel/automake: 1.11.6, 1.12.6, 1.13.1 sys-devel/binutils: 2.23.1 sys-devel/gcc: 4.6.3, 4.7.2 sys-devel/gcc-config: 1.8 sys-devel/libtool: 2.4.2 sys-devel/make: 3.82-r4 sys-kernel/linux-headers: 3.7 (virtual/os-headers) sys-libs/glibc: 2.16.0 Repositories: gentoo raw raiagent x11 Graham-s-Local-Portage ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -mtune=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/polkit-1/actions /var/bind /var/spool/munin-async/.ssh" CONFIG_PROTECT_MASK="${EPREFIX}/etc/gconf /etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/games/angband/edit/ /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.4/ext-active/ /etc/php/cgi-php5.4/ext-active/ /etc/php/cli-php5.4/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -mtune=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps y" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs buildpkg config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch xattr" FFLAGS="-march=native -mtune=native -O2 -pipe" GENTOO_MIRRORS="http://www.mirrorservice.org/sites/www.ibiblio.org/gentoo/ http://mirror.qubenet.net/mirror/gentoo/ http://mirrors.linuxant.fr/distfiles.gentoo.org/ ftp://mirror.qubenet.net/mirror/gentoo/ ftp://ftp.mirrorservice.org/sites/www.ibiblio.org/gentoo/" LANG="en_GB.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j5" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/raw /var/lib/layman/raiagent /var/lib/layman/x11 /usr/local/portage" SYNC="rsync://rsync.uk.gentoo.org/gentoo-portage" USE="X a52 aac acl alsa amd64 apache2 berkdb branding bzip2 cairo caps cdda cddb cli cracklib crypt cups cxx dbus directfb doc dts dvd emacs encode examples exif fam ffmpeg flac fontconfig fortran gd gdbm geoip gif gmp gnome gnome-keyring gnutls gpm gstreamer gtk hardened iconv icu imagemagick ipv6 java jpeg jpeg2k justify kde lcms libnotify lua lzma mad matroska milter mmx mng modules mp3 mpeg mudflap multilib mysql ncurses nls nptl nsplugin ogg opengl openmp pam pax_kernel pcre perl pfd png policykit postgres ppds pulseaudio python qt4 raw readline sdl semantic-desktop session speex spell sqlite sqlite3 sse sse2 sse3 ssl ssse3 startup-notification svg tcpd theora threads tiff tk truetype udev unicode urandom usb v4l vim-syntax vorbis x264 xattr xcb xml xv xvid zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="braindump flow karbon kexi krita sheets words" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en_GB en fr" PHP_TARGETS="php5-3" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_2" RUBY_TARGETS="ruby18 ruby19" USERLAND="GNU" VIDEO_CARDS="nouveau" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Can you paste your lsmod on 3.6.8 I think this problem is caused by udev trying to load the drm module via kmod.
einstein ~ # lsmod Module Size Used by nouveau 865741 2 cfbfillrect 4899 1 nouveau cfbimgblt 3336 1 nouveau video 11988 1 nouveau mxm_wmi 2196 1 nouveau wmi 9112 2 mxm_wmi,nouveau cfbcopyarea 4335 1 nouveau ttm 65921 1 nouveau fbcon 38903 76 bitblit 6274 1 fbcon softcursor 2158 1 bitblit font 8205 1 fbcon tileblit 3134 1 fbcon drm_kms_helper 26663 1 nouveau drm 239586 4 ttm,drm_kms_helper,nouveau backlight 5281 2 video,nouveau coretemp 5893 0 crc32c_intel 2940 0 fb 60494 6 fbcon,drm_kms_helper,nouveau,softcursor,tileblit,bitblit ghash_clmulni_intel 5062 0 aesni_intel 42739 0 fbdev 1631 2 fb,fbcon aes_x86_64 8460 1 aesni_intel aes_generic 26851 2 aesni_intel,aes_x86_64 iTCO_wdt 5684 0 lpc_ich 11370 0 mei 34499 0 mfd_core 3794 1 lpc_ich serio_raw 5558 0 dcdbas 6177 0 ablk_helper 2725 1 aesni_intel
I think this is a bug caused either by nouveau or drm. I'm assigining it to hardened-kernel team, but please be patient since I think they are a little busy right now. As a test I'd recommend you try blacklisting these modules (or just removing them temporarily from /lib/modules/3.7.3-hardened/ ) to be sure that's the cause of the issue. @blueness I leave it at your discretion to CC the pax team here or not.
I have removed the modules and 3.7.3 boots to completion (with the standard 80x24 console)
Then I'm 100% sure it is a kernel bug, which udev only triggers by trying to load said modules. I'll leave you with the kernel team since they are the ones that can help you.
I'm pretty sure its the kernel and not kmod: hardened-sources-3.7.3 = grsecurity-2.9.1-3.7.3-201301181518
it's a kernexec/constify bug due to some recent constification changes where i forgot to add open/close calls around the code setting various event->funcs fields in kernel/trace/trace_output.c:register_ftrace_event. will be fixed in the next patch.
(In reply to comment #7) > it's a kernexec/constify bug due to some recent constification changes where > i forgot to add open/close calls around the code setting various > event->funcs fields in kernel/trace/trace_output.c:register_ftrace_event. > will be fixed in the next patch. Please test the latest hardened-sources and see if this is still a problem.
(In reply to comment #8) > Please test the latest hardened-sources and see if this is still a problem. Hardened-sources-3.7.4-r1 does not show any problem. So, for me, it looks as though it is now fixed.