Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 584828 - =dev-db/mariadb-10.0.25 crashes - mysqld got signal 11
Summary: =dev-db/mariadb-10.0.25 crashes - mysqld got signal 11
Status: RESOLVED UPSTREAM
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Unspecified (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Gentoo Linux MySQL bugs team
URL: https://jira.mariadb.org/browse/MDEV-...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-06-02 07:44 UTC by Tomáš Mózes
Modified: 2016-09-21 07:18 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
crash1.log (01-crash-mariadb-10.0.25-1.log,40.55 KB, text/plain)
2016-06-02 07:45 UTC, Tomáš Mózes
Details
crash2.log (02-crash-mariadb-10.0.25-2.log,1.06 KB, text/plain)
2016-06-02 07:45 UTC, Tomáš Mózes
Details
crash3.log (03-crash-mariadb-10.0.23-1.log,20.15 KB, text/plain)
2016-06-02 07:45 UTC, Tomáš Mózes
Details
crash4.log (04-crash-mariadb-10.0.23-2.log,23.35 KB, text/plain)
2016-06-02 07:45 UTC, Tomáš Mózes
Details
my.cnf (my.cnf,2.33 KB, text/plain)
2016-06-02 07:46 UTC, Tomáš Mózes
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Tomáš Mózes 2016-06-02 07:44:21 UTC
Hello,
after upgrading to latest stable one of our MariaDB instance started to crash. The crashes seems to be random at times like:

160527  9:34:05 [ERROR] mysqld got signal 11 ;
160527 13:52:37 [ERROR] mysqld got signal 11 ;
160530 20:46:51 [ERROR] mysqld got signal 11 ;
160602  5:32:48 [ERROR] mysqld got signal 11 ;

We have a master-slave replication. We first upgraded the slave to 10.0.25, had it running for 2 weeks without problems. Then we did a master failover, it worked for a week and then it started to crash. First it crashed on MariaDB 10.0.25, then again on 10.0.25. We downgraded to MariaDB 10.0.23, but it crashed again. Then we switched back to the old master instance (failover) with MariaDB 10.0.23, but it crashed again.

The MariaDB instances are running virtualized as Xen DomU (in pvh mode) on Linux Kernel 4.1.24 with 230GB RAM / 24 vcpus. MariaDB was compiled with the following Gentoo USE flags: "extraengine jemalloc openssl pam server".

Software versions:
glibc-2.22-r4
jemalloc-3.6.0
openssl-1.0.2h
libaio-0.3.110
zlib-1.2.8-r1

# emerge --info dev-db/mariadb
Portage 2.2.28 (python 3.4.3-final-0, default/linux/amd64/13.0, gcc-4.9.3, glibc-2.22-r4, 4.1.24-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-4.1.24-gentoo-x86_64-Intel-R-_Xeon-R-_CPU_E5-2640_0_@_2.50GHz-with-gentoo-2.2
KiB Mem:   230895320 total, 180076120 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Thu, 02 Jun 2016 00:45:01 +0000
sh bash 4.3_p42-r1
ld GNU ld (Gentoo 2.25.1 p1.1) 2.25.1
app-shells/bash:          4.3_p42-r1::gentoo
dev-lang/perl:            5.20.2::gentoo
dev-lang/python:          2.7.10-r1::gentoo, 3.4.3-r1::gentoo
dev-util/cmake:           3.3.1-r1::gentoo
dev-util/pkgconfig:       0.28-r2::gentoo
sys-apps/baselayout:      2.2::gentoo
sys-apps/openrc:          0.19.1::gentoo
sys-apps/sandbox:         2.10-r1::gentoo
sys-devel/autoconf:       2.69::gentoo
sys-devel/automake:       1.14.1::gentoo, 1.15::gentoo
sys-devel/binutils:       2.25.1-r1::gentoo
sys-devel/gcc:            4.9.3::gentoo
sys-devel/gcc-config:     1.7.3::gentoo
sys-devel/libtool:        2.4.6::gentoo
sys-devel/make:           4.1-r1::gentoo
sys-kernel/linux-headers: 4.4::gentoo (virtual/os-headers)
sys-libs/glibc:           2.22-r4::gentoo

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-mtune=native -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /var/bind"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-mtune=native -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j8"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="acl amd64 berkdb bzip2 cli cracklib crypt cxx dri fortran gdbm iconv mmx mmxext modules multilib ncurses nptl openmp pam pcre readline seccomp session sse sse2 ssl tcpd unicode xattr zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4" RUBY_TARGETS="ruby20 ruby21" USERLAND="GNU" VIDEO_CARDS="amdgpu fbdev intel nouveau radeon radeonsi vesa dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON

=================================================================
                        Package Settings
=================================================================

dev-db/mariadb-10.0.25::gentoo was built with the following:
USE="extraengine jemalloc openssl pam server -bindist -debug -embedded -latin1 -libressl -odbc -oqgraph -perl -profiling (-selinux) -sphinx -static -static-libs -systemtap -tcmalloc -test -tokudb -xml -yassl" ABI_X86="64 -32 -x32"
CFLAGS="-mtune=native -O2 -pipe -fno-strict-aliasing"
CXXFLAGS="-mtune=native -O2 -pipe -felide-constructors -fno-strict-aliasing"
Comment 1 Tomáš Mózes 2016-06-02 07:45:12 UTC
Created attachment 436138 [details]
crash1.log
Comment 2 Tomáš Mózes 2016-06-02 07:45:24 UTC
Created attachment 436140 [details]
crash2.log
Comment 3 Tomáš Mózes 2016-06-02 07:45:34 UTC
Created attachment 436142 [details]
crash3.log
Comment 4 Tomáš Mózes 2016-06-02 07:45:49 UTC
Created attachment 436144 [details]
crash4.log
Comment 5 Tomáš Mózes 2016-06-02 07:46:02 UTC
Created attachment 436146 [details]
my.cnf
Comment 7 Tomáš Mózes 2016-06-21 13:36:29 UTC
Adding Xen team to CC as it seems like a Xen related issue. Maybe we could add some note about this to the ebuild(s) once we get to something (probably via the Xen mailing list).
Comment 8 Tomáš Mózes 2016-09-21 07:18:51 UTC
This was caused by Xen PVH mode. After switching back to PV, the crashes are gone.