Good afternoon. On the server I use Gentoo_x64. The server is Apache, and nGinx, and a major project with php and postgres database. Also, the server virtualization Xen. Not so long ago, about a month ago, I began to pay attention to the server, suddenly gaining a minute LA from 3 to 15. And begin to drop off services (apache, exim, sshd, monit, nGinx, Xen and others). I have long experimented with apache, because I thought that it flows(leaks). But today, when rebooted the server that received the message (in the attached picture, I'm sorry the text is not able to save only the screenshot) Reproducible: Always Actual Results: In picture Portage 2.1.10.49 (default/linux/amd64/10.0/server, gcc-4.5.3, glibc-2.13-r4, 3.2.1-gentoo-r2 x86_64) ================================================================= System uname: Linux-3.2.1-gentoo-r2-x86_64-Intel-R-_Xeon-R-_CPU_E5645_@_2.40GHz-with-gentoo-2.0.3 Timestamp of tree: Wed, 18 Apr 2012 11:30:01 +0000 app-shells/bash: 4.2_p20 dev-java/java-config: 2.1.11-r3 dev-lang/python: 2.7.2-r3, 3.1.4-r3, 3.2.2 dev-util/cmake: 2.8.6-r4 dev-util/pkgconfig: 0.26 sys-apps/baselayout: 2.0.3 sys-apps/openrc: 0.9.8.4 sys-apps/sandbox: 2.5 sys-devel/autoconf: 2.68 sys-devel/automake: 1.11.1 sys-devel/binutils: 2.21.1-r1 sys-devel/gcc: 4.5.3-r2 sys-devel/gcc-config: 1.5-r2 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82-r1 sys-kernel/linux-headers: 3.1 (virtual/os-headers) sys-libs/glibc: 2.13-r4 Repositories: gentoo zugaina barzog-overlay sunrise godin ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O2 -pipe" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks ebuild-locks fixlafiles getbinpkg news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" FFLAGS="" GENTOO_MIRRORS="http://mirror.yandex.ru/gentoo-distfiles/ ftp://mirror.yandex.ru/gentoo-distfiles/" LANG="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="en ru" MAKEOPTS="-j12" PKGDIR="/usr/portage/distfiles" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/zugaina /var/lib/layman/barzog-overlay /var/lib/layman/sunrise /var/lib/layman/godin" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="acl amd64 bash-completion berkdb bzip2 cdr cli cracklib crypt cups cxx dri dvd fortran gdbm gpm iconv ipv6 mmx modules mudflap multilib multiuser ncurses nls nptl nptlonly openmp pam pcre php php5 postgres postgresql pppd python readline session snmp sqlite sse sse2 ssl sysfs tcpd truetype unicode userlocales vim-syntax xml xorg zlib zsh-completion" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias asis auth_digest authn_dbd cern_meta charset_lite imagemap reqtimeout substitute version" APACHE2_MPMS="prefork" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en ru" NGINX_MODULES_HTTP="access auth_basic autoindex browser charset empty_gif fastcgi geo gzip limit_req limit_zone map memcached proxy referer rewrite scgi split_clients ssi upstream_ip_hash userid uwsgi addition cache_purge dav flv geoip gzip_static headers_more image_filter mp4 perl push realip secure_link slowfs_cache stub_status sub upload upload_progress xslt" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="fbdev glint intel mach64 mga neomagic nouveau nv r128 radeon savage sis tdfx trident vesa via vmware dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Created attachment 309585 [details] BUG trace
Give a piece of log system which again XEN: Apr 16 11:00:02 test kernel: [1449249.557240] hrtimer: interrupt took 19944419 ns Apr 18 17:52:03 test kernel: [1646777.729973] INFO: rcu_sched detected stalls on CPUs/tasks: { 11} (detected by 6, t=60002 jiffies) Apr 18 17:52:03 test kernel: [1646777.729989] Pid: 0, comm: swapper/6 Not tainted 3.2.1-gentoo-r2 #5 Apr 18 17:52:03 test kernel: [1646777.729993] Call Trace: Apr 18 17:52:03 test kernel: [1646777.729996] [] __rcu_pending+0x3b4/0x410 Apr 18 17:52:03 test kernel: [1646777.730015] [] ? tick_nohz_handler+0xf0/0xf0 Apr 18 17:52:03 test kernel: [1646777.730021] [] rcu_check_callbacks+0x75/0x1b0 Apr 18 17:52:03 test kernel: [1646777.730030] [] update_process_times+0x43/0x80 Apr 18 17:52:03 test kernel: [1646777.730036] [] tick_sched_timer+0x5f/0xb0 Apr 18 17:52:03 test kernel: [1646777.730043] [] __run_hrtimer+0x7f/0x1d0 Apr 18 17:52:03 test kernel: [1646777.730051] [] ? xen_spin_lock+0xa5/0x110 Apr 18 17:52:03 test kernel: [1646777.730057] [] hrtimer_interrupt+0xd2/0x210 Apr 18 17:52:03 test kernel: [1646777.730064] [] xen_timer_interrupt+0x2f/0x1b0 Apr 18 17:52:03 test kernel: [1646777.730071] [] ? _raw_spin_lock_irq+0x10/0x20 Apr 18 17:52:03 test kernel: [1646777.730077] [] ? run_timer_softirq+0x1e9/0x3a0 Apr 18 17:52:03 test kernel: [1646777.730084] [] handle_irq_event_percpu+0x5d/0x210 Apr 18 17:52:03 test kernel: [1646777.730090] [] handle_percpu_irq+0x43/0x60 Apr 18 17:52:03 test kernel: [1646777.730097] [] __xen_evtchn_do_upcall+0x19d/0x260 Apr 18 17:52:03 test kernel: [1646777.730103] [] xen_evtchn_do_upcall+0x2a/0x40 Apr 18 17:52:03 test kernel: [1646777.730110] [] xen_do_hypervisor_callback+0x1e/0x30 Apr 18 17:52:03 test kernel: [1646777.730113] [] ? hypercall_page+0x3aa/0x1000 Apr 18 17:52:03 test kernel: [1646777.730124] [] ? hypercall_page+0x3aa/0x1000 Apr 18 17:52:03 test kernel: [1646777.730130] [] ? xen_safe_halt+0x10/0x20 Apr 18 17:52:03 test kernel: [1646777.730136] [] ? default_idle+0x58/0x180 Apr 18 17:52:03 test kernel: [1646777.730142] [] ? cpu_idle+0x86/0xc0 Apr 18 17:52:03 test kernel: [1646777.730148] [] ? xen_irq_enable_direct_reloc+0x4/0x4 Apr 18 17:52:03 test kernel: [1646777.730155] [] ? cpu_bringup_and_idle+0xe/0x10 Apr 18 17:52:23 test kernel: [1646798.224974] INFO: rcu_bh detected stalls on CPUs/tasks: { 11} (detected by 7, t=60002 jiffies) Apr 18 17:52:23 test kernel: [1646798.224992] Pid: 0, comm: swapper/7 Not tainted 3.2.1-gentoo-r2 #5
Is this still an issue with later kernels?
