Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 529076 - sys-cluster/ceph-9999-r80 with sys-libs/glibc-2.20 - while running ceph non-interactively: illegal instruction in ?
Summary: sys-cluster/ceph-9999-r80 with sys-libs/glibc-2.20 - while running ceph non-i...
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Server (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Yixun Lan
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-11-12 18:37 UTC by Denis Kaganovich
Modified: 2015-03-05 21:29 UTC (History)
3 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
ceph-glibc-2.20-double-unlock.patch (ceph-glibc-2.20-double-unlock.patch,1.45 KB, patch)
2014-11-21 09:23 UTC, Denis Kaganovich
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Denis Kaganovich 2014-11-12 18:37:46 UTC
After upgrading to glibc 2.20, "ceph" command line tool (in non-interactive form) exiting (after job OK) with "Illegal instruction" message and error exit code. This is still functional, but broken for scripting (like "ceph <cmd> && ...). Pyhon 2.7.7 (or trying 2.7.8 with ceph-specific rollback patch - same).

PS Trying "ceph" tool from both last stable trees - "firefly" & "giant".

Reproducible: Always
Comment 1 Denis Kaganovich 2014-11-12 18:46:00 UTC
I just trying "rbd ls"... There are similar result, but much more output (after "ls"):

*** Caught signal (Illegal instruction) **
 in thread 7f21f64d0800
 ceph version 0.80.7-124-g0804dee (0804deeab293e09123d1b58825051ccc4dddbc0e)
 1: rbd() [0x42f27f]
 2: (()+0x33b20) [0x7f21f3f3fb20]
 3: (pthread_rwlock_unlock()+0x12) [0x7f21f4e2c402]
 4: (librados::RadosClient::~RadosClient()+0x125) [0x7f21f5160195]
 5: (librados::RadosClient::~RadosClient()+0x9) [0x7f21f5160319]
 6: (librados::Rados::shutdown()+0x36) [0x7f21f5133136]
 7: (main()+0x392) [0x40eac2]
 8: (__libc_start_main()+0xf0) [0x7f21f3f2bfa0]
 9: rbd() [0x4159ce]
2014-11-12 21:42:23.254063 7f21f64d0800 -1 *** Caught signal (Illegal instruction) **
 in thread 7f21f64d0800

 ceph version 0.80.7-124-g0804dee (0804deeab293e09123d1b58825051ccc4dddbc0e)
 1: rbd() [0x42f27f]
 2: (()+0x33b20) [0x7f21f3f3fb20]
 3: (pthread_rwlock_unlock()+0x12) [0x7f21f4e2c402]
 4: (librados::RadosClient::~RadosClient()+0x125) [0x7f21f5160195]
 5: (librados::RadosClient::~RadosClient()+0x9) [0x7f21f5160319]
 6: (librados::Rados::shutdown()+0x36) [0x7f21f5133136]
 7: (main()+0x392) [0x40eac2]
 8: (__libc_start_main()+0xf0) [0x7f21f3f2bfa0]
 9: rbd() [0x4159ce]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
   -80> 2014-11-12 21:42:23.236671 7f21f64d0800  5 asok(0x121a800) register_command perfcounters_dump hook 0x121a7e0
   -79> 2014-11-12 21:42:23.236698 7f21f64d0800  5 asok(0x121a800) register_command 1 hook 0x121a7e0
   -78> 2014-11-12 21:42:23.236706 7f21f64d0800  5 asok(0x121a800) register_command perf dump hook 0x121a7e0
   -77> 2014-11-12 21:42:23.236714 7f21f64d0800  5 asok(0x121a800) register_command perfcounters_schema hook 0x121a7e0
   -76> 2014-11-12 21:42:23.236726 7f21f64d0800  5 asok(0x121a800) register_command 2 hook 0x121a7e0
   -75> 2014-11-12 21:42:23.236731 7f21f64d0800  5 asok(0x121a800) register_command perf schema hook 0x121a7e0
   -74> 2014-11-12 21:42:23.236737 7f21f64d0800  5 asok(0x121a800) register_command config show hook 0x121a7e0
   -73> 2014-11-12 21:42:23.236742 7f21f64d0800  5 asok(0x121a800) register_command config set hook 0x121a7e0
   -72> 2014-11-12 21:42:23.236747 7f21f64d0800  5 asok(0x121a800) register_command config get hook 0x121a7e0
   -71> 2014-11-12 21:42:23.236752 7f21f64d0800  5 asok(0x121a800) register_command log flush hook 0x121a7e0
   -70> 2014-11-12 21:42:23.236757 7f21f64d0800  5 asok(0x121a800) register_command log dump hook 0x121a7e0
   -69> 2014-11-12 21:42:23.236764 7f21f64d0800  5 asok(0x121a800) register_command log reopen hook 0x121a7e0
   -68> 2014-11-12 21:42:23.239829 7f21f64d0800 10 monclient(hunting): build_initial_monmap
   -67> 2014-11-12 21:42:23.239937 7f21f64d0800  1 librados: starting msgr at :/0
   -66> 2014-11-12 21:42:23.239951 7f21f64d0800  1 librados: starting objecter
   -65> 2014-11-12 21:42:23.239987 7f21f64d0800  1 -- :/0 messenger.start
   -64> 2014-11-12 21:42:23.240005 7f21f64d0800  1 librados: setting wanted keys
   -63> 2014-11-12 21:42:23.240009 7f21f64d0800  1 librados: calling monclient init
   -62> 2014-11-12 21:42:23.240011 7f21f64d0800 10 monclient(hunting): init
   -61> 2014-11-12 21:42:23.240016 7f21f64d0800  5 adding auth protocol: cephx
   -60> 2014-11-12 21:42:23.240020 7f21f64d0800 10 monclient(hunting): auth_supported 2 method cephx
   -59> 2014-11-12 21:42:23.240204 7f21f64d0800  2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring
   -58> 2014-11-12 21:42:23.240278 7f21f64d0800 10 monclient(hunting): _reopen_session rank -1 name 
   -57> 2014-11-12 21:42:23.240336 7f21f64d0800 10 monclient(hunting): picked mon.a con 0x12275e0 addr 10.227.227.101:6789/0
   -56> 2014-11-12 21:42:23.240365 7f21f64d0800 10 monclient(hunting): _send_mon_message to mon.a at 10.227.227.101:6789/0
   -55> 2014-11-12 21:42:23.240372 7f21f64d0800  1 -- :/1071357 --> 10.227.227.101:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x1227a40 con 0x12275e0
   -54> 2014-11-12 21:42:23.240388 7f21f64d0800 10 monclient(hunting): renew_subs
   -53> 2014-11-12 21:42:23.240400 7f21f64d0800 10 monclient(hunting): authenticate will time out at 2014-11-12 21:47:23.240399
   -52> 2014-11-12 21:42:23.240985 7f21f64c8700  1 -- 10.227.227.105:0/1071357 learned my addr 10.227.227.105:0/1071357
   -51> 2014-11-12 21:42:23.241821 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 1 ==== mon_map v1 ==== 473+0+0 (505717684 0 0) 0x7f21e0000bd0 con 0x12275e0
   -50> 2014-11-12 21:42:23.241865 7f21f1d56700 10 monclient(hunting): handle_monmap mon_map v1
   -49> 2014-11-12 21:42:23.241883 7f21f1d56700 10 monclient(hunting):  got monmap 1, mon.a is now rank 0
   -48> 2014-11-12 21:42:23.241889 7f21f1d56700 10 monclient(hunting): dump:
epoch 1
fsid 4fc73849-f913-4689-b6a6-efcefccae8d1
last_changed 2013-05-28 18:43:12.325687
created 2013-05-28 18:43:12.325687
0: 10.227.227.101:6789/0 mon.a
1: 10.227.227.103:6789/0 mon.b
2: 10.227.227.104:6789/0 mon.c

   -47> 2014-11-12 21:42:23.241931 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3914553092 0 0) 0x7f21e0001080 con 0x12275e0
   -46> 2014-11-12 21:42:23.241985 7f21f1d56700 10 monclient(hunting): my global_id is 1917150
   -45> 2014-11-12 21:42:23.242145 7f21f1d56700 10 monclient(hunting): _send_mon_message to mon.a at 10.227.227.101:6789/0
   -44> 2014-11-12 21:42:23.242156 7f21f1d56700  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0 0x7f21e40017c0 con 0x12275e0
   -43> 2014-11-12 21:42:23.242881 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2469527312 0 0) 0x7f21e0001080 con 0x12275e0
   -42> 2014-11-12 21:42:23.242968 7f21f1d56700 10 monclient(hunting): _send_mon_message to mon.a at 10.227.227.101:6789/0
   -41> 2014-11-12 21:42:23.242977 7f21f1d56700  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+0 0x7f21e4001e90 con 0x12275e0
   -40> 2014-11-12 21:42:23.243659 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 393+0+0 (1710929821 0 0) 0x7f21e00008c0 con 0x12275e0
   -39> 2014-11-12 21:42:23.243717 7f21f1d56700  1 monclient(hunting): found mon.a
   -38> 2014-11-12 21:42:23.243722 7f21f1d56700 10 monclient: _send_mon_message to mon.a at 10.227.227.101:6789/0
   -37> 2014-11-12 21:42:23.243728 7f21f1d56700  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x1227f00 con 0x12275e0
   -36> 2014-11-12 21:42:23.243779 7f21f64d0800  5 monclient: authenticate success, global_id 1917150
   -35> 2014-11-12 21:42:23.243821 7f21f64d0800  5 asok(0x121a800) register_command objecter_requests hook 0x1228110
   -34> 2014-11-12 21:42:23.243879 7f21f64d0800 10 monclient: renew_subs
   -33> 2014-11-12 21:42:23.243885 7f21f64d0800 10 monclient: _send_mon_message to mon.a at 10.227.227.101:6789/0
   -32> 2014-11-12 21:42:23.243895 7f21f64d0800  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -- ?+0 0x1227a40 con 0x12275e0
   -31> 2014-11-12 21:42:23.243910 7f21f64d0800 10 monclient: renew_subs
   -30> 2014-11-12 21:42:23.243913 7f21f64d0800 10 monclient: _send_mon_message to mon.a at 10.227.227.101:6789/0
   -29> 2014-11-12 21:42:23.243918 7f21f64d0800  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -- ?+0 0x1229160 con 0x12275e0
   -28> 2014-11-12 21:42:23.243946 7f21f64d0800  1 librados: init done
   -27> 2014-11-12 21:42:23.244313 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 5 ==== mon_map v1 ==== 473+0+0 (505717684 0 0) 0x7f21e00012f0 con 0x12275e0
   -26> 2014-11-12 21:42:23.244330 7f21f1d56700 10 monclient: handle_monmap mon_map v1
   -25> 2014-11-12 21:42:23.244345 7f21f1d56700 10 monclient:  got monmap 1, mon.a is now rank 0
   -24> 2014-11-12 21:42:23.244349 7f21f1d56700 10 monclient: dump:
epoch 1
fsid 4fc73849-f913-4689-b6a6-efcefccae8d1
last_changed 2013-05-28 18:43:12.325687
created 2013-05-28 18:43:12.325687
0: 10.227.227.101:6789/0 mon.a
1: 10.227.227.103:6789/0 mon.b
2: 10.227.227.104:6789/0 mon.c

   -23> 2014-11-12 21:42:23.244382 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2160789602 0 0) 0x7f21e0001590 con 0x12275e0
   -22> 2014-11-12 21:42:23.244393 7f21f1d56700 10 monclient: handle_subscribe_ack sent 2014-11-12 21:42:23.240391 renew after 2014-11-12 21:44:53.240391
   -21> 2014-11-12 21:42:23.247283 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 7 ==== osd_map(79561..79561 src has 78135..79561) v3 ==== 94482+0+0 (4079190998 0 0) 0x7f21e00008c0 con 0x12275e0
   -20> 2014-11-12 21:42:23.248914 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 8 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2160789602 0 0) 0x7f21e00184e0 con 0x12275e0
   -19> 2014-11-12 21:42:23.248927 7f21f1d56700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring
   -18> 2014-11-12 21:42:23.248932 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 9 ==== osd_map(79561..79561 src has 78135..79561) v3 ==== 94482+0+0 (4079190998 0 0) 0x7f21e002f920 con 0x12275e0
   -17> 2014-11-12 21:42:23.248946 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== mon.0 10.227.227.101:6789/0 10 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2160789602 0 0) 0x7f21e002fdc0 con 0x12275e0
   -16> 2014-11-12 21:42:23.248954 7f21f1d56700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring
   -15> 2014-11-12 21:42:23.249032 7f21f64d0800  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6810/32749 -- osd_op(client.1917150.0:1 rbd_directory [read 0~0] 2.30a98c1c ack+read e79561) v4 -- ?+0 0x122a790 con 0x1229d70
   -14> 2014-11-12 21:42:23.251299 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== osd.0 10.227.227.101:6810/32749 1 ==== osd_op_reply(1 rbd_directory [read 0~109] v0'0 uv282471 ondisk = 0) v6 ==== 180+0+109 (1476285171 0 3731283201) 0x7f21dc000c70 con 0x1229d70
   -13> 2014-11-12 21:42:23.251418 7f21f64d0800  1 -- 10.227.227.105:0/1071357 --> 10.227.227.101:6810/32749 -- osd_op(client.1917150.0:2 rbd_directory [call rbd.dir_list] 2.30a98c1c ack+read e79561) v4 -- ?+0 0x122a790 con 0x1229d70
   -12> 2014-11-12 21:42:23.253222 7f21f1d56700  1 -- 10.227.227.105:0/1071357 <== osd.0 10.227.227.101:6810/32749 2 ==== osd_op_reply(2 rbd_directory [call] v0'0 uv282471 ondisk = 0) v6 ==== 180+0+823 (3757076840 0 2169796863) 0x7f21dc000c70 con 0x1229d70
   -11> 2014-11-12 21:42:23.253436 7f21f64d0800  1 -- 10.227.227.105:0/1071357 mark_down 0x1229d70 -- 0x1229ae0
   -10> 2014-11-12 21:42:23.253505 7f21f64d0800 10 monclient: shutdownshutdown
    -9> 2014-11-12 21:42:23.253483 7f21eeb4e700  2 -- 10.227.227.105:0/1071357 >> 10.227.227.101:6810/32749 pipe(0x1229ae0 sd=4 :36480 s=4 pgs=54 cs=1 l=1 c=0x1229d70).reader couldn't read tag, (0) Success
    -8> 2014-11-12 21:42:23.253512 7f21eeb4e700  2 -- 10.227.227.105:0/1071357 >> 10.227.227.101:6810/32749 pipe(0x1229ae0 sd=4 :36480 s=4 pgs=54 cs=1 l=1 c=0x1229d70).fault (0) Success
    -7> 2014-11-12 21:42:23.253535 7f21f64d0800  1 -- 10.227.227.105:0/1071357 mark_down 0x12275e0 -- 0x1227350
    -6> 2014-11-12 21:42:23.253562 7f21f64d0800  5 asok(0x121a800) unregister_command objecter_requests
    -5> 2014-11-12 21:42:23.253575 7f21f64d0800  1 -- 10.227.227.105:0/1071357 mark_down_all
    -4> 2014-11-12 21:42:23.253559 7f21efd52700  2 -- 10.227.227.105:0/1071357 >> 10.227.227.101:6789/0 pipe(0x1227350 sd=3 :55320 s=4 pgs=12684 cs=1 l=1 c=0x12275e0).reader couldn't read tag, (0) Success
    -3> 2014-11-12 21:42:23.253587 7f21efd52700  2 -- 10.227.227.105:0/1071357 >> 10.227.227.101:6789/0 pipe(0x1227350 sd=3 :55320 s=4 pgs=12684 cs=1 l=1 c=0x12275e0).fault (0) Success
    -2> 2014-11-12 21:42:23.253659 7f21f64d0800  1 -- 10.227.227.105:0/1071357 shutdown complete.
    -1> 2014-11-12 21:42:23.253668 7f21f64d0800  1 librados: shutdown
     0> 2014-11-12 21:42:23.254063 7f21f64d0800 -1 *** Caught signal (Illegal instruction) **
 in thread 7f21f64d0800

 ceph version 0.80.7-124-g0804dee (0804deeab293e09123d1b58825051ccc4dddbc0e)
 1: rbd() [0x42f27f]
 2: (()+0x33b20) [0x7f21f3f3fb20]
 3: (pthread_rwlock_unlock()+0x12) [0x7f21f4e2c402]
 4: (librados::RadosClient::~RadosClient()+0x125) [0x7f21f5160195]
 5: (librados::RadosClient::~RadosClient()+0x9) [0x7f21f5160319]
 6: (librados::Rados::shutdown()+0x36) [0x7f21f5133136]
 7: (main()+0x392) [0x40eac2]
 8: (__libc_start_main()+0xf0) [0x7f21f3f2bfa0]
 9: rbd() [0x4159ce]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
   0/ 5 none
   0/ 1 lockdep
   0/ 1 context
   1/ 1 crush
   1/ 5 mds
   1/ 5 mds_balancer
   1/ 5 mds_locker
   1/ 5 mds_log
   1/ 5 mds_log_expire
   1/ 5 mds_migrator
   0/ 1 buffer
   0/ 1 timer
   0/ 1 filer
   0/ 1 striper
   0/ 1 objecter
   0/ 5 rados
   0/ 5 rbd
   0/ 5 journaler
   0/ 5 objectcacher
   0/ 5 client
   0/ 5 osd
   0/ 5 optracker
   0/ 5 objclass
   1/ 3 filestore
   1/ 3 keyvaluestore
   1/ 3 journal
   0/ 5 ms
   1/ 5 mon
   0/10 monc
   1/ 5 paxos
   0/ 5 tp
   1/ 5 auth
   1/ 5 crypto
   1/ 1 finisher
   1/ 5 heartbeatmap
   1/ 5 perfcounter
   1/ 5 rgw
   1/10 civetweb
   1/ 5 javaclient
   1/ 5 asok
   1/ 1 throttle
  -2/-2 (syslog threshold)
  99/99 (stderr threshold)
  max_recent       500
  max_new         1000
  log_file 
--- end dump of recent events ---
reraise_fatal: default handler for signal 4 didn't terminate the process?
Comment 2 Alex Xu (Hello71) 2014-11-12 22:53:53 UTC
Please paste the output of emerge --info sys-libs/glibc sys-cluster/ceph as a comment.
Comment 3 Denis Kaganovich 2014-11-13 10:09:04 UTC
!!! Repository 'local-portage' is missing masters attribute in '/usr/local/portage/metadata/layout.conf'
!!! Set 'masters = gentoo' in this file for future compatibility
Portage 2.2.14 (python 2.7.7-final-0, default/linux/amd64/13.0, gcc-4.9.2, glibc-2.19-r1, 3.17.2 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-3.17.2-x86_64-Intel-R-_Xeon-R-_CPU_E5-2620_0_@_2.00GHz-with-gentoo-2.2
KiB Mem:    66013604 total,    770884 free
KiB Swap:          0 total,         0 free
Timestamp of tree: Thu, 13 Nov 2014 00:30:01 +0000
ld GNU ld (Gentoo 2.24 p1.4) 2.24
ccache version 3.1.10 [disabled]
app-shells/bash:          4.3_p30-r1
dev-java/java-config:     2.2.0
dev-lang/perl:            5.20.1-r2
dev-lang/python:          2.7.7, 3.3.5-r1, 3.4.2
dev-util/ccache:          3.1.10-r1
dev-util/cmake:           2.8.12.2-r2
dev-util/pkgconfig:       0.28-r2
sys-apps/baselayout:      2.2
sys-apps/openrc:          0.13.4
sys-apps/sandbox:         2.6-r1
sys-devel/autoconf:       2.69
sys-devel/automake:       1.12.6, 1.14.1
sys-devel/binutils:       2.24-r3
sys-devel/gcc:            4.9.2
sys-devel/gcc-config:     1.8
sys-devel/libtool:        2.4.3-r2
sys-devel/make:           4.1-r1
sys-kernel/linux-headers: 3.17-r1 (virtual/os-headers)
sys-libs/glibc:           2.19-r1::shared-local-portage
Repositories: gentoo raw mysql local-portage shared-local-portage
ACCEPT_KEYWORDS="amd64 x86 ~amd64 ~x86"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O3 -Ofast -mtune=native -march=native -fno-ident -pipe -mfpmath=both -ffast-math -fexcess-precision=fast -fpeel-loops -fomit-frame-pointer -momit-leaf-frame-pointer -minline-stringops-dynamically -maccumulate-outgoing-args -fivopts -funroll-loops -ftracer -fbranch-target-load-optimize2 -ftree-loop-distribution -ftree-loop-im -ftree-loop-ivcanon -fgraphite-identity -ftree-loop-linear -fmodulo-sched -fmodulo-sched-allow-regmoves -freschedule-modulo-scheduled-loops -fgcse-after-reload -fipa-cp-clone -fpredictive-commoning -ftree-loop-distribute-patterns -funswitch-loops -ftree-vectorize -fvect-cost-model -ftree-partial-pre -finline-small-functions -findirect-inlining -fno-inline-functions -fno-tree-loop-linear -fno-graphite-identity"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt /var/bind"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CPPFLAGS=""
CXXFLAGS="-O3 -Ofast -mtune=native -march=native -fno-ident -pipe -mfpmath=both -ffast-math -fexcess-precision=fast -fpeel-loops -fomit-frame-pointer -momit-leaf-frame-pointer -minline-stringops-dynamically -maccumulate-outgoing-args -fivopts -funroll-loops -ftracer -fbranch-target-load-optimize2 -ftree-loop-distribution -ftree-loop-im -ftree-loop-ivcanon -fgraphite-identity -ftree-loop-linear -fmodulo-sched -fmodulo-sched-allow-regmoves -freschedule-modulo-scheduled-loops -fgcse-after-reload -fipa-cp-clone -fpredictive-commoning -ftree-loop-distribute-patterns -funswitch-loops -ftree-vectorize -fvect-cost-model -ftree-partial-pre -finline-small-functions -findirect-inlining -fno-inline-functions -fno-tree-loop-linear -fno-graphite-identity -fvisibility-inlines-hidden"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://10.200.200.206/gentoo-portage/ ftp://ftp.byfly.by/pub/gentoo-distfiles/ http://distfiles.gentoo.org"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common"
MAKEOPTS="-j5 -s"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--exclude=/metadata/cache --whole-file --no-compress --inplace --compress-level=1 -q -c"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/raw /var/lib/layman/mysql /usr/local/portage /mnt/ceph1/local-portage"
SYNC="rsync://10.200.200.206/gentoo-portage/"
USE="acl acpi aio amd64 avx berkdb build-kernel bzip2 cli cracklib crypt custom-arch custom-cflags cxx embed-hardware extensions fortran fuse gdbm graphite iconv idn ipv6 libatomic libnet lto mmx modules multilib multitarget ncurses nls nptl ntp numa openipmi openmp pcre perl profile python2 radosgw rbd readline rt session sse sse2 sse4_1 ssl ssse3 subversion tcmalloc threads unicode update-boot urandom usb winbind xattr xz zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias access_compat auth_digest" APACHE2_MPMS="event" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" RUBY_TARGETS="ruby19" USERLAND="GNU" VIDEO_CARDS="fbdev glint intel mach64 mga nouveau nv r128 radeon savage sis tdfx trident vesa via vmware dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, USE_PYTHON

=================================================================
                        Package Settings
=================================================================

sys-libs/glibc-2.19-r1 was built with the following:
USE="(multilib) profile -debug -gd (-hardened) -nscd (-selinux) -suid -systemtap -vanilla" ABI_X86="64"
CFLAGS="-mtune=native -march=native -fno-ident -pipe -O2 -fno-strict-aliasing -fno-stack-protector"
CXXFLAGS="-mtune=native -march=native -fno-ident -pipe -O2 -fno-strict-aliasing -fno-stack-protector"


sys-cluster/ceph-9999-r80 was built with the following:
USE="fuse libatomic radosgw tcmalloc xfs -debug -gtk -static-libs" ABI_X86="64"
Comment 4 Denis Kaganovich 2014-11-13 10:11:55 UTC
PS ceph: ebuild, based on mainstream git ebuild, but with fixed branch ("firefly" now). glibc: I was try also sanitized (CFLAGS="-O2", -profile, etc) version. All same.
Comment 5 Denis Kaganovich 2014-11-14 10:45:37 UTC
PPS Sorry, this is rollbacked info with masked glibc 2.20 and unblocked version rollback. Too  dangerous keep broken scripts too long, sorry. Nothing more changes.
Comment 6 Denis Kaganovich 2014-11-21 09:23:06 UTC
Created attachment 389934 [details, diff]
ceph-glibc-2.20-double-unlock.patch

Fastfixed, working for me.

More info: https://sourceware.org/bugzilla/show_bug.cgi?id=17561
In short, gcc 2.20 annoying double pthread_rwlock_unlock() (or unlocking not locked rwlock) and will not be fixed.
Comment 7 Denis Kaganovich 2014-11-21 09:30:55 UTC
*glibc, not gcc
Comment 8 Denis Kaganovich 2014-11-21 15:16:57 UTC
Probably patch is wrong. I have growing "slow requests" and rollback.
Comment 9 Denis Kaganovich 2015-01-12 10:51:26 UTC
Fixed upstream, but only for master branch. So, FYI:
https://github.com/ceph/ceph/commit/cf2104d4d991361c53f6e2fea93b69de10cd654b.patch

And to similar goal (ceph ~amd64, don't want to open new bug) - patch for latest boost:
https://github.com/ceph/ceph/commit/a53ead14c113047567177630b4906136a2109b65.patch

- both works for me on "giant" stable release [snapshot].
Comment 10 Yixun Lan archtester gentoo-dev 2015-03-03 09:50:17 UTC
hi, I believe this should be fixed at version 0.87.1 and 0.93 (not sure 0.80.8)

ceph # qlist -ICv ceph glibc
sys-cluster/ceph-0.93
sys-libs/glibc-2.20-r1
Comment 11 Yixun Lan archtester gentoo-dev 2015-03-03 21:37:21 UTC
problem still exist at version 0.87.1
Comment 12 Hendrik v. Raven 2015-03-05 11:40:21 UTC
It apears to be this problem, which is fixed in the master branch, but isn't in 0.87.1: http://tracker.ceph.com/issues/10085

The corresponding patch is here
https://github.com/ceph/ceph/commit/77deeaa4ffa247a2c93599d2d135416d35912a3f
Applying it to the 0.87.1 ebuild fixed the problem
Comment 13 Yixun Lan archtester gentoo-dev 2015-03-05 21:28:07 UTC
(In reply to Hendrik v. Raven from comment #12)
> It apears to be this problem, which is fixed in the master branch, but isn't
> in 0.87.1: http://tracker.ceph.com/issues/10085
> 
> The corresponding patch is here
> https://github.com/ceph/ceph/commit/77deeaa4ffa247a2c93599d2d135416d35912a3f
> Applying it to the 0.87.1 ebuild fixed the problem

oh, this already reported at comment #6

and yes, I tested this patch couple days ago, it worked fine, but just haven't got time to commit..

now it's fixed in tree, thanks all ;-)
Comment 14 Yixun Lan archtester gentoo-dev 2015-03-05 21:29:57 UTC
oh, btw, I didn't do a revision bump.. so have to emerge this package

+  05 Mar 2015; Yixun Lan <dlan@gentoo.org> ceph-0.87.1.ebuild,
+  +files/ceph-0.87.1-glibc-2.20.patch:
+  fix segfault if using =glibc-2.20, bug 529076