Created attachment 900174 [details] example ceph crash I've experiencing ceph-osd crashes during startup after upgrade from 18.2.1 to 18.2.4-r2. It looks like OSD cannot open it's db because of missing LZ4 compression. I suspect it may be related to recent LZ4 version bump. Example from the log: 5 rocksdb: verify_sharding column families from rocksdb: [default,m-0,m-1,m-2,p-0,p-1,p-2,O-0,O-1,O-2,L,P] -1 rocksdb: Invalid argument: Compression type LZ4 is not linked with the binary. -1 bluestore(/var/lib/ceph/osd/ceph-6300) _open_db erroring opening db: The same errors do not appear in 18.2.1. I've tried to recompile obvious direct dependancies but it didn't help app-arch/lz4-1.10.0-r1 dev-libs/rocksdb-7.9.2 sys-cluster/ceph-18.2.4-r2 I'm compiling this package with patches I've mentioned here https://bugs.gentoo.org/937928. They affect only python code and shouldn't be relevant.
I think I've solved this Bluestore OSD default behavious has been changed in 18.2.4 https://ceph.io/en/news/blog/2024/v18-2-4-reef-released/ https://github.com/ceph/ceph/pull/55197/commits/61abd175fa3159c7ced7e570b483ae0642999c8f Our dev-libs/rocksdb-7.9.2 compiles without lz4 support. I had to enable WITH_LZ4 in rocksdb ebuild. It correctly enables lz4 support. -- Detecting C compile features -- Detecting C compile features - done -- Found lz4: /lib64/liblz4.so -- Performing Test HAVE_OMIT_LEAF_FRAME_POINTER -- Performing Test HAVE_OMIT_LEAF_FRAME_POINTER - Success
Created attachment 905005 [details] fixed rocksdb-7.9.2 ebuild
I should have checked dev-libs/rocksdb-7.9.2-r1 before looking into this issues. -r1 as lz4 enabled by default. If you're affected by this issue just upgrade to dev-libs/rocksdb-7.9.2-r1
*** Bug 941233 has been marked as a duplicate of this bug. ***
