Bug 920906

Summary:	sys-cluster/ceph-18.2.0-r2 cannot load mgr plugins, import issue dev-python/bcrypt-4.1.1
Product:	Gentoo Linux	Reporter:	ev
Component:	Current packages	Assignee:	Patrick McLean <chutzpah>
Status:	UNCONFIRMED ---
Severity:	major	CC:	cluster, leonchik1976, openstack, python
Priority:	Normal
Version:	unspecified
Hardware:	All
OS:	Linux
See Also:	https://github.com/pyca/bcrypt/issues/694 https://github.com/pyca/cryptography/issues/9016
Whiteboard:
Package list:		Runtime testing required:	---
Attachments:	example of ceph-mgr import errors output of emerge --info sys-cluster/ceph

Description ev 2023-12-28 23:49:11 UTC

ceph-mgr fails to load python modules because some bcrypt-4.1.1 dev-python/cryptography incompatibility. 

People are discussing exactly this issue on gitub. 
fhttps://github.com/pyca/bcrypt/issues/694
https://github.com/pyca/cryptography/issues/9016

Reproducible: Always

Steps to Reproduce:
1. Install ceph cluster with dev-python/bcrypt-4.1.1 and dev-python/cryptography-41.0.7
2. run properly configured ceph-mgr
3. check ceph-mgr logs
Actual Results:  
2023-12-28T23:46:45.996+0100 7fd07340b040  0 ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mgr, pid 189047
2023-12-28T23:46:46.002+0100 7fd07340b040  1 mgr[py] Loading python module 'zabbix'
2023-12-28T23:46:46.056+0100 7fd07340b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
2023-12-28T23:46:46.056+0100 7fd07340b040  1 mgr[py] Loading python module 'volumes'
2023-12-28T23:46:46.096+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.096+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

2023-12-28T23:46:46.099+0100 7fd07340b040 -1 mgr[py] Class not found in module 'volumes'
2023-12-28T23:46:46.099+0100 7fd07340b040 -1 mgr[py] Error loading module 'volumes': (22) Invalid argument
2023-12-28T23:46:46.099+0100 7fd07340b040  1 mgr[py] Loading python module 'test_orchestrator'
2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Class not found in module 'test_orchestrator'
2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Error loading module 'test_orchestrator': (22) Invalid argument
2023-12-28T23:46:46.142+0100 7fd07340b040  1 mgr[py] Loading python module 'telemetry'
2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Class not found in module 'telemetry'
2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Error loading module 'telemetry': (22) Invalid argument
2023-12-28T23:46:46.186+0100 7fd07340b040  1 mgr[py] Loading python module 'telegraf'
2023-12-28T23:46:46.226+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.226+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

Comment 1 ev 2023-12-28 23:50:56 UTC

Created attachment 880874 [details]
example of ceph-mgr import errors

Comment 2 ev 2023-12-28 23:55:52 UTC

Created attachment 880875 [details]
output of emerge --info sys-cluster/ceph