920906 – sys-cluster/ceph-18.2.0-r2 cannot load mgr plugins, import issue dev-python/bcrypt-4.1.1

Bug 920906 - sys-cluster/ceph-18.2.0-r2 cannot load mgr plugins, import issue dev-python/bcrypt-4.1.1

Summary: sys-cluster/ceph-18.2.0-r2 cannot load mgr plugins, import issue dev-python/b...

Status:	UNCONFIRMED

Alias:	None

Product:	Gentoo Linux
Classification:	Unclassified
Component:	Current packages (show other bugs)
Hardware:	All Linux

Importance:	Normal major with 1 vote (vote)
Assignee:	Patrick McLean

URL:
Whiteboard:
Keywords:

Depends on:
Blocks:

Reported:	2023-12-28 23:49 UTC by ev
Modified:	2024-01-02 13:14 UTC (History)
CC List:	4 users (show)

See Also:	https://github.com/pyca/bcrypt/issues/694 https://github.com/pyca/cryptography/issues/9016
Package list:
Runtime testing required:	---

Attachments
example of ceph-mgr import errors (example_of_ceph-mgr-import-errors.log,3.36 KB, text/x-log) 2023-12-28 23:50 UTC, ev	Details
output of emerge --info sys-cluster/ceph (emerge-info-ceph.txt,6.82 KB, text/plain) 2023-12-28 23:55 UTC, ev	Details
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description ev 2023-12-28 23:49:11 UTC

ceph-mgr fails to load python modules because some bcrypt-4.1.1 dev-python/cryptography incompatibility. 

People are discussing exactly this issue on gitub. 
fhttps://github.com/pyca/bcrypt/issues/694
https://github.com/pyca/cryptography/issues/9016

Reproducible: Always

Steps to Reproduce:
1. Install ceph cluster with dev-python/bcrypt-4.1.1 and dev-python/cryptography-41.0.7
2. run properly configured ceph-mgr
3. check ceph-mgr logs
Actual Results:  
2023-12-28T23:46:45.996+0100 7fd07340b040  0 ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mgr, pid 189047
2023-12-28T23:46:46.002+0100 7fd07340b040  1 mgr[py] Loading python module 'zabbix'
2023-12-28T23:46:46.056+0100 7fd07340b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
2023-12-28T23:46:46.056+0100 7fd07340b040  1 mgr[py] Loading python module 'volumes'
2023-12-28T23:46:46.096+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.096+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

2023-12-28T23:46:46.099+0100 7fd07340b040 -1 mgr[py] Class not found in module 'volumes'
2023-12-28T23:46:46.099+0100 7fd07340b040 -1 mgr[py] Error loading module 'volumes': (22) Invalid argument
2023-12-28T23:46:46.099+0100 7fd07340b040  1 mgr[py] Loading python module 'test_orchestrator'
2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Class not found in module 'test_orchestrator'
2023-12-28T23:46:46.142+0100 7fd07340b040 -1 mgr[py] Error loading module 'test_orchestrator': (22) Invalid argument
2023-12-28T23:46:46.142+0100 7fd07340b040  1 mgr[py] Loading python module 'telemetry'
2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Class not found in module 'telemetry'
2023-12-28T23:46:46.186+0100 7fd07340b040 -1 mgr[py] Error loading module 'telemetry': (22) Invalid argument
2023-12-28T23:46:46.186+0100 7fd07340b040  1 mgr[py] Loading python module 'telegraf'
2023-12-28T23:46:46.226+0100 7fd07340b040 -1 mgr[py] Module not found: 'mgr_module'
2023-12-28T23:46:46.226+0100 7fd07340b040 -1 mgr[py] Traceback (most recent call last):
  File "/usr/share/ceph/mgr/mgr_module.py", line 28, in <module>
    from mgr_util import profile_method
  File "/usr/share/ceph/mgr/mgr_util.py", line 6, in <module>
    import bcrypt
  File "/usr/lib/python3.11/site-packages/bcrypt/__init__.py", line 13, in <module>
    from ._bcrypt import (
ImportError: PyO3 modules compiled for CPython 3.8 or older may only be initialized once per interpreter process

Comment 1 ev 2023-12-28 23:50:56 UTC

Created attachment 880874 [details]
example of ceph-mgr import errors

Comment 2 ev 2023-12-28 23:55:52 UTC

Created attachment 880875 [details]
output of emerge --info sys-cluster/ceph