Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 950259 - dev-python/zstandard-0.23.0-r2: [clang] cffi.CDefError: parse error
Summary: dev-python/zstandard-0.23.0-r2: [clang] cffi.CDefError: parse error
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal
Assignee: Python Gentoo Team
URL:
Whiteboard:
Keywords: PullRequest
: 951915 (view as bug list)
Depends on:
Blocks: systemwide-clang
  Show dependency tree
 
Reported: 2025-02-24 23:55 UTC by scv
Modified: 2025-03-23 14:57 UTC (History)
12 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build log (file_950259.txt,8.84 KB, text/plain)
2025-02-24 23:55 UTC, scv
Details
problematic tmp file (file_950259.txt,177.96 KB, text/plain)
2025-02-25 11:25 UTC, scv
Details

Note You need to log in before you can comment on or make changes to this bug.
Description scv 2025-02-24 23:55:59 UTC
Created attachment 919875 [details]
build log

Portage 3.0.67 (python 3.12.9-final-0, default/linux/amd64/23.0/musl/llvm, [unavailable], musl-1.2.5-r3, 6.6.74 x86_64)
=================================================================
System uname: Linux-6.6.74-x86_64-AMD_Ryzen_7_5800X_8-Core_Processor-with-libc
KiB Mem:    32761096 total,  23230992 free
KiB Swap:   33554428 total,  33554428 free
Timestamp of repository gentoo: Mon, 24 Feb 2025 16:05:43 +0000
Head commit of repository gentoo: 64d05de539aa4cd3eebcdef1bb86f02cc86d68c2

sh bash 5.2_p37
ld GNU ld (Gentoo 2.44 p1) 2.44.0
app-misc/pax-utils:        1.3.8::gentoo
app-shells/bash:           5.2_p37::gentoo
dev-build/autoconf:        2.72-r1::gentoo
dev-build/automake:        1.16.5-r2::gentoo, 1.17-r1::gentoo
dev-build/cmake:           3.31.5::gentoo
dev-build/libtool:         2.5.4::gentoo
dev-build/make:            4.4.1-r100::gentoo
dev-build/meson:           1.7.0::gentoo
dev-lang/perl:             5.40.0-r1::gentoo
dev-lang/python:           3.12.9::gentoo, 3.13.2::gentoo
dev-lang/rust:             1.85.0::gentoo
llvm-core/clang:           19.1.7::gentoo
llvm-core/lld:             19.1.7::gentoo
llvm-core/llvm:            19.1.7::gentoo
sys-apps/baselayout:       2.17::gentoo
sys-apps/openrc:           0.56::gentoo
sys-apps/sandbox:          2.45::gentoo
sys-devel/binutils:        2.44::gentoo
sys-devel/binutils-config: 5.5.2::gentoo
sys-devel/gcc-config:      2.12.1::gentoo
sys-kernel/linux-headers:  6.13::gentoo (virtual/os-headers)
sys-libs/musl:             1.2.5-r3::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: git
    sync-uri: [bugzilla doesnt allow urls]
    priority: -1000
    volatile: False

local
    location: /var/db/repos/local
    masters: gentoo
    volatile: False

Binary Repositories:

gentoobinhost
    priority: 1
    sync-uri: [bugzilla doesnt allow urls]

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
ADDR2LINE="llvm-addr2line"
AR="llvm-ar"
AS="clang -c"
CBUILD="x86_64-pc-linux-musl"
CC="clang"
CFLAGS="-march=native -O3 -flto=thin -pipe -Werror=odr -Werror=strict-aliasing"
CHOST="x86_64-pc-linux-musl"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d"
CPP="clang-cpp"
CXX="clang++"
CXXFLAGS="-march=native -O3 -flto=thin -pipe -Werror=odr -Werror=strict-aliasing"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=native -O3 -flto=thin -pipe -Werror=odr -Werror=strict-aliasing"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O3 -flto=thin -pipe -Werror=odr -Werror=strict-aliasing"
GENTOO_MIRRORS="[bugzilla doesnt allow urls]"
INSTALL_MASK="charset.alias /usr/share/locale/locale.alias"
LANG="C.UTF8"
LC_ALL="en_GB.UTF-8"
LD="ld.lld"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,--as-needed"
LEX="flex"
MAKEOPTS="-j16"
NM="llvm-nm"
OBJCOPY="llvm-objcopy"
OBJDUMP="llvm-objdump"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
RANLIB="llvm-ranlib"
READELF="llvm-readelf"
RUSTFLAGS="-C target-cpu=native -C linker-plugin-lto"
SHELL="/bin/bash"
STRINGS="llvm-strings"
STRIP="llvm-strip"
USE="a52 aac acl acpi alsa amd64 bluetooth branding bzip2 cairo caps cdda cdr cet clang crypt cups dbus dist-kernel dri dts dvd dvdr encode exif flac gif gpm iconv icu ipv6 jpeg kf6compat lcms libnotify libtirpc llvm-libunwind lto mad mng mp3 mp4 mpeg ncurses nls ogg opengl openmp pam pango pcre pdf pic pipewire png policykit ppds pulseaudio qml readline sdl seccomp sound spell ssl startup-notification svg test-rust tiff truetype udev udisks unicode upower usb vaapi vorbis vulkan wayland wxwidgets x264 xattr xft xml xvid zlib zstd" ABI_X86="64" ADA_TARGET="gcc_14" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 aes avx avx2 f16c fma3 pclmul popcnt rdrand sha sse3 sse4_1 sse4_2 sse4a ssse3 vpclmulqdq" ELIBC="musl" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GUILE_SINGLE_TARGET="3-0" GUILE_TARGETS="3-0" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LLVM_SLOT="19" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres16" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_12" RUBY_TARGETS="ruby32" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ARFLAGS, ASFLAGS, CCLD, CONFIG_SHELL, CPPFLAGS, CTARGET, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, SIZE, YACC, YFLAGS
Comment 1 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2025-02-25 07:58:42 UTC
> cffi.CDefError: parse error
/var/tmp/portage/dev-python/zstandard-0.23.0-r2/temp/tmptp94lekw.h:1861:2: before: pragma

Please include that tempfile (or if you removed it already, the tempfile next failed build produced).

Also your dev-python/cffi and app-arch/zstd version and flags.
Comment 2 scv 2025-02-25 11:25:07 UTC
Created attachment 919892 [details]
problematic tmp file

Okay, here is the temp file its complaining about. (it was pretty hard to catch due to it being very short lived)

also, app-arch/zstd ver and use flags:

[ebuild   R   ~] app-arch/zstd-1.5.7:0/1::gentoo  USE="lzma zlib -lz4 -static-libs -test"
Comment 3 scv 2025-02-25 11:25:54 UTC
oh and:

[ebuild   R    ] dev-python/cffi-1.17.1:0/1.17.1::gentoo  USE="-debug -doc -test" PYTHON_TARGETS="python3_12 -python3_10 -python3_11 -python3_13"
Comment 4 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2025-02-25 11:40:07 UTC
Ah, sorry, I didn't notice you were using clang.  I can reproduce it now.
Comment 5 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2025-02-25 11:47:44 UTC
A bug known for 2.5 years...
Comment 6 Zhixu Liu 2025-03-19 10:03:57 UTC
> 1855  const ZSTD_DDict* ZSTD_initStaticDDict(
> 1856                                         void* workspace, size_t workspaceSize,
> 1857                                         const void* dict, size_t dictSize,
> 1858                                         ZSTD_dictLoadMethod_e dictLoadMethod,
> 1859                                         ZSTD_dictContentType_e dictContentType);
> 1860
> 1861
> 1862 /*! Custom memory allocation :
> 1863  *  These prototypes make it possible to pass your own allocation/free functions.
> 1864  *  ZSTD_customMem is provided at creation time, using ZSTD_create*_advanced() variants listed below.
> 1865  *  All allocation/free operations will be completed using these custom variants instead of regular <stdlib.h> ones.
> 1866  */
> 1867 typedef void* (*ZSTD_allocFunction) (void* opaque, size_t size);

I can reproduce this problem. But I didn't find out what's the error in line 1861. :(
Comment 7 Gino McCarty 2025-03-20 01:14:50 UTC
I've attempted to force gcc using package.env and haven't found a workaround for this issue.


  File "/usr/lib/python3.12/site-packages/cffi/api.py", line 112, in cdef
    self._cdef(csource, override=override, packed=packed, pack=pack)
  File "/usr/lib/python3.12/site-packages/cffi/api.py", line 126, in _cdef
    self._parser.parse(csource, override=override, **options)
  File "/usr/lib/python3.12/site-packages/cffi/cparser.py", line 390, in parse
    self._internal_parse(csource)
  File "/usr/lib/python3.12/site-packages/cffi/cparser.py", line 395, in _internal_parse
    ast, macros, csource = self._parse(csource)
                           ^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/cffi/cparser.py", line 339, in _parse
    self.convert_pycparser_error(e, csource)
  File "/usr/lib/python3.12/site-packages/cffi/cparser.py", line 368, in convert_pycparser_error
    raise CDefError(msg)
cffi.CDefError: parse error
/var/tmp/portage/dev-python/zstandard-0.23.0-r2/temp/tmpgcipnpae.h:1861:2: before: pragma
 * ERROR: dev-python/zstandard-0.23.0-r2::gentoo failed (compile phase):
 *   Wheel build failed
 *


masking for now.
Comment 8 Larry the Git Cow gentoo-dev 2025-03-21 02:14:54 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=dbafca7f6a782fce22b2ccc146dccda3d1675a4c

commit dbafca7f6a782fce22b2ccc146dccda3d1675a4c
Author:     Z. Liu <zhixu.liu@gmail.com>
AuthorDate: 2025-03-20 03:49:09 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2025-03-21 02:14:03 +0000

    app-arch/zstd: apply patch to move #pragma before static
    
    [sam: This adds a workaround for dev-python/pycparser being broken
    upstream, see https://github.com/eliben/pycparser/issues/478. The workaround
    has been approved upstream on the zstd side.]
    
    Closes: https://bugs.gentoo.org/950259
    Signed-off-by: Z. Liu <zhixu.liu@gmail.com>
    Closes: https://github.com/gentoo/gentoo/pull/41185
    Signed-off-by: Sam James <sam@gentoo.org>

 .../zstd-1.5.7-move-pragma-before-static.patch     | 45 ++++++++++++++
 app-arch/zstd/zstd-1.5.7-r1.ebuild                 | 72 ++++++++++++++++++++++
 2 files changed, 117 insertions(+)
Comment 9 Holger Hoffstätte 2025-03-23 14:57:51 UTC
*** Bug 951915 has been marked as a duplicate of this bug. ***