Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 931884 - dev-lang/php-8.3.6 cross-compilation fails configure phase with "Cannot use external libcrypt as some algo are missing"
Summary: dev-lang/php-8.3.6 cross-compilation fails configure phase with "Cannot use e...
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal
Assignee: PHP Bugs
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-05-13 18:52 UTC by raffaele
Modified: 2024-11-23 12:39 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
output og emerge -pqv dev-lang/php (emerge-qvp.txt,1.24 KB, text/plain)
2024-05-13 18:53 UTC, raffaele
Details
build log, on Host (build.log,26.24 KB, text/x-log)
2024-05-13 18:54 UTC, raffaele
Details
Build log on arm64, incomplete but shows the successful configure phase (build_arm64.log,396.14 KB, text/x-log)
2024-05-13 18:57 UTC, raffaele
Details
The Host's /usr/aarch64-unknown-linux-gnu/etc/portage/make.conf (make.conf.txt,592 bytes, text/plain)
2024-05-13 19:01 UTC, raffaele
Details
config.log (/usr/aarch64-unknown-linux-gnu/tmp/portage/dev-lang/php-8.3.6/work/sapis-build/cli/config.log) (config.log,504.11 KB, text/x-log)
2024-05-14 17:58 UTC, raffaele
Details
build log for 8.3.7-r1 (build-8.3.7-r1.log.gz,87.79 KB, application/gzip)
2024-06-08 13:01 UTC, raffaele
Details

Note You need to log in before you can comment on or make changes to this bug.
Description raffaele 2024-05-13 18:52:36 UTC
Cross-compiling php fails during the configure phase.

HOST is ~amd64, TARGET is ~arm64 (Raspberry Pi4b).
The cross-toolchain was built with:

# crossdev --target aarch64-unknown-linux-gnu

Reproducible: Always

Steps to Reproduce:
1.emerge-aarch64-unknown-linux-gnu --ask --verbose --oneshot php

Actual Results:  
Build fails during configure

Expected Results:  
Package built

emerge --info
Portage 3.0.64 (python 3.11.9-final-0, default/linux/amd64/23.0/no-multilib/hardened, gcc-13, glibc-2.39-r5, 6.8.9-gentoo x86_64)
=================================================================
System uname: Linux-6.8.9-gentoo-x86_64-AMD_Ryzen_9_5900X_12-Core_Processor-with-glibc2.39
KiB Mem:    65769176 total,  61615148 free
KiB Swap:   21504028 total,  21504028 free
Timestamp of repository gentoo: Sun, 12 May 2024 10:30:00 +0000
Head commit of repository gentoo: 22ff40e55776f99542d9ded5d866478bd44eaa82
Timestamp of repository tatsh-overlay: Sun, 12 May 2024 05:07:23 +0000
Head commit of repository tatsh-overlay: 63b17c7d4b406f67b86d67be9f55f4a197e3354a

sh bash 5.2_p26-r3
ld GNU ld (Gentoo 2.42 p3) 2.42.0
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p26-r3::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.72-r1::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.29.3::gentoo
dev-build/libtool:         2.4.7-r4::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.4.0-r1::gentoo
dev-lang/perl:             5.38.2-r5::gentoo
dev-lang/python:           3.11.9::gentoo, 3.12.3::gentoo, 3.13.0_beta1_p1::gentoo
dev-lang/rust:             1.77.1::gentoo
sys-apps/baselayout:       2.15::gentoo
sys-apps/openrc:           0.54::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-devel/binutils:        2.42-r1::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           17.0.6::gentoo, 18.1.5::gentoo
sys-devel/gcc:             13.2.1_p20240503::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/lld:             17.0.6::gentoo
sys-devel/llvm:            17.0.6::gentoo, 18.1.5::gentoo
sys-kernel/linux-headers:  6.8-r1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.39-r5::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-metamanifest: yes
    sync-rsync-extra-opts: 

local
    location: /var/db/repos/local
    masters: gentoo
    volatile: False

tatsh-overlay
    location: /var/db/repos/tatsh-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/tatsh-overlay.git
    masters: gentoo
    volatile: False

crossdev
    location: /var/db/repos/crossdev
    masters: gentoo
    priority: 10
    volatile: False

Installed sets: @x11
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=native -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d"
CXXFLAGS="-O2 -march=native -pipe"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--quiet-build --keep-going --jobs 24 --load-average 24.0"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -march=native -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userpriv usersandbox usersync xattr"
FFLAGS="-O2 -march=native -pipe"
GENTOO_MIRRORS="https://gentoo.mirrors.ovh.net/gentoo-distfiles/     rsync://mirror.leaseweb.com/gentoo/     https://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/     http://mirrors.ircam.fr/pub/gentoo-distfiles/     http://ftp.free.fr/mirrors/ftp.gentoo.org/"
LANG="C.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
LINGUAS="en it"
MAKEOPTS="-j24 -l24.0"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="X a52 aac acl acpi alsa amd64 audit bluetooth branding bzip2 cairo cdda cdr cet crypt cups dbus dri dts dvd dvdr elogind encode exif flac gdbm gif gpm gtk gui hardened hpcups iconv icu jpeg lcms libnotify libtirpc logrotate mad mng mp3 mp4 mpeg mtp ncurses nls nsplugin ogg opengl openmp pam pango pcre pcsc-lite pdf pic pie png policykit ppds pulseaudio qt5 readline sdl seccomp sound spell ssl ssp startup-notification svg test-rust tiff tpm truetype udev udisks unicode upower usb vorbis wxwidgets x264 x265 xattr xcb xfce xft xml xtpax xv xvid zlib" ABI_X86="64" ADA_TARGET="gcc_12" ALSA_CARDS="hda-intel" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="canon" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 vpclmulqdq" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" INPUT_DEVICES="evdev" KERNEL="linux" L10N="en it" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" SANE_BACKENDS="niash" VIDEO_CARDS="nouveau" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
Comment 1 raffaele 2024-05-13 18:53:37 UTC
Created attachment 892883 [details]
output og emerge -pqv dev-lang/php
Comment 2 raffaele 2024-05-13 18:54:37 UTC
Created attachment 892884 [details]
build log, on Host
Comment 3 raffaele 2024-05-13 18:57:38 UTC
Created attachment 892885 [details]
Build log on arm64, incomplete but shows the successful configure phase
Comment 4 raffaele 2024-05-13 19:01:32 UTC
Created attachment 892886 [details]
The Host's /usr/aarch64-unknown-linux-gnu/etc/portage/make.conf
Comment 5 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2024-05-13 19:36:29 UTC
Could we have config.log too please?
Comment 6 raffaele 2024-05-14 17:58:21 UTC
Created attachment 892925 [details]
config.log (/usr/aarch64-unknown-linux-gnu/tmp/portage/dev-lang/php-8.3.6/work/sapis-build/cli/config.log)
Comment 7 Michael Orlitzky gentoo-dev 2024-05-15 13:12:53 UTC
These tests are doing e.g.,

  AC_CACHE_CHECK(for extended DES crypt, ac_cv_crypt_ext_des,[
    AC_RUN_IFELSE([AC_LANG_SOURCE([[
      ...                                                                          
    ]])
    ],[
      ac_cv_crypt_ext_des=yes
    ],[
      ac_cv_crypt_ext_des=no
    ],[
      ac_cv_crypt_ext_des=no
    ])
  ])

where the last case is saying "no support" while cross-compiling. This leads to an error when --with-external-libcrypt is passed to ./configure. I'm not sure how many people are doing that, so we may simply be the first to hit the issue.

What does cross@ think is the best solution?

0. Is there a better way to detect crypt() methods without running programs?
1. Report upstream, and ask for the default to be "yes" when cross-compiling.
2. In Gentoo, set those cache vars to "yes" in the ebuild when cross-compiling.
3. In Gentoo, fall back to the bundled libcrypt when cross-compiling.

Or are there other options I've overlooked?
Comment 8 raffaele 2024-05-17 17:23:58 UTC
(In reply to Michael Orlitzky from comment #7)
> 
> What does cross@ think is the best solution?
> 
> 0. Is there a better way to detect crypt() methods without running programs?
> 1. Report upstream, and ask for the default to be "yes" when cross-compiling.
> 2. In Gentoo, set those cache vars to "yes" in the ebuild when
> cross-compiling.
> 3. In Gentoo, fall back to the bundled libcrypt when cross-compiling.
> 

Just to let me proceed with my project I tried option 3. and commented out --with-external-libcrypt from the ebuild and the build succeeds.
Comment 9 Mike Gilbert gentoo-dev 2024-05-17 19:16:54 UTC
(In reply to Michael Orlitzky from comment #7)

config.site is also an option. A couple ways to utilize that:

5. Add entries to /usr/share/crossdev/include/site via sys-devel/crossdev.

6. Install a new drop-in in /usr/share/config.site.d via the packages that provide libcrypt (sys-libs/libxcrypt, sys-libs/glibc, sys-libs/musl).
Comment 10 Mike Gilbert gentoo-dev 2024-05-17 19:20:59 UTC
Actually, option 6 is tricky because configure doesn't look for config.site in SYSROOT, and Gentoo's sys-apps/config-site isn't SYSROOT-aware either. If we fix the latter issue, it could be a slick solution though.
Comment 11 raffaele 2024-06-08 12:59:16 UTC
The situation worsens with 8.3.7-r1, removing --with-external-libcrypt build succeeds but install phase fails:

 * Installing php.ini for cli into /etc/php/cli-php8.3
 * 
 * Adding opcache to /etc/php/cli-php8.3/ext
 * Installing SAPI: fpm
 * Installing php.ini for fpm into /etc/php/fpm-php8.3
 * 
 * Adding opcache to /etc/php/fpm-php8.3/ext
 * Installing FPM config files php-fpm.conf and www.conf
 * Installing SAPI: apache2
 * Installing php.ini for apache2 into /etc/php/apache2-php8.3
 * 
 * Adding opcache to /etc/php/apache2-php8.3/ext
sed: can't read /usr/aarch64-unknown-linux-gnu/tmp/portage/dev-lang/php-8.3.7-r1/image/usr/lib64/php8.3/bin/php-config: No such file or directory

Build log attached
Comment 12 raffaele 2024-06-08 13:01:14 UTC
Created attachment 895382 [details]
build log for 8.3.7-r1

Removing --with-external-crypt the build completes but fails during the install phase
Comment 13 Michael Orlitzky gentoo-dev 2024-06-08 15:22:33 UTC
This is the line that's failing now:

    # set php-config variable correctly (bug #278439)                           
    sed -e "s:^\(php_sapis=\)\".*\"$:\1\"${sapi_list}\":" -i \
	"${ED}/usr/$(get_libdir)/php${SLOT}/bin/php-config" || die

It fails with,

  sed: can't read /usr/aarch64-unknown-linux-gnu/tmp/portage/dev-lang/php-8.3.7-
  r1/image/usr/lib64/php8.3/bin/php-config: No such file or directory

This likely has to do with the removal of eautoconf (from autotools.eclass) in 8.3.7-r1. But I'm not sure if it's hopelessly broken without the eautoreconf, or if the path just needs to be tweaked, or if we should be sed'ing this file BEFORE installing it, or something else.

(As for the original issue: upstream is working on adding cache variables for any checks that might need to be overridden during a cross-compile. When they show up in a released version, I'll be able to add them all to the ebuild, hopefully fixing this and any other ./configure issues.)
Comment 14 Larry the Git Cow gentoo-dev 2024-07-10 14:50:06 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=0771e0a34345350b76153a1d4826dbec82e0dbea

commit 0771e0a34345350b76153a1d4826dbec82e0dbea
Author:     Michael Orlitzky <mjo@gentoo.org>
AuthorDate: 2024-07-09 19:16:23 +0000
Commit:     Michael Orlitzky <mjo@gentoo.org>
CommitDate: 2024-07-10 14:07:08 +0000

    dev-lang/php: add 8.3.9, drop 8.3.8
    
    Various improvements on top of the version bump:
    
      * The system copy of media-libs/gd is now used.
      * Autoconf cache variables are overridden to allow
        cross-compiles with external libraries.
      * New USE=opcache-jit flag to control the use of a
        JIT within the opcache extension.
    
    Closes: https://bugs.gentoo.org/857597
    Closes: https://bugs.gentoo.org/906585
    Bug: https://bugs.gentoo.org/931884
    Signed-off-by: Michael Orlitzky <mjo@gentoo.org>

 dev-lang/php/Manifest                              |    2 +-
 dev-lang/php/files/php-8.3.9-gd-cachevars.patch    |   68 ++
 .../files/php-8.3.9-optional-png-testfixen.patch   | 1277 ++++++++++++++++++++
 dev-lang/php/metadata.xml                          |    3 +
 .../php/{php-8.3.8.ebuild => php-8.3.9.ebuild}     |   89 +-
 5 files changed, 1406 insertions(+), 33 deletions(-)
Comment 15 Michael Orlitzky gentoo-dev 2024-07-10 14:53:48 UTC
I think this should be working in 8.3.9, because I had to bring back the eautoreconf whose removal broke something else in Comment 11.

Both libcrypt and libgd are using external libraries now, but both should have the autoconf cache variables overridden to allow cross-compilation.

In the next version 8.3.10, the eautoreconf will probably be removed again and whatever happened in Comment 11 will come back, but one problem at a time...
Comment 16 Michael Orlitzky gentoo-dev 2024-07-11 20:31:49 UTC
I'm closing this because I'm confident that cross-compiles, if they still fail, will fail for some other reason.
Comment 17 dE 2024-11-23 07:06:59 UTC
Confirmed with dev-lang/php-8.2.24::gentoo
Comment 18 Michael Orlitzky gentoo-dev 2024-11-23 12:39:00 UTC
(In reply to dE from comment #17)
> Confirmed with dev-lang/php-8.2.24::gentoo

It's only fixed in 8.3.x. Upstream is not so great about applying build system fixes to older branches, especially if they don't apply cleanly.