Bug 925192 – emerge uUD --autounmask --autounmask-write sometimes fails to edit /etc/portage/package.unmask when there is an update of other libraries that are needed by applications

• Status: UNCONFIRMED
• Product: Portage Development

[Description Benjamin Schulz 2024-02-21 17:06:23 UTC]

Hi i noticed the following behavior of portage:
yesterday, parts of kde were was updated, from 5.113 to 5.115, e.g.
kde-frameworks/ktexteditor-5.113

In my case, this required to set a useflag for this package

# required by media-libs/libheif-1.15.2::gentoo
# required by media-libs/gd-2.3.3-r4::gentoo[heif]
# required by net-analyzer/vnstat-2.11::gentoo[gd]
# required by @selected
# required by @world (argument)
>=media-libs/libde265-1.0.11 abi_x86_32
# required by app-arch/libarchive-3.7.2::gentoo[blake2]
# required by sys-apps/fwupd-1.9.6::gentoo[archive]
# required by kde-plasma/discover-5.27.10::gentoo[firmware]
# required by kde-plasma/plasma-welcome-5.27.10::gentoo[discover]
# required by kde-plasma/plasma-meta-5.27.10::gentoo
# required by @selected
# required by @world (argument)
>=app-crypt/libb2-0.98.1-r3 abi_x86_32
# required by app-arch/libarchive-3.7.2::gentoo[lz4]
# required by sys-apps/fwupd-1.9.6::gentoo[archive]
# required by kde-plasma/discover-5.27.10::gentoo[firmware]
# required by kde-plasma/plasma-welcome-5.27.10::gentoo[discover]
# required by kde-plasma/plasma-meta-5.27.10::gentoo
# required by @selected
# required by @world (argument)
>=app-arch/lz4-1.9.4 abi_x86_32

unfortunately, --autounmask --autounmask-write did not do this.

Instead, emerge printed a huge list of blockers that made no sense.
It claimed that the update of many of the kde libraries would have a block because these libraries would be used by older applications, e.g that ktexteditor-5.113 would need the old libraries and thus it could not upgrade.

And as a result, --autounmask --autounmask-write also did not update the package.use file.

But now, after i wrote the lines quited above into package.use/zz-autounmask, the nonsensical blocks of old kde applications blocking the new kde libraries were gone and the new version of kde's libraries were installed together with the applications...

By now this happened to me sometimes, that i had to put in things into package.use or package.keywords manually. But these were then just lines that the emerge command suggested, behind a large series of blocks that seemed to make no sense.

In such a case, --autounmask --autounmask-write should just modify the package.keywords, package.mask, or package.use file and proceed...


Reproducible: Always

Actual Results:  
emerge --autounmask --autounmask-write does not modify  the package.keywords, package.mask, or package.use files if there are percieved blocks that happen during an update when the update three is not fully computed.

Expected Results:  
In such a case, --autounmask --autounmask-write should just modify the package.keywords, package.mask, or package.use file and proceed...

It is a little anoying if one has to put in lines into config files that emerge actually suggests when one is using the argument --autounmask-write.


merge --info
Portage 3.0.61 (python 3.11.7-final-0, default/linux/amd64/17.1/desktop, gcc-13, glibc-2.38-r10, 6.6.13-gentoo-x86_64 x86_64)
=================================================================
System uname: Linux-6.6.13-gentoo-x86_64-x86_64-AMD_Ryzen_9_3900X_12-Core_Processor-with-glibc2.38
KiB Mem:    32791324 total,  18005776 free
KiB Swap:   31249404 total,  29393404 free
Timestamp of repository gentoo: Wed, 21 Feb 2024 12:00:00 +0000
Head commit of repository gentoo: c05b1cf909d724d72c0ce14fd7c870ab3749677f
Timestamp of repository escpr2: Fri, 08 Dec 2023 17:18:01 +0000
Head commit of repository escpr2: 8d84a976f5df90476c9fa42f9497ad0000a0d82f

Timestamp of repository guru: Wed, 21 Feb 2024 12:03:21 +0000
Head commit of repository guru: c56661bf837b40960b6653cc89e3734f974b6ba9

Timestamp of repository pixlra: Mon, 12 Feb 2024 16:35:52 +0000
Head commit of repository pixlra: 9e1d3c5bf18c4bb087edf2dc6a2de4cea436d6ab

Timestamp of repository sage-on-gentoo: Wed, 14 Feb 2024 02:33:27 +0000
Head commit of repository sage-on-gentoo: 794d28851e0e98ddff16c65de09e714bfb775271

Timestamp of repository science: Wed, 21 Feb 2024 01:33:28 +0000
Head commit of repository science: 399c3d69e9b126d9165a68b28642f63abe8b2eba

Timestamp of repository ssnb: Mon, 12 Feb 2024 16:35:48 +0000
Head commit of repository ssnb: 5eb8878de019fa9e5ca6c20eb220f9fb7231f749

Timestamp of repository steam-overlay: Fri, 16 Feb 2024 23:18:24 +0000
Head commit of repository steam-overlay: 214f4d5b11850f9751ee0939df3dd2aaaaef6d26

sh bash 5.1_p16-r6
ld GNU ld (Gentoo 2.41 p5) 2.41.0
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.1_p16-r6::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.71-r6::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.27.9::gentoo
dev-build/libtool:         2.4.7-r2::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.3.1-r1::gentoo
dev-java/java-config:      2.3.3-r1::gentoo
dev-lang/perl:             5.38.2-r1::gentoo
dev-lang/python:           3.11.7::gentoo, 3.12.1_p1::gentoo
dev-lang/rust:             1.74.1::gentoo
dev-lang/rust-bin:         1.74.1::gentoo
sys-apps/baselayout:       2.14-r2::gentoo
sys-apps/openrc:           0.53::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-devel/binutils:        2.41-r5::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           15.0.7-r3::gentoo, 16.0.6::gentoo, 17.0.6::gentoo
sys-devel/gcc:             12.3.1_p20240112::gentoo, 13.2.1_p20240113-r1::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/lld:             17.0.6::gentoo
sys-devel/llvm:            15.0.7-r3::gentoo, 16.0.6::gentoo, 17.0.6::gentoo
sys-kernel/linux-headers:  6.6::gentoo (virtual/os-headers)
sys-libs/glibc:            2.38-r10::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    volatile: False
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-max-age: 3
    sync-rsync-extra-opts: 
    sync-rsync-verify-jobs: 1

escpr2
    location: /var/db/repos/escpr2
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/escpr2.git
    masters: gentoo
    volatile: False

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    volatile: False

pixlra
    location: /var/db/repos/pixlra
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/pixlra.git
    masters: gentoo
    volatile: False

sage-on-gentoo
    location: /var/db/repos/sage-on-gentoo
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/sage-on-gentoo.git
    masters: gentoo
    volatile: False

science
    location: /var/db/repos/science
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/science.git
    masters: gentoo
    volatile: False

ssnb
    location: /var/db/repos/ssnb
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/ssnb.git
    masters: gentoo
    volatile: False

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo
    volatile: False

Binary Repositories:

gentoobinhost
    priority: 1
    sync-uri: https://gentoo.osuosl.org/releases/amd64/binpackages/17.1/x86-64

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O3 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=native -O3 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-march=native -O3 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O3 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="de_DE.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LEX="flex"
LINGUAS="de en"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="7zip R X a52 aac acl acpi activities addc addressbook admin ads alembic alsa amd64 amr amrenc appstream aprs aptx archive asm aspell assistant avif base bittorrent blake2 bluetooth bluray boost branding broadway brotli bs2b bzip2 cairo calendar capi caps cdda cddb cdio cdr cdrom chromium cinnamon clamav cli clippy codec2 collada color-management colord context contrib contribcvv contribdnn contribfreetype contribhdf contribxfeatures2d cpudetection crypt cryptsetup cuda cue cups curl cvs dbus deep-sky designer dhcp-tools dhcpcd dia dicom discover distancefieldgenerator distributed djvu dos download dri drm dropbox dts dv dvb dvd dvdr dvi eds education efiemu eglfs eigen elogind encode eps epub equalizer escprlib evdev examples excel exif expat extra extraengine faad fbgemm fdk ffmpeg fftw fits flac flite fltk font-styles fontconfig fortran fpx frei0r fribidi ftp fuse gd gdal gdbm gdbui geckodriver geolocation geos gflags gif gimp git gloo gme gml gmp gnome gnome-keyring gnome-shell gnumeric gnuplot gnutls go goffice googledrive gpg gpgme gphoto2 gps grammar graphics graphite grub gsf gsl gsm gssapi gstreamer gtk gtk3 gtk4 gts gui guile handbook hardcoded-tables hdf5 heif hex highlight html htmlreport http humanities hunspell ibus iconv icu iec61883 ieee1394 image image-backend imagemagick imagequant innodb-lz4 innodb-lzo introspection iprint ipv6 jack java javascript jdbc jit jpeg jpeg2k jpegxl json julia junction jupyter kaccounts kafka kate kbd kbindicator kcm kde kdesu kerberos keyring kpathsea kvazaar kwallet ladspa lapack latency-timing latex latin layers lcms ldac ldap lensfun libaom libaribb24 libcaca libdrm libilbc libnotify libproxy librtmp libsoxr libtesseract libtirpc libuv libv4l libxml2 linguist llvm lm-sensors logrotate lrz lspclient lto lv2 lz4 lzma lzo mad map marble mariadb markdown mate math mathml matio media mediaplayer mercurial metapost mng mobi modplug modula2 mongodb mount mp3 mp4 mpd mpeg multilib multimedia multitarget mysql nautilus nbconvert ncurses netapi netcdf netlink network networkmanager nfc nftables nls nnpack notebook nsight ntfs numpy nvcontrol nvdec nvenc nvidia objc objc++ objc-gc oci8 odbc offlinehelp ogg okular opds openal opencl opencv opencvapps openexr opengl openh264 openmp openssl openvdb opus oqgraph oracle origin osg osl osmesa oss oxygen pam pango panorama pcap pcre pdf pdfimport pdfium perl pgplot phonon pim pipewire pixeltool plasma png policykit positioning postgres postscript ppds ppp printsupport pstricks publishers pulseaudio pyqt6 python qalculate qdbus qml qmldesigner qnnpack qt5 qt6 qtattributionsscanner qtaudio qtcamera qtdiag qtegrity qthelp qtmedia qtmultimedia qtplugininfo quick quick3d racket rar rav1e raw readline redland remote-fs reviewboard rss rtf rtmp rubberband ruby rust rust-analyzer rust-src rustfmt rustls samba sanitizer sasl scanner science scope scripts scripttools sdk sdl sdl-image sdl2 search seccomp semantic-desktop sensord sensors serial serialport serialterminal server session sha2 shaderc shaders shapefile share sieve sift sim skins smartcard smp snapper snappy sndfile sndio sodium sound source-highlight spacenav spam-report spamassassin spatialaudio speech speex spell sphinx split-usr spotlight sql sqlite srt ssh ssl sst-rsync stars startup-notification subversion svg svg2 svt-av1 systemtap szip t1lib tcl telephony telescope tensorpipe terminal tesseract test-rust tex4ht texi2html theora thesaurus threads tiff tk tools tor-hardening tpm truetype twolame udev udisks uefi ufw unicode unrar upower usb utils v4l v4lutils vaapi vala vcd vdpau verify-file verify-sig video vidstab vis-profiler vlc vnc vorbis vpx vtv vulkan wav wavpack webchannel webdav webengine webkit webp websockets widgets wifi winbind wineappdb wireless wma wmf wordperfect wxwidgets x11extras x264 x265 xattr xcb xft xine xinerama xkb xla xls xml xmlpatterns xmlwriter xmp xmss xorg xpm xps xrandr xray xrender xs xscreensaver xv xvid xxhash yassl zeromq zimg zlib zstd zvbi" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 aes avx avx2 f16c fma3 pclmul popcnt rdrand sha sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" L10N="de en en-GB" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LIBREOFFICE_EXTENSIONS="nlpsolver scripting-beanshell scripting-javascript wiki-publisher" LUA_SINGLE_TARGET="lua5-4" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" VIDEO_CARDS="nvidia d3d12" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, MAKEOPTS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS

[Comment 1 Benjamin Schulz 2024-02-24 02:09:07 UTC]

Here is a

[Comment 2 Benjamin Schulz 2024-02-24 02:16:01 UTC]

Here is an example where you can verify this bug easily.

Currently, there is a bug in opencolorio. It needs 

 dev-cpp/yaml-cpp-0.8.0:0

But yaml-cpp is now at version 0.8.

This is a bug which was acknowledged here. yaml-cpp has to update its ebuild
https://bugs.gentoo.org/925174

Now at the moment, i would have to unmask the  license linux-fw-redistributable   for  sys-kernel/linux-firmware-20240220-r1::gentoo because of an update.

And this is what portage then does when I use it with --autounmask --autounmask-write: It just does nothing.

Instead, it should have updated the license masking...
The same happens with useflags and masked packages. 
Annoying is especially that this happens also when there are just percieved blocks, i.e. that --autounmask write does not do anything for some package just because in some other package there appears to be a block when the package tree has not entirely be computed, i.e when it claims a kdelib cant be installed because it would depend on old kde-apps, which are, however, also updated when the entire tree is taken into account.


/home/Benni # emerge -uUD --autounmask --autounmask-write world
Calculating dependencies... done!
Dependency resolution took 49.91 s (backtrack: 0/20).


WARNING: One or more updates/rebuilds have been skipped due to a dependency conflict:

dev-cpp/yaml-cpp:0

  (dev-cpp/yaml-cpp-0.8.0:0/0.8::gentoo, ebuild scheduled for merge) USE="-test" ABI_X86="(64) -32 (-x32)" conflicts with
    <dev-cpp/yaml-cpp-0.8.0:= required by (media-libs/opencolorio-2.1.3:0/2.1.1::gentoo, installed) USE="python (-doc) -opengl -test" ABI_X86="(64)" CPU_FLAGS_X86="sse2" PYTHON_SINGLE_TARGET="python3_11 -python3_10"
    ^                 ^^^^^  
    dev-cpp/yaml-cpp:0/0.7= required by (dev-qt/qt-creator-12.0.1:0/0::gentoo, installed) USE="clang designer help qmldesigner serialterminal svg tracing webengine -doc -test" ABI_X86="(64)"
                    ^^^^^^^
    <dev-cpp/yaml-cpp-0.8.0:0/0.7= required by (media-libs/opencolorio-2.1.3:0/2.1.1::gentoo, installed) USE="python (-doc) -opengl -test" ABI_X86="(64)" CPU_FLAGS_X86="sse2" PYTHON_SINGLE_TARGET="python3_11 -python3_10"
    ^                 ^^^^^^^^^^^^


!!! The following updates are masked by LICENSE changes:
- sys-kernel/linux-firmware-20240220-r1::gentoo (masked by: || ( ) linux-fw-redistributable license(s))
A copy of the 'linux-fw-redistributable' license is located at '/var/db/repos/gentoo/licenses/linux-fw-redistributable'.

For more information, see the MASKED PACKAGES section in the emerge
man page or refer to the Gentoo Handbook.

[Comment 3 Greg Kubaryk 2024-02-24 03:27:21 UTC]

(Hopefully you mean package.accept_keywords; package.keywords was deprecated for years and should warn on use.)

[Comment 4 Benjamin Schulz 2024-02-24 15:01:00 UTC]

Hi Greg, 

Yes I meant package.accept_keywords.

I use gentoo a bit longer, but of course my system is up to date.


but it is still strange that --autounmask --autounmask-write does not do its job at all, when there is a totally unrelated conflict somewhere else or when there would be a conflict only if the package update tree is not entirely computed.

When you are new to portage, i guess this bug can be confusing, since, during my last update of kde, portage just printed out a very very large list of nonsensical blocks that really were not relly there. 

For a beginner, it could be difficult to imagine that this is a portage bug in 
--autounmask-write and that he simply has to set some useflags, licenses or maskings manually totally in unrelated packages in order to continue the upgrade of kde...

Also confusing is that portage manages to print out the settings that need to be changed, but does not write it despite being told to do so...