Whenever I do "emerge @preserved-rebuild", it wants to reemerge 1 package: games-misc/katawa-shoujo-1.1. This was not happening before, but started happening after I: 1. emerged "playonlinux" 2. unmerged "playonlinux" 3. Did emerge --depclean After emerging @preserved-rebuild it asks me to emerge @preserved-rebuild again with exactly the same packages and log. $ sudo emerge @preserved-rebuild Calculating dependencies... done! >>> Verifying ebuild manifests >>> Emerging (1 of 1) games-misc/katawa-shoujo-1.1 * katawa-shoujo-1.1.tar.bz2 SHA256 SHA512 WHIRLPOOL size ;-) ... [ ok ] * katawa-shoujo-48.png SHA256 SHA512 WHIRLPOOL size ;-) ... [ ok ] * katawa-shoujo-256.png SHA256 SHA512 WHIRLPOOL size ;-) ... [ ok ] >>> cfg-update-1.8.2-r1: Creating checksum index... >>> Unpacking source... >>> Unpacking katawa-shoujo-1.1.tar.bz2 to /var/tmp/portage/games-misc/katawa-shoujo-1.1/work >>> Unpacking katawa-shoujo-48.png to /var/tmp/portage/games-misc/katawa-shoujo-1.1/work unpack katawa-shoujo-48.png: file format not recognized. Ignoring. >>> Unpacking katawa-shoujo-256.png to /var/tmp/portage/games-misc/katawa-shoujo-1.1/work unpack katawa-shoujo-256.png: file format not recognized. Ignoring. >>> Source unpacked in /var/tmp/portage/games-misc/katawa-shoujo-1.1/work >>> Preparing source in /var/tmp/portage/games-misc/katawa-shoujo-1.1/work/Katawa Shoujo-linux-x86 ... >>> Source prepared. >>> Configuring source in /var/tmp/portage/games-misc/katawa-shoujo-1.1/work/Katawa Shoujo-linux-x86 ... >>> Source configured. >>> Compiling source in /var/tmp/portage/games-misc/katawa-shoujo-1.1/work/Katawa Shoujo-linux-x86 ... >>> Source compiled. >>> Test phase [not enabled]: games-misc/katawa-shoujo-1.1 >>> Install katawa-shoujo-1.1 into /var/tmp/portage/games-misc/katawa-shoujo-1.1/image/ category games-misc >>> Completed installing katawa-shoujo-1.1 into /var/tmp/portage/games-misc/katawa-shoujo-1.1/image/ strip: x86_64-pc-linux-gnu-strip --strip-unneeded -R .comment -R .GCC.command.line -R .note.gnu.gold-version opt/katawa-shoujo/lib/linux-x86/lib/libpng.so.3 * QA Notice: The following files contain runtime text relocations * Text relocations force the dynamic linker to perform extra * work at startup, waste system resources, and may pose a security * risk. On some architectures, the code may not even function * properly, if at all. * For more information, see http://hardened.gentoo.org/pic-fix-guide.xml * Please include the following list of files in your report: * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/libavformat.so.52 * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/libavcodec.so.52 * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/libSDL_image-1.2.so.0 * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/python2.5/bz2.so * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/python2.5/pygame/imageext.so * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/python2.5/_renpy.so * TEXTREL opt/katawa-shoujo/lib/linux-x86/lib/libavutil.so.49 >>> Installing (1 of 1) games-misc/katawa-shoujo-1.1 * Updating icons cache ... [ ok ] * Savegames from system-renpy and the bundled version are incompatible * Remember, in order to play games, you have to * be in the 'games' group. * Just run 'gpasswd -a <USER> games', then have <USER> re-login. * For more info about Gentoo gaming in general, see our website: * http://games.gentoo.org/ * Updating icons cache ... [ ok ] * Messages for package games-misc/katawa-shoujo-1.1: * Savegames from system-renpy and the bundled version are incompatible * Remember, in order to play games, you have to * be in the 'games' group. * Just run 'gpasswd -a <USER> games', then have <USER> re-login. >>> Auto-cleaning packages... >>> No outdated packages were found on your system. * GNU info directory index is up-to-date. !!! existing preserved libs: >>> package: app-emulation/emul-linux-x86-medialibs-20131008-r1 * - /usr/lib32/libfribidi.so.0 * - /usr/lib32/libfribidi.so.0.3.4 * used by /opt/katawa-shoujo/lib/linux-x86/lib/python2.5/_renpybidi.so (games-misc/katawa-shoujo-1.1) >>> package: app-emulation/emul-linux-x86-baselibs-20131008-r6 * - /lib32/libz.so.1 * - /lib32/libz.so.1.2.7 * used by /opt/katawa-shoujo/lib/linux-x86/lib/libSDL_image-1.2.so.0 (games-misc/katawa-shoujo-1.1) * used by /opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0 (games-misc/katawa-shoujo-1.1) * used by /opt/katawa-shoujo/lib/linux-x86/lib/libavformat.so.52 (games-misc/katawa-shoujo-1.1) * used by 7 other files * - /usr/lib32/libglib-2.0.so.0 * - /usr/lib32/libglib-2.0.so.0.3200.4 * used by /usr/lib32/libfribidi.so.0 (preserved) * used by /usr/lib32/libfribidi.so.0.3.4 (preserved) * - /lib32/libbz2.so.1 * - /lib32/libbz2.so.1.0.6 * used by /usr/lib32/libfreetype.so.6 (preserved) * used by /usr/lib32/libfreetype.so.6.10.0 (preserved) >>> package: app-emulation/emul-linux-x86-xlibs-20131008 * - /usr/lib32/libXau.so.6 * - /usr/lib32/libXau.so.6.0.0 * - /usr/lib32/libX11.so.6 * - /usr/lib32/libX11.so.6.3.0 * used by /opt/katawa-shoujo/lib/linux-x86/lib/python2.5/pygame/scrap.so (games-misc/katawa-shoujo-1.1) * - /usr/lib32/libxcb.so.1 * - /usr/lib32/libxcb.so.1.1.0 * - /usr/lib32/libXdmcp.so.6 * - /usr/lib32/libXdmcp.so.6.0.0 * - /usr/lib32/libfreetype.so.6 * - /usr/lib32/libfreetype.so.6.10.0 * used by /opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0 (games-misc/katawa-shoujo-1.1) * used by /opt/katawa-shoujo/lib/linux-x86/lib/python2.5/_renpy_font.so (games-misc/katawa-shoujo-1.1) Use emerge @preserved-rebuild to rebuild packages using these libraries Reproducible: Always $ emerge --info Portage 2.2.7 (default/linux/amd64/13.0/desktop/kde, gcc-4.7.3, glibc-2.17, 3.10.25-gentoo_gg16 x86_64) ================================================================= System uname: Linux-3.10.25-gentoo_gg16-x86_64-Intel-R-_Core-TM-_i7-3517U_CPU_@_1.90GHz-with-gentoo-2.2 KiB Mem: 3936664 total, 1128772 free KiB Swap: 4509692 total, 4288628 free Timestamp of tree: Wed, 12 Feb 2014 03:15:01 +0000 ld GNU ld (GNU Binutils) 2.23.2 app-shells/bash: 4.2_p45 dev-lang/python: 2.7.5-r3, 3.3.3 dev-util/cmake: 2.8.11.2 dev-util/pkgconfig: 0.28 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.12.4 sys-apps/sandbox: 2.6-r1 sys-devel/autoconf: 2.13, 2.69 sys-devel/automake: 1.10.3, 1.11.6, 1.12.6, 1.13.4 sys-devel/binutils: 2.23.2 sys-devel/gcc: 4.7.3-r1 sys-devel/gcc-config: 1.7.3 sys-devel/libtool: 2.4.2 sys-devel/make: 3.82-r4 sys-kernel/linux-headers: 3.9 (virtual/os-headers) sys-libs/glibc: 2.17 Repositories: gentoo ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe -ggdb" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=native -O2 -pipe -ggdb" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--ask-enter-invalid" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://ftp.vectranet.pl/gentoo/ http://gentoo.bloodhost.ru/ http://mirror2.corbina.ru/gentoo-distfiles/ http://mirror.yandex.ru/gentoo-distfiles/ http://tux.rainside.sk/gentoo/ http://ftp.df.lth.se/pub/gentoo/ http://gentoo.kiev.ua/ftp/" LANG="en_US.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j9" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="" SYNC="rsync://rsync.ru.gentoo.org/gentoo-portage" USE="X a52 aac acl acpi alsa amd64 berkdb bindist bluetooth branding bzip2 cairo cdda cdr cli cmake consolekit cracklib crypt cryptsetup cups cxx dbus declarative dri dts dvd dvdr emacs emboss encode exif fam firefox flac fortran gdbm gif git gpm gtk iconv ipv6 jpeg kde kipi lcms ldap libnotify mad mmx mng modules mp3 mp4 mpeg multilib ncurses networkmanager nls nptl ogg opengl openmp pam pango pcre pdf phonon plasma png policykit ppds pulseaudio qt3support qt4 readline sdl semantic-desktop session spell sse sse1 sse2 ssl startup-notification svg tcpd tiff truetype udev udisks unicode upower usb valgrind vorbis wxwidgets x264 xcb xcomposite xinerama xml xscreensaver xv xvid zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64 pc" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en ru" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" RUBY_TARGETS="ruby19 ruby18" USERLAND="GNU" VIDEO_CARDS="intel" XFCE_PLUGINS="brightness clock trash" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
big_daddy portage # e-file /usr/lib32/libfribidi.so.0 [I] app-emulation/emul-linux-x86-medialibs Available Versions: 20130224-r7 20110722 20130224-r8 20110129 20130224-r6 20100915-r1 20130224-r5 20100915 20130224-r4 20100611-r0 20130224-r2 20100220 20130224-r1 20100611 20130224 20131008 20100409 20131008-r1 20100409-r0 20121202 20130224-r13 20100220-r0 20130224-r12 20091231-r0 20121028 20120520 20130224-r11 20120127 20130224-r9 20110928 Last Installed Ver: 20130224-r2(Thu 18 Jul 2013 01:37:00 AM PDT) Matched Files: /usr/lib32/libfribidi.so.0; [I] dev-libs/fribidi Available Versions: 0.19.5-r1 0.19.5 0.19.5-r2 Last Installed Ver: 0.19.5-r2(Wed 15 Jan 2014 11:42:34 AM PST) Matched Files: /usr/lib32/libfribidi.so.0; big_daddy portage # So, there are 2 pkgs that supply that lib. It is very likely that games-misc/katawa-shoujo-1.1 directly links to the existing lib it finds in your system. Try adding --with-bdeps=y to a re-emerge of games-misc/katawa-shoujo-1.1. That should bring back in the dep supplying that lib. Alternatively you may have to delete that lib, then re-emerge the game.
hmm, looks like the ebuild doesn't list that dependency. Julian. Looks like this ame is missing a dependency, causing the pkg to not re-install the depcleaned pkg supplying the preserved lib.
(In reply to Brian Dolbec from comment #2) > hmm, looks like the ebuild doesn't list that dependency. > > Julian. Looks like this ame is missing a dependency, causing the pkg to not > re-install the depcleaned pkg supplying the preserved lib. # ls /opt/katawa-shoujo/lib/linux-x86/lib libavcodec.so.52 libfribidi.so.0 libSDL_image-1.2.so.0 python2.5 libavformat.so.52 libpng.so.3 libSDL_ttf-2.0.so.0 libavutil.so.49 libpython2.5.so.1.0 libsmpeg-0.4.so.0 libfreetype.so.6 libSDL-1.2.so.0 libXau.so.6
Looks like the game is bundling it's own copy. hmm, I wonder if it is a case of a mistaken path or it is actually linking to the preserved lib rather than the bundled lib. Can you please attach a copy of both the NEEDED and NEEDED.ELF.2 files. They should be located in /var/db/pkg/games-misc/katawa-shoujo-1.1/
Created attachment 370644 [details] NEEDED
Created attachment 370646 [details] NEEDED.ELF.2
Julian, it looks like everything is linking to system libs, not the bundled ones. I emerged it and run some tests. Also my NEEDED and NEEDED.ELF.2 seem to match, at least for a few libs I checked. big_daddy portage # ls -l /usr/lib32/libSDL-1.2.so.0 lrwxrwxrwx 1 root root 20 Jul 18 2013 /usr/lib32/libSDL-1.2.so.0 -> libSDL-1.2.so.0.11.4 big_daddy portage # ldd /opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0 ldd: warning: you do not have execution permission for `/opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0' linux-gate.so.1 (0xf779c000) libfreetype.so.6 => /usr/lib32/libfreetype.so.6 (0xf76b3000) libz.so.1 => /lib32/libz.so.1 (0xf769c000) libSDL-1.2.so.0 => /usr/lib32/libSDL-1.2.so.0 (0xf763f000) libpthread.so.0 => /lib32/libpthread.so.0 (0xf7623000) ... The matching line in NEEDED.ELF.2: 386;/opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0;libSDL_ttf-2.0.so.0;/home/tom/ab/dapper-deps/install/lib;libfreetype.so.6,libz.so.1,libSDL-1.2.so.0,libpthread.so.0,libc.so.6 I confirmed this with other libs as well. You can run ldd for all files reported in the original post to confirm. Looking through the sources, I found a file in the source that changes the LD_LIBRARY_PATH. Portage has no way of knowing this at install time. So it records the links pointing to the system libs. headcrabextra, it looks like you will have to delete the preserved libs manually. It might be safer to move them somewhere out of ldd's path, like in a home dir. Just in case you have to restore it. I don't think you will have to re-install.
(In reply to Brian Dolbec from comment #7) > Julian, it looks like everything is linking to system libs, not the bundled > ones. > > I emerged it and run some tests. Also my NEEDED and NEEDED.ELF.2 seem to > match, at least for a few libs I checked. > > big_daddy portage # ls -l /usr/lib32/libSDL-1.2.so.0 > lrwxrwxrwx 1 root root 20 Jul 18 2013 /usr/lib32/libSDL-1.2.so.0 -> > libSDL-1.2.so.0.11.4 > big_daddy portage # ldd > /opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0 > ldd: warning: you do not have execution permission for > `/opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0' > linux-gate.so.1 (0xf779c000) > libfreetype.so.6 => /usr/lib32/libfreetype.so.6 (0xf76b3000) > libz.so.1 => /lib32/libz.so.1 (0xf769c000) > libSDL-1.2.so.0 => /usr/lib32/libSDL-1.2.so.0 (0xf763f000) > libpthread.so.0 => /lib32/libpthread.so.0 (0xf7623000) > ... > > The matching line in NEEDED.ELF.2: > > 386;/opt/katawa-shoujo/lib/linux-x86/lib/libSDL_ttf-2.0.so.0;libSDL_ttf-2.0. > so.0;/home/tom/ab/dapper-deps/install/lib;libfreetype.so.6,libz.so.1,libSDL- > 1.2.so.0,libpthread.so.0,libc.so.6 > > I confirmed this with other libs as well. You can run ldd for all files > reported in the original post to confirm. > > Looking through the sources, I found a file in the source that changes the > LD_LIBRARY_PATH. Portage has no way of knowing this at install time. So it > records the links pointing to the system libs. > > headcrabextra, it looks like you will have to delete the preserved libs > manually. It might be safer to move them somewhere out of ldd's path, like > in a home dir. Just in case you have to restore it. I don't think you will > have to re-install. I don't understand how this is a bug in the ebuild. The libraries are bundled, nothing is compiled.
(In reply to Julian Ospald (hasufell) from comment #8) > I don't understand how this is a bug in the ebuild. The libraries are > bundled, nothing is compiled. It isn't directly. What seems to be happening is portage is detecting the links to the system libs, not knowing that the game sets the ldd path to point to it's bundled libs. So, @preseved-rebuild is falsely saving the system libs, reporting them as being needed for the game. I will have to check out more about @preserved-rebuild to see if there is a way to set it to not record bundled libs like these as system libs. Perhaps the ebuild may have to set a variable of the bundled libs. That way it won't record them as system libs.
Julian, apparently there is a way to fix the libs so it doesn't screw up the preserved-libs feature. The solution is in one of your ebuilds that you inherited. sci-geosciences/googleearth does this. see bug 265372 comment #17 for the solution. It is changes in the ebuild. The ebuild has to run patchelf to set the path correctly. Sorry to play ping pong with the assignment like this. But the ball is in your court again.
(In reply to Brian Dolbec from comment #10) > Julian, apparently there is a way to fix the libs so it doesn't screw up the > preserved-libs feature. The solution is in one of your ebuilds that you > inherited. sci-geosciences/googleearth does this. > > see bug 265372 comment #17210 for the solution. > > It is changes in the ebuild. The ebuild has to run patchelf to set the path > correctly. > > Sorry to play ping pong with the assignment like this. But the ball is in > your court again. That has to be done for all bundled libs that are also available as system version? That's a lot.
can we fix this on eclass or pm level somehow?
for example... QA_PREBUILT could be used to apply something automatically, no?
Sorry, I do/know little on the bash side of things. I'm a python coder. You have far more ebuild/eclass knowledge than I do.
@mgorny ...what do you think about using QA_PREBUILT for this?
(In reply to Julian Ospald (hasufell) from comment #15) > @mgorny ...what do you think about using QA_PREBUILT for this? I'm afraid I don't understand how that would help. Could you elaborate a bit on what exactly would the magic do?
(In reply to Brian Dolbec from comment #9) > Perhaps the ebuild may have to set a variable of the bundled libs. That way > it won't record them as system libs. These should be already in QA_PREBUILT.
If anyone has a patch for supporting this undocumented feature in one of my packages, open a specific bug... however, I don't intend to actively support or test it. Afais, it should be fixed for katawa-shoujo anyway.
