Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 598080 - sys-apps/portage - libncurses.so.5 was not preserved
Summary: sys-apps/portage - libncurses.so.5 was not preserved
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Unclassified (show other bugs)
Hardware: All Linux
: Normal major
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS
: 602672 (view as bug list)
Depends on:
Blocks: preserve-libs 611328
  Show dependency tree
 
Reported: 2016-10-25 15:36 UTC by stanton_arch
Modified: 2017-05-20 18:07 UTC (History)
11 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
ncurses install log with postinst failure (compressed) (sys-libs:ncurses-6.0-r1:20161213-204334.log.gz,74.45 KB, application/gzip)
2016-12-13 22:26 UTC, Nick Bowler
Details

Note You need to log in before you can comment on or make changes to this bug.
Description stanton_arch 2016-10-25 15:36:44 UTC
I recently did an "emerge --sync"  and "emerge --update @world" with the
defaults on an hppa machine that failed.

Sorry I don't have a log, but it seems that the update failed in
ncurses, because ncurses-5 was removed before ncurses-6 got installed,
breaking everything that previously depended on ncurses, including bash.

I had to manually add sym links from libncurses*5* to libncurses*6* to
get the system usable.  I re-did the emerge --update which I think
finished installing ncurses6, but there are still packages depending on
ncurses5.

It kind of looks related to these
https://bugs.gentoo.org/show_bug.cgi?id=573504
https://bugs.gentoo.org/show_bug.cgi?id=594338

> equery check ncurses
* Checking sys-libs/ncurses-5.9-r99 ...
   0 out of 0 files passed

* Checking sys-libs/ncurses-6.0-r1 ...
   3749 out of 3749 files passed

>equery d ncurses
 * These packages depend on ncurses:
app-admin/eselect-1.4.5 (sys-libs/ncurses)
app-editors/nvi-1.81.6-r4 (>=sys-libs/ncurses-5.6-r2)
app-shells/bash-4.3_p48 (>=sys-libs/ncurses-5.2-r2:0)
app-shells/tcsh-6.18.01-r2 (>=sys-libs/ncurses-5.1)
dev-lang/python-2.7.10-r1 (ncurses ? >=sys-libs/ncurses-5.2:0)
dev-lang/python-3.4.3-r1 (ncurses ? >=sys-libs/ncurses-5.2:0)
sys-apps/less-481 (>=sys-libs/ncurses-5.2:0)
sys-apps/openrc-0.21.7 (ncurses ? sys-libs/ncurses:0)
sys-apps/texinfo-6.1 (>=sys-libs/ncurses-5.2-r2:0)
sys-apps/util-linux-2.26.2 (ncurses ? >=sys-libs/ncurses-5.2-r2:0[unicode?])
sys-devel/bc-1.06.95-r1 (readline ? >=sys-libs/ncurses-5.2)
sys-devel/gettext-0.19.7 (ncurses ? sys-libs/ncurses:0)
sys-kernel/gentoo-sources-3.14.58-r1 (!build ? >=sys-libs/ncurses-5.2)
sys-libs/gpm-1.20.7-r2 (>=sys-libs/ncurses-5.9-r3:0[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?])
sys-libs/ncurses-5.9-r99 (sys-libs/ncurses:0/5[ada?,cxx?,gpm?,static-libs?,tinfo?,unicode?,abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?])
sys-libs/readline-6.3_p8-r2 (>=sys-libs/ncurses-5.9-r3[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_ppc_32(-)?,abi_ppc_64(-)?,abi_s390_32(-)?,abi_s390_64(-)?])
sys-process/procps-3.3.12 (ncurses ? >=sys-libs/ncurses-5.7-r7[unicode?])
sys-process/psmisc-22.21-r2 (>=sys-libs/ncurses-5.7-r7)


 >emerge --depclean
 [sniped...]

Calculating dependencies... done!
 * Dependencies could not be completely resolved due to
 * the following required packages not being installed:
 * 
 *   >=sys-libs/ncurses-5.2-r2:0/5= pulled in by:
 *     app-shells/bash-4.3_p48
 * 
 *   sys-libs/ncurses:0/5= pulled in by:
 *     sys-apps/openrc-0.21.7
 * 
 *   sys-libs/ncurses:0/5= pulled in by:
 *     sys-devel/gettext-0.19.7
 * 
 *   >=sys-libs/ncurses-5.2-r2:0/5= pulled in by:
 *     sys-apps/texinfo-6.1
 * 
 *   >=sys-libs/ncurses-5.2:0/5= pulled in by:
 *     sys-apps/less-481
 * 
 *   >=sys-libs/ncurses-5.2-r2:0/5=[unicode] pulled in by:
 *     sys-apps/util-linux-2.26.2


 >emerge --info
Portage 2.2.28 (python 3.4.3-final-0, default/linux/hppa/13.0, gcc-4.9.4, glibc-2.22-r4, 3.14.58-gentoo-r1 parisc64)
=================================================================
System uname: Linux-3.14.58-gentoo-r1-parisc64-PA8800_-Mako-with-gentoo-2.3
KiB Mem:     4106480 total,   3555568 free
KiB Swap:    1048572 total,   1048572 free
Timestamp of repository gentoo: Tue, 25 Oct 2016 15:00:01 +0000
sh bash 4.3_p48
ld GNU ld (Gentoo 2.25.1 p1.1) 2.25.1
app-shells/bash:          4.3_p48::gentoo
dev-lang/perl:            5.20.2::gentoo
dev-lang/python:          2.7.10-r1::gentoo, 3.4.3-r1::gentoo
dev-util/pkgconfig:       0.28-r2::gentoo
sys-apps/baselayout:      2.3::gentoo
sys-apps/openrc:          0.21.7::gentoo
sys-apps/sandbox:         2.10-r1::gentoo
sys-devel/autoconf:       2.69::gentoo
sys-devel/automake:       1.14.1::gentoo, 1.15::gentoo
sys-devel/binutils:       2.25.1-r1::gentoo
sys-devel/gcc:            4.9.3::gentoo, 4.9.4::gentoo
sys-devel/gcc-config:     1.7.3::gentoo
sys-devel/libtool:        2.4.6::gentoo
sys-devel/make:           4.1-r1::gentoo
sys-kernel/linux-headers: 4.3::gentoo (virtual/os-headers)
sys-libs/glibc:           2.22-r4::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000

ACCEPT_KEYWORDS="hppa"
ACCEPT_LICENSE="* -@EULA"
CBUILD="hppa2.0-unknown-linux-gnu"
CFLAGS="-O2 -pipe -march=2.0"
CHOST="hppa2.0-unknown-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FCFLAGS=""
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS=""
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="C"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j4"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="acl berkdb bindist bzip2 cli cracklib crypt cups cxx firefox foomaticdb fortran gdbm gpm hppa iconv imlib ipv6 libwww modules ncurses nls nptl openmp pam pcre readline session spell ssl tcpd unicode xattr xml2 zlib" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4" RUBY_TARGETS="ruby20 ruby21" USERLAND="GNU" VIDEO_CARDS="fbdev dummy" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Comment 1 Mike Gilbert gentoo-dev 2016-10-25 15:53:42 UTC
The portage feature "preserve-libs" should have prevented libncurses.so.5 from being removed before all reverse dependencies were rebuilt. I am therefore calling this a portage bug until proven otherwise. ;)
Comment 2 Zac Medico gentoo-dev 2016-10-25 16:09:06 UTC
Somebody should unpack an hppa stage3, chroot in there, and see if the ncurses libraries are properly preserved when ncurses is unmerged:

    emerge --unmerge ncurses
Comment 3 Jeroen Roovers (RETIRED) gentoo-dev 2016-10-27 17:17:26 UTC
There is nothing HPPA specific about that. I've seen it on other architectures as well.
Comment 4 Nick Bowler 2016-12-13 22:26:23 UTC
Created attachment 456112 [details]
ncurses install log with postinst failure (compressed)

Just hit this on x32.  The ncurses upgrade explodes in postinst because
bash is hosed at this point (libs were not preserved).  Then all subsequent
package installations fail immediately.

(In reply to Zac Medico from comment #2)
> Somebody should unpack an hppa stage3, chroot in there, and see if the
> ncurses libraries are properly preserved when ncurses is unmerged:
> 
>     emerge --unmerge ncurses

With current stage3-x32-20161208.tar.bz2 the libs are preserved with
this command.  However, they do not seem to be properly preserved if
you attempt to downgrade to ncurses-5 (unfortunately, stages with
ncurses-5 seem to be no longer available to test the upgrade path):

  % emerge --unmerge sys-libs/ncurses
  (libs are preserved, cool!)

  % emerge -1 '=sys-libs/ncurses-5.9-r5'
  (for some reason, most of the preserved ncurses-6 libs disappear after
  this, breaking many packages, but bash and portage are still working...)

  % emerge -1 sys-libs/readline
  (attempt to rebuild ncurses reverse dependency.  When this package is
  reinstalled, all remaining preserved libs disappear and the installation
  fails in postinst.  All subsequent emerge attempts fail.)

Portage 2.3.0 (python 3.4.3-final-0, default/linux/amd64/13.0/x32, gcc-4.9.3, glibc-2.22-r4, 4.5.4 x86_64)
=================================================================
System uname: Linux-4.5.4-x86_64-Intel-R-_Core-TM-_i7-5600U_CPU_@_2.60GHz-with-gentoo-2.2
KiB Mem:     4048828 total,    242884 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Tue, 13 Dec 2016 00:45:01 +0000
sh dash 0.5.8.2
ld GNU ld (Gentoo 2.25.1 p1.1) 2.25.1
app-shells/bash:          4.3_p46-r1::gentoo
dev-lang/perl:            5.22.2::gentoo
dev-lang/python:          2.7.10-r1::gentoo, 3.4.3-r1::gentoo
dev-util/cmake:           3.5.2-r1::gentoo
dev-util/pkgconfig:       0.28-r2::gentoo
sys-apps/baselayout:      2.2::gentoo
sys-apps/openrc:          0.21.7::gentoo
sys-apps/sandbox:         2.10-r1::gentoo
sys-devel/autoconf:       2.13::gentoo, 2.69::gentoo
sys-devel/automake:       1.14.1::gentoo, 1.15::gentoo
sys-devel/binutils:       2.25.1-r1::gentoo
sys-devel/gcc:            4.9.3::gentoo
sys-devel/gcc-config:     1.7.3::gentoo
sys-devel/libtool:        2.4.6::gentoo
sys-devel/make:           4.1-r1::gentoo
sys-kernel/linux-headers: 4.3::gentoo (virtual/os-headers)
sys-libs/glibc:           2.22-r4::gentoo
Repositories:

gentoo
    location: /srv/repos/gentoo
    sync-type: webrsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    sync-user: portage
    priority: -1000

gentoo-draconx
    location: /srv/repos/gentoo-draconx
    masters: gentoo

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnux32"
CFLAGS="-O2 -march=broadwell -pipe"
CHOST="x86_64-pc-linux-gnux32"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -march=broadwell -pipe"
DISTDIR="/var/cache/portage/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going --dynamic-deps=n --autounmask-write=n --quiet-build --binpkg-respect-use=y"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs binpkg-multi-instance config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync webrsync-gpg xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
INSTALL_MASK="/etc/portage/bin/post_sync"
LANG="en_CA.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j2"
PKGDIR="/var/cache/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X acl amd64 berkdb bzip2 cli cracklib crypt cxx dri fortran gdbm iconv ipv6 mmx mmxext modules multilib ncurses nls nptl openmp pam pcre png readline seccomp session sse sse2 ssl svg tcpd truetype unicode xattr xft zlib" ABI_X86="x32" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4" RUBY_TARGETS="ruby21" USERLAND="GNU" VIDEO_CARDS="modesetting" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Comment 5 SpanKY gentoo-dev 2016-12-16 18:49:03 UTC
*** Bug 602672 has been marked as a duplicate of this bug. ***
Comment 6 Opportunist 2016-12-20 07:29:58 UTC
Confirm on AMD64
Comment 7 Daniel Augustin 2016-12-20 16:43:28 UTC
I think the problem is not about preserving the libs, but about not emerging a usable ncurses.

For me, this happened:

(doing some updates)
[...]
<<<          dir /usr/share/doc/kate-16.08.3
 * Updating icons cache ...                                                                                                                                                                                                             [ ok ]
 * Updating .desktop files database ...                                                                                                                                                                                                 [ ok ]
>>> Regenerating /etc/ld.so.cache...
>>> Original instance of package unmerged safely.
 * Updating icons cache ...                                                                                                                                                                                                             [ ok ]
 * Updating .desktop files database ...                                                                                                                                                                                                 [ ok ]
>>> kde-apps/kate-16.12.0 merged.
>>> Auto-cleaning packages...

 sys-libs/ncurses
    selected: 6.0-r1 
   protected: 6.0 
     omitted: none 

All selected packages: =sys-libs/ncurses-6.0-r1

Afterwards, the libncurses was preserved, but all files from ncurses were gone:

~ $ htop
Error opening terminal: xterm.

~ $ ldd $(which xterm) | grep ncurses
	libncurses.so.6 => /lib64/libncurses.so.6 (0x00007f6081c30000)

~ $ ls -l /lib/*ncurses*
lrwxrwxrwx 1 root root     17 Dec 17 10:50 /lib/libncurses.so.6 -> libncurses.so.6.0
-rwxr-xr-x 1 root root 382680 Dec 17 10:51 /lib/libncurses.so.6.0
lrwxrwxrwx 1 root root     18 Dec 17 10:51 /lib/libncursesw.so.6 -> libncursesw.so.6.0
-rwxr-xr-x 1 root root 469144 Dec 17 10:51 /lib/libncursesw.so.6.0

~ $ equery f ncurses
 * Searching for ncurses ...
 * Contents of sys-libs/ncurses-6.0:
Comment 8 Morton Pellung 2016-12-21 12:01:35 UTC
also happened yesterday for me: I emerged a package, did not pay
attention to what's happening and suddenly all ncurses related files
were gone and all newly started terminal programs unusable to due missing
terminfo database :-(
Immediately rebuilding ncurses failed with "tic missing" something,
but then I somehow succeeded and got a working system back
Comment 9 Teika kazura 2016-12-24 12:49:33 UTC
Almost the same as Comment #7, after upgrading a package.

Backgrounds: On Dec 15, I tried "emerge -pDu world", and portage said
------------------------------------------------------------------------
The following packages are causing rebuilds:

  (sys-libs/ncurses-6.0-r1:0/6::gentoo, ebuild scheduled for merge) causes rebuilds for:
    (app-text/aspell-0.60.6.1-r1:0/0::gentoo, ebuild scheduled for merge)
    ....
------------------------------------------------------------------------
Then I manually did:
  $ emerge --oneshot app-text/aspell ... sys-libs/ncurses:{0,5}
It caused the updating of ncurses 5.9-r5 -> 6.0-r1, and 5.9-r99 -> 6.0

Today, portage removed ncurses-6.0-r1, but 6.0 remained, as reported by Daniel Augstin in Comment #7

BTW: I had to manually scroll my X terminal to find this message:
------------------------------------------------------------------------
>>> Auto-cleaning packages...

 sys-libs/ncurses
    selected: 6.0-r1
   protected: 6.0
     omitted: none

All selected packages: =sys-libs/ncurses-6.0-r1
------------------------------------------------------------------------
Is it possible to save these messages by elog, using make.conf? I've got PORT_LOGDIR=/my/path/to/elog, and per-package logs get saved, but not the above one.

Thanks gentoo devs. Happy New Year.
Comment 10 Zac Medico gentoo-dev 2016-12-24 20:36:20 UTC
(In reply to teika from comment #9)
> Today, portage removed ncurses-6.0-r1, but 6.0 remained, as reported by
> Daniel Augstin in Comment #7
> 
> BTW: I had to manually scroll my X terminal to find this message:
> ------------------------------------------------------------------------
> >>> Auto-cleaning packages...
> 
>  sys-libs/ncurses
>     selected: 6.0-r1
>    protected: 6.0
>      omitted: none
> 
> All selected packages: =sys-libs/ncurses-6.0-r1
> ------------------------------------------------------------------------

I've filed bug 603658 for that issue.
Comment 11 Zac Medico gentoo-dev 2016-12-25 07:34:19 UTC
(In reply to Nick Bowler from comment #4)
> Created attachment 456112 [details]
> ncurses install log with postinst failure (compressed)

Using stage3-x32-20161201, I was able to to partially reproduce the problem shown in the above log. In my case, libncurses.so.5 was successfully preserved, but not libncursesw.so.5 and libpanelw.so.5:

>>> needed    sym /libx32/libncurses.so.5
>>> needed    obj /libx32/libncurses.so.5.9
>>> needed    sym /libx32/libncursesw.so.5
>>> needed    obj /libx32/libncursesw.so.5.9
>>> needed    sym /usr/lib64/libncurses.so.5
>>> needed    obj /usr/lib64/libncurses.so.5.9
>>> needed    sym /usr/libx32/libpanelw.so.5
>>> needed    obj /usr/libx32/libpanelw.so.5.9
>>> Safely unmerging already-installed instance...
>>> Regenerating /etc/ld.so.cache...
>>> Original instance of package unmerged safely.
>>> sys-libs/ncurses-6.0-r1 merged.
>>> Regenerating /etc/ld.so.cache...
<<< !needed  sym /libx32/libncursesw.so.5
<<< !needed  obj /libx32/libncursesw.so.5.9
<<< !needed  sym /usr/libx32/libpanelw.so.5
<<< !needed  obj /usr/libx32/libpanelw.so.5.9

Afterwards less was broken:

less: error while loading shared libraries: libncursesw.so.5: cannot open shared object file: No such file or directory

The stage3-x32-20161201 appears to have correct NEEDED.ELF.2 data involving libncursesw.so.5:

X86_64;/libx32/libncursesw.so.5.9;libncursesw.so.5;;libc.so.6;x86_x32
X86_64;/usr/bin/less;;;libncursesw.so.5,libpcre.so.1,libc.so.6;x86_x32

I'll have to use pdb to see what's going on here.
Comment 13 Hans de Graaff gentoo-dev Security 2016-12-27 16:40:12 UTC
(In reply to Morton Pellung from comment #8)

> Immediately rebuilding ncurses failed with "tic missing" something,
> but then I somehow succeeded and got a working system back

"Somehow." Aaargh. :-)

In case anyone else needs a workaround: it seems to help to first re-emerge the ncurses-5.9:0 version and then upgrade again to ncurses-6.0:0.
Comment 15 Jeroen Roovers (RETIRED) gentoo-dev 2016-12-29 14:27:33 UTC
(In reply to Zac Medico from comment #11)
> (In reply to Nick Bowler from comment #4)
> > Created attachment 456112 [details]
> > ncurses install log with postinst failure (compressed)
> 
> Using stage3-x32-20161201, I was able to to partially reproduce the problem
> shown in the above log. In my case, libncurses.so.5 was successfully
> preserved, but not libncursesw.so.5 and libpanelw.so.5:
> 
> >>> needed    sym /libx32/libncurses.so.5
> >>> needed    obj /libx32/libncurses.so.5.9
> >>> needed    sym /libx32/libncursesw.so.5
> >>> needed    obj /libx32/libncursesw.so.5.9
> >>> needed    sym /usr/lib64/libncurses.so.5
> >>> needed    obj /usr/lib64/libncurses.so.5.9
> >>> needed    sym /usr/libx32/libpanelw.so.5
> >>> needed    obj /usr/libx32/libpanelw.so.5.9
> >>> Safely unmerging already-installed instance...
> >>> Regenerating /etc/ld.so.cache...
> >>> Original instance of package unmerged safely.
> >>> sys-libs/ncurses-6.0-r1 merged.
> >>> Regenerating /etc/ld.so.cache...
> <<< !needed  sym /libx32/libncursesw.so.5
> <<< !needed  obj /libx32/libncursesw.so.5.9
> <<< !needed  sym /usr/libx32/libpanelw.so.5
> <<< !needed  obj /usr/libx32/libpanelw.so.5.9

That looks a bit like this:

1) Forcibly remove some unneeded and masked version of dev-lang/ruby.
2) Then immediately forcibly remove all virtual/perl- packages:

>>> 'Protected' and 'omitted' packages will not be removed.

>>> Waiting 5 seconds before starting...
>>> (Control-C to abort)...
>>> Unmerging in: 5 4 3 2 1
>>> Unmerging (1 of 71) virtual/perl-Archive-Tar-2.40.0-r1...
<<< !needed  sym /usr/lib/libruby20.so.2.0
<<< !needed  obj /usr/lib/libruby20.so.2.0.0
>>> Unmerging (2 of 71) virtual/perl-Attribute-Handlers-0.970.0...

Wait what? Removing a new-style virtual which installs (or removes) no files triggers the removal of preserved libraries!
Comment 16 Zac Medico gentoo-dev 2016-12-29 20:03:30 UTC
(In reply to Jeroen Roovers from comment #15)
> Wait what? Removing a new-style virtual which installs (or removes) no files
> triggers the removal of preserved libraries!

Yes, that's consistent with the bug fixed in cbaee3c3b28f52947c142da8df24d6b0817962f9. After some libraries are preserved, the first call to _find_unused_preserved_libs would behave incorrectly because LinkageMapElf used _approx_multilib_categories for preserved libraries, instead of using compute_multilib_category with the ELF header.
Comment 17 Zac Medico gentoo-dev 2017-05-20 18:07:01 UTC
Fixed in portage-2.3.5.