Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 263081 - >=sys-apps/portage-2.1.6.8: UnicodeDecodeError when emerging some packages or emerge -u world
Summary: >=sys-apps/portage-2.1.6.8: UnicodeDecodeError when emerging some packages or...
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Unclassified (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS, REGRESSION
Depends on:
Blocks: 210077 261959
  Show dependency tree
 
Reported: 2009-03-19 22:20 UTC by Bartosz Brachaczek
Modified: 2010-07-15 07:49 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bartosz Brachaczek 2009-03-19 22:20:53 UTC
Hi,
When I updated to portage-2.1.6.8 and done 'emerge -DNuav world', I got the following message:

These are the packages that would be merged, in order:

Calculating dependencies \

!!! Problem in 'media-video/mplayer' dependencies.
!!! 'ascii' codec can't decode byte 0xc5 in position 1: ordinal not in range(128) None
Traceback (most recent call last):
  File "/usr/bin/emerge", line 40, in <module>
    retval = _emerge.emerge_main()
  File "/usr/lib/portage/pym/_emerge/__init__.py", line 15189, in emerge_main
    myopts, myaction, myfiles, spinner)
  File "/usr/lib/portage/pym/_emerge/__init__.py", line 14112, in action_build
    retval, favorites = mydepgraph.select_files(myfiles)
  File "/usr/lib/portage/pym/_emerge/__init__.py", line 5657, in select_files
    myroot, atom, onlydeps=onlydeps)
  File "/usr/lib/portage/pym/_emerge/__init__.py", line 6075, in _select_pkg_highest_available
    ret = self._select_pkg_highest_available_imp(root, atom, onlydeps=onlydeps)
  File "/usr/lib/portage/pym/_emerge/__init__.py", line 6260, in _select_pkg_highest_available_imp
    pkgsettings.setcpv(pkg)
  File "/usr/lib/portage/pym/portage/__init__.py", line 2173, in setcpv
    self.reset(keeping_pkg=1,use_cache=use_cache)
  File "/usr/lib/portage/pym/portage/__init__.py", line 1968, in reset
    self.regenerate(use_cache=use_cache)
  File "/usr/lib/portage/pym/portage/__init__.py", line 2806, in regenerate
    self.configlist[-1]["USE"]= " ".join(sorted(myflags))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 1: ordinal not in range(128)

so I thought that I have done something wrong and masked this version as temporary solution (hadn't much time and 2.1.6.7 was working fine). Then 2.1.6.9 version was released, so I installed it and got exact message, did some testing and filed a bug.

When I masked media-video/mplayer, got this:

These are the packages that would be merged, in order:

Calculating dependencies -Traceback (most recent call last):
  File "/usr/bin/emerge", line 40, in <module>
(the rest as above...)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 5: ordinal not in range(128)

Portage does any other operation than 'emerge -u world' fine, expect 'emerge mplayer'. Also noticed that 'emerge virtualbox-bin' gives the same result as with mplayer (I have mplayer installed but virtualbox-bin not).
Also noticed that portage-2.2_rc26 has the same issue, and rc23 works fine.


Reproducible: Always




Portage 2.1.6.9 (default/linux/x86/2008.0/desktop, gcc-4.3.3, glibc-2.9_p20081201-r2, 2.6.28-gentoo-r3 i686)
=================================================================
System uname: Linux-2.6.28-gentoo-r3-i686-AMD_Turion-tm-_64_Mobile_Technology_MK-36-with-glibc2.0
Timestamp of tree: Thu, 19 Mar 2009 19:45:01 +0000
app-shells/bash:     4.0_p10-r1
dev-java/java-config: 1.3.7-r1, 2.1.7
dev-lang/python:     2.5.4-r2
dev-util/cmake:      2.6.3
sys-apps/baselayout: 2.0.0
sys-apps/openrc:     0.4.3-r1
sys-apps/sandbox:    1.6
sys-devel/autoconf:  2.13, 2.63
sys-devel/automake:  1.5, 1.7.9-r1, 1.9.6-r2, 1.10.2
sys-devel/binutils:  2.19.1-r1
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6a
virtual/os-headers:  2.6.28-r1
ACCEPT_KEYWORDS="x86 ~x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=athlon-xp -msse3 -O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-march=athlon-xp -msse3 -O2 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
FEATURES="distlocks fixpackages metadata-transfer parallel-fetch protect-owned sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="ftp://gentoo.po.opole.pl/ http://gentoo.po.opole.pl/ ftp://ftp.vectranet.pl/gentoo/ http://gentoo.mirror.pw.edu.pl/ http://distfiles.gentoo.org http://www.ibiblio.org/pub/Linux/distributions/gentoo"
LANG="pl_PL.UTF-8"
LC_ALL="pl_PL.UTF-8"
LDFLAGS="-Wl,-O1"
LINGUAS="pl"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage/layman/roslin /usr/local/portage"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext X a52 aac acpi alsa avahi bash-completion berkdb branding bzip2 cairo cdr consolekit cups cxx dbus dvd dvdr encode exif fam ffmpeg flac fortran gif glib gnome gnutls gpm gstreamer gtk hal iconv jpeg jpeg2k libnotify libsamplerate lzo mad midi mikmod mmx mmxext mp3 mpeg mudflap nautilus ncurses nls nptl nptlonly nsplugin ogg opengl pam pcre perl png ppds python qt3support quicktime readline samba schroedinger sdl session sndfile spell sse sse2 sse3 ssl startup-notification svg tcpd theora threads tiff truetype unicode usb vim-syntax vorbis win32codecs wmf x264 x86 xcb xml xorg xulrunner xv xvid xvmc zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" FOO2ZJS_DEVICES="hp1020" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="pl" USERLAND="GNU" VIDEO_CARDS="via vesa"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Zac Medico gentoo-dev 2009-03-19 22:44:23 UTC
It seems that you have a unicode character inside /etc/portage/package.use settings for mplayer. Please post the output of this command:

 grep media-video/mplayer /etc/portage/package.use
Comment 2 Bartosz Brachaczek 2009-03-19 23:11:41 UTC
(In reply to comment #1)
> It seems that you have a unicode character inside /etc/portage/package.use
> settings for mplayer.
Yes, indeed, I have. Now I see it's causing the problem.

>  Please post the output of this command:
>  grep media-video/mplayer /etc/portage/package.use
> 

# grep media-video/mplayer /etc/portage/package.use
media-video/mplayer -fbcon
media-video/mplayer -gtk #jakaś skórka, nie używam jej
media-video/mplayer -oss #domyślnie było włączone (?)

So now the only proper way of adding comments is to place them above the package atom?
Comment 3 Zac Medico gentoo-dev 2009-03-19 23:26:57 UTC
Right, only lines that begin with # are recognized as comments.
Comment 4 Bartosz Brachaczek 2009-03-19 23:29:16 UTC
Ok, thanks. My bad, sorry for fuss.
Comment 5 Zac Medico gentoo-dev 2009-03-20 00:35:03 UTC
Well, it's still a valid bug. We should fix it to simply ignore unicode encode/decode errors in cases like this where they don't really matter.

I suspect that you have the sqlite cache module enabled in /etc/portage/modules, since that might trigger the UnicodeDecodeError that you reported. Am I right?
Comment 6 Bartosz Brachaczek 2009-03-20 14:09:23 UTC
(In reply to comment #5)
> Well, it's still a valid bug. We should fix it to simply ignore unicode
> encode/decode errors in cases like this where they don't really matter.

Ah, ok. Misunderstood.

> I suspect that you have the sqlite cache module enabled in
> /etc/portage/modules, since that might trigger the UnicodeDecodeError that you
> reported. Am I right?

Right.
Comment 7 Zac Medico gentoo-dev 2009-03-22 08:39:00 UTC
(In reply to comment #6)
> > I suspect that you have the sqlite cache module enabled in
> > /etc/portage/modules, since that might trigger the UnicodeDecodeError that you
> > reported. Am I right?
> 
> Right.
> 

Thanks for the confirmation. In svn r13141 I've reverted the changes in the sqlite module which triggered the UnicodeDecodeError.
Comment 8 Zac Medico gentoo-dev 2009-03-23 07:17:34 UTC
This is fixed in 2.1.6.10.