Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 328047 - dev-lang/python-3.1.2-r4 fails to build in some locales (e.g. lt_LT.UTF-8)
Summary: dev-lang/python-3.1.2-r4 fails to build in some locales (e.g. lt_LT.UTF-8)
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Development (show other bugs)
Hardware: All All
: High normal (vote)
Assignee: Python Gentoo Team
URL: http://bugs.python.org/issue7384
Whiteboard:
Keywords:
: 328045 (view as bug list)
Depends on:
Blocks:
 
Reported: 2010-07-13 04:50 UTC by blackdream
Modified: 2010-07-15 21:30 UTC (History)
14 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
builg.log (build.log,56.92 KB, text/plain)
2010-07-13 04:51 UTC, blackdream
Details

Note You need to log in before you can comment on or make changes to this bug.
Description blackdream 2010-07-13 04:50:03 UTC
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 1: ordinal not in range(128)

emerge --info =dev-lang/python-3.1.2-r4

Portage 2.1.8.3 (default/linux/amd64/10.0/desktop/gnome, gcc-4.5.0, glibc-2.11.2-r0, 2.6.34-ck-r1 x86_64)
=================================================================
                        System Settings
=================================================================
System uname: Linux-2.6.34-ck-r1-x86_64-AMD_Athlon-tm-_64_X2_Dual_Core_Processor_5000+-with-gentoo-2.0.1
Timestamp of tree: Tue, 13 Jul 2010 04:15:01 +0000
ccache version 2.4 [enabled]
app-shells/bash:     4.1_p7
dev-java/java-config: 2.1.11
dev-lang/python:     2.6.5-r3, 3.1.2-r3
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.8.1-r2
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.6.1-r1
sys-apps/sandbox:    2.2
sys-devel/autoconf:  2.13, 2.65-r1
sys-devel/automake:  1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/gcc:       4.5.0
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.10
virtual/os-headers:  2.6.34
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=athlon64 -msse3 -fomit-frame-pointer -O3 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=athlon64 -msse3 -fomit-frame-pointer -O3 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests ccache distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://mirrors.xmu.edu.cn/gentoo"
LANG="zh_CN.UTF-8"
LDFLAGS="-Wl,-O2,--as-needed"
LINGUAS="zh_CN"
MAKEOPTS="-j3"
PKGDIR="/home/blackdream/software/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--exclude-from=/etc/portage/rsync_excludes"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/home/blackdream/.overlay/x11 /home/blackdream/.overlay/suka /home/blackdream/.overlay/gnome /home/blackdream/.overlay/gentoo-china /home/blackdream/.overlay/mozilla /home/blackdream/.overlay/blackdream"
SYNC="rsync://mirrors.xmu.edu.cn/gentoo-portage"
USE="3dnow X a52 aac acl acpi alsa amd64 berkdb branding bzip2 cairo cli consolekit cracklib crypt cxx dbus dri dts dvd dvdr eds emboss encode evo exif fam firefox flac fortran gdbm gdu gif gnome gnome-keyring gpm gstreamer gtk iconv jpeg lcms ldap libnotify mad mikmod mmx mng modules mp3 mp4 mpeg mudflap multilib nautilus ncurses nls nptl nptlonly ogg opengl openmp pam pango pcre pdf perl png policykit ppds pppd python qt3support readline reflection sdl session smp spell spl sse sse2 ssl startup-notification svg sysfs tcpd tiff truetype udev unicode usb vorbis x264 xcb xml xorg xulrunner xv xvid zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="zh_CN" QEMU_SOFTMMU_TARGETS="i386 x86_64" QEMU_USER_TARGETS="i386 x86_64" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="radeon r600" XTABLES_ADDONS="cui gfw zhang ipset" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LC_ALL, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS


Reproducible: Always
Comment 1 blackdream 2010-07-13 04:51:35 UTC
Created attachment 238547 [details]
builg.log
Comment 2 blackdream 2010-07-13 04:52:22 UTC
emerge -pqv =dev-lang/python-3.1.2-r4

[ebuild     U ] dev-lang/python-3.1.2-r4 [3.1.2-r3] USE="gdbm ncurses readline sqlite* ssl threads (wide-unicode) xml -build -doc -examples -ipv6 -tk -wininst" 
Comment 3 Kacper Kowalik (Xarthisius) (RETIRED) gentoo-dev 2010-07-13 07:45:40 UTC
*** Bug 328045 has been marked as a duplicate of this bug. ***
Comment 4 Yuriy Dmitriev 2010-07-13 13:55:59 UTC
 File "./setup.py", line 160, in build_extensions
    missing = self.detect_modules()
  File "./setup.py", line 567, in detect_modules
    for ln in fp:
  File "/var/tmp/portage/dev-lang/python-3.1.2-r4/work/Python-3.1.2/Lib/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 1: ordinal not in range(128)
make: *** [sharedmods] Ошибка 1
 * ERROR: dev-lang/python-3.1.2-r4 failed:
 *   emake failed
Comment 5 Miroslav Šulc gentoo-dev 2010-07-13 21:40:37 UTC
i have the same issue. on ~amd64 arch, dev-lang/python-3.1.2-r3 is ok but dev-lang/python-3.1.2-r4 fails with the ascii codec error
Comment 6 Matthias Fulz 2010-07-13 22:03:29 UTC
same error here on ~amd64
 python-3.1.2-r3 working fine where python-3.1.2-r4 has the ascii error.

Comment 7 fkhp 2010-07-15 00:08:06 UTC
(In reply to comment #0)
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 1: ordinal
> not in range(128)

ascii.py caused many emerge problems. http://bugs.gentoo.org/show_bug.cgi?id=322545#c43
https://code.fluendo.com/flumotion/trac/ticket/1443#comment:7

as most locales have utf-8 charmap, so it seems utf_8.py should be preffered to ascii.py as codec.

gentoo ~ # ls /usr/lib64/python3.1/encodings/utf*8*
/usr/lib64/python3.1/encodings/utf_8.py  
/usr/lib64/python3.1/encodings/utf_8_sig.py
/usr/lib64/python3.1/encodings/utf_8.pyc 
/usr/lib64/python3.1/encodings/utf_8_sig.pyc
/usr/lib64/python3.1/encodings/utf_8.pyo 
/usr/lib64/python3.1/encodings/utf_8_sig.pyo
gentoo ~ # ls /usr/lib64/python2.6/encodings/utf*8*
/usr/lib64/python2.6/encodings/utf_8.py  
/usr/lib64/python2.6/encodings/utf_8_sig.py
/usr/lib64/python2.6/encodings/utf_8.pyc 
/usr/lib64/python2.6/encodings/utf_8_sig.pyc
/usr/lib64/python2.6/encodings/utf_8.pyo 
/usr/lib64/python2.6/encodings/utf_8_sig.pyo
gentoo ~ # 
Comment 8 blackdream 2010-07-15 05:13:34 UTC
(In reply to comment #7)
> (In reply to comment #0)
> > UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 1: ordinal
> > not in range(128)
> 
> ascii.py caused many emerge problems.
> http://bugs.gentoo.org/show_bug.cgi?id=322545#c43
> https://code.fluendo.com/flumotion/trac/ticket/1443#comment:7
> 
> as most locales have utf-8 charmap, so it seems utf_8.py should be preffered to
> ascii.py as codec.
> 
> gentoo ~ # ls /usr/lib64/python3.1/encodings/utf*8*
> /usr/lib64/python3.1/encodings/utf_8.py  
> /usr/lib64/python3.1/encodings/utf_8_sig.py
> /usr/lib64/python3.1/encodings/utf_8.pyc 
> /usr/lib64/python3.1/encodings/utf_8_sig.pyc
> /usr/lib64/python3.1/encodings/utf_8.pyo 
> /usr/lib64/python3.1/encodings/utf_8_sig.pyo
> gentoo ~ # ls /usr/lib64/python2.6/encodings/utf*8*
> /usr/lib64/python2.6/encodings/utf_8.py  
> /usr/lib64/python2.6/encodings/utf_8_sig.py
> /usr/lib64/python2.6/encodings/utf_8.pyc 
> /usr/lib64/python2.6/encodings/utf_8_sig.pyc
> /usr/lib64/python2.6/encodings/utf_8.pyo 
> /usr/lib64/python2.6/encodings/utf_8_sig.pyo
> gentoo ~ # 
> 

How can I solve it?
Comment 9 sisoft 2010-07-15 09:41:03 UTC
I can merge it with MAKEOPTS="-j1" LANG=en_US.UTF-8
Comment 10 blackdream 2010-07-15 09:55:38 UTC
(In reply to comment #9)
> I can merge it with MAKEOPTS="-j1" LANG=en_US.UTF-8
> 

Thx u so much! It works.^_^
Comment 11 Artem Semendyaev 2010-07-15 10:51:27 UTC
(In reply to comment #10)
> (In reply to comment #9)
> > I can merge it with MAKEOPTS="-j1" LANG=en_US.UTF-8
> > 
> 
> Thx u so much! It works.^_^
> 

but it doesn't for LANG=ru_RU.UTF-8 :(
Comment 12 blackdream 2010-07-15 11:02:52 UTC
(In reply to comment #11)
> (In reply to comment #10)
> > (In reply to comment #9)
> > > I can merge it with MAKEOPTS="-j1" LANG=en_US.UTF-8
> > > 
> > 
> > Thx u so much! It works.^_^
> > 
> 
> but it doesn't for LANG=ru_RU.UTF-8 :(
> 

u type "MAKEOPTS="-j1" LANG=ru_RU.UTF-8 emerge -1av dev-lang/python-3.1.2-r4"

or

"MAKEOPTS="-j1" LANG=en_US.UTF-8 emerge -1av =dev-lang/python-3.1.2-r4 "?
Comment 13 Artem Semendyaev 2010-07-15 12:18:52 UTC
(In reply to comment #12)
> 
> u type "MAKEOPTS="-j1" LANG=ru_RU.UTF-8 emerge -1av dev-lang/python-3.1.2-r4"
> 
> or
> 
> "MAKEOPTS="-j1" LANG=en_US.UTF-8 emerge -1av =dev-lang/python-3.1.2-r4 "?
> 

my bad, sorry, tried with LANG=ru_RU.UTF-8. LANG=en_US.UTF-8 works fine
Comment 14 Xavier Miller (RETIRED) gentoo-dev 2010-07-15 20:23:55 UTC
The problem is not with parallel make!

Works OK form me by disabling locale :

LC_ALL=C emerge -1 =python-3.1.2-r4
Comment 15 Arfrever Frehtes Taifersar Arahesis (RETIRED) gentoo-dev 2010-07-15 21:22:05 UTC
I have added LC_ALL="C".