Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 343721 - A number of Python packages fail to build with python 3.1+ and a non-utf8 locale
Summary: A number of Python packages fail to build with python 3.1+ and a non-utf8 locale
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: New packages (show other bugs)
Hardware: All Linux
: High normal with 1 vote (vote)
Assignee: Python Gentoo Team
URL: http://bugs.python.org/issue9561
Whiteboard:
Keywords:
: 345023 359371 375985 387993 406027 (view as bug list)
Depends on:
Blocks: 366879 393533 403681
  Show dependency tree
 
Reported: 2010-11-01 15:18 UTC by Diego Elio Pettenò (RETIRED)
Modified: 2012-05-23 16:38 UTC (History)
11 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
Build log (smart-live-rebuild-0.6.4:20101101-145103.log,5.29 KB, text/plain)
2010-11-01 15:18 UTC, Diego Elio Pettenò (RETIRED)
Details
Patch to add the patch and revbump ebuilds (0001-Add-distutils-egg-file-writing-utf8-patch-for-bug-34.patch,3.63 KB, patch)
2011-09-23 10:49 UTC, Michał Górny
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Diego Elio Pettenò (RETIRED) gentoo-dev 2010-11-01 15:18:43 UTC
Portage 2.1.9.24 (default/linux/amd64/10.0, gcc-4.5.1-asneeded, glibc-2.12.1-r2, 2.6.36+ x86_64)
=================================================================
System uname: Linux-2.6.36+-x86_64-Quad-Core_AMD_Opteron-tm-_Processor_2350-with-gentoo-2.0.1
Timestamp of tree: Sun, 31 Oct 2010 21:00:01 +0000
ccache version 2.4 [disabled]
app-shells/bash:     4.1_p9
dev-java/java-config: 2.1.11-r1
dev-lang/python:     2.7, 3.1.2-r4
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.8.1-r2
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.6.3
sys-apps/sandbox:    2.3-r1
sys-devel/autoconf:  2.13, 2.68
sys-devel/automake:  1.4_p6-r1, 1.5-r1, 1.6.3-r1, 1.7.9-r2, 1.8.5-r4, 1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/gcc:       4.5.1
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.10
sys-devel/make:      3.82
virtual/os-headers:  2.6.35 (sys-kernel/linux-headers)
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/openvpn/easy-rsa /var/lib/hsqldb /var/qmail/alias /var/qmail/control /var/vpopmail/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe"
DISTDIR="/var/cache/portage/distfiles"
FEATURES="assume-digests binpkg-logs distlocks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms split-log strict test test-fail-continue unknown-features-warn unmerge-orphans userfetch userpriv usersandbox"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://gentoo.wheel.sk/"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu"
MAKEOPTS="-j14"
PKGDIR="/var/spool/portage/packages"
PORTAGE_COMPRESS=""
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/var/cache/portage/tree"
SYNC="rsync://yamato.home.flameeyes.eu/gentoo-portage"
USE="acl amd64 berkdb bzip2 cli cracklib crypt cups cxx dri fortran gdbm gpm iconv ipv6 java5 java6 mmx modules mudflap multilib mysql ncurses nls nostatic nptl nptlonly openmp pam pcre perl postgres pppd python qt3support readline ruby session sse sse2 ssl sysfs tcpd unicode vhosts xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias auth_digest cgi" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" PHP_TARGETS="php5-2" RUBY_TARGETS="ruby18 jruby ruby19 ree18" USERLAND="GNU" VIDEO_CARDS="intel radeon nouveau vmware" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos aclines 1-43/45 95%
Comment 1 Diego Elio Pettenò (RETIRED) gentoo-dev 2010-11-01 15:18:59 UTC
Created attachment 252805 [details]
Build log
Comment 2 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2010-11-01 15:28:07 UTC
As already said a million times before, this is a bug in Python [1] and I really can't do anything specific about it. As a workaround, you can set locale to utf8 during the build.

Feel free to suggest any solution if you've got one. But I really would like to avoid restricting 3.* completely, changing my name or printing a warning in each ebuild.

[1] http://bugs.python.org/issue9561
Comment 3 Diego Elio Pettenò (RETIRED) gentoo-dev 2010-11-01 15:30:36 UTC
I feel your pain (regarding names and UTF-8).

For what I'm concerned, this bug in our bugzilla should stay open to testify that *PYTHON 3.1 IS NOT F…INELY READY*.
Comment 4 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2010-11-01 15:37:05 UTC
Python, do you have any reusable idea?
Comment 5 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2010-11-14 09:14:21 UTC
*** Bug 345023 has been marked as a duplicate of this bug. ***
Comment 6 Paul Varner (RETIRED) gentoo-dev 2010-11-18 21:11:07 UTC
Add app-portage/gentoolkit-0.3.0_rc11 to this list
Comment 7 Seth Robertson 2010-11-21 02:09:30 UTC
As #2 hinted at, running the build with LC_CTYPE set allows the build to complete.

LC_CTYPE=en_US.utf8 emerge flaggie

Before I did that, I also updated /etc/locale.gen to:

en_US ISO-8859-1
en_US.UTF-8 UTF-8

and ran locale-gen, but I don't know if that was a necessary part of the solution (it was not sufficient)
Comment 8 Vladimir Berezhnoy 2010-12-04 07:08:48 UTC
Quick workaround based on comment #7


# mkdir -p /etc/portage/env/app-portage/
# echo "export LC_CTYPE=en_US.utf8" > /etc/portage/env/app-portage/flaggie
Comment 9 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-03-18 16:39:42 UTC
*** Bug 359371 has been marked as a duplicate of this bug. ***
Comment 10 Arfrever Frehtes Taifersar Arahesis (RETIRED) gentoo-dev 2011-05-11 13:28:55 UTC

*** This bug has been marked as a duplicate of bug 366879 ***
Comment 11 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-07-22 12:58:43 UTC
*** Bug 375985 has been marked as a duplicate of this bug. ***
Comment 12 Ulrich Müller gentoo-dev 2011-09-19 08:56:56 UTC
Did I get this right: The problem is triggered by non-ASCII characters in *comments*?

Then why can't the trivial and obvious workaround (namely changing those comments to ASCII only) be applied?
Comment 13 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-09-19 09:04:14 UTC
(In reply to comment #12)
> Did I get this right: The problem is triggered by non-ASCII characters in
> *comments*?

The comments part of the bug was fixed already. Now the author metadata is an issue but it's being fixed as well.

> Then why can't the trivial and obvious workaround (namely changing those
> comments to ASCII only) be applied?

There's no point in discussing this when patches are already on their way to gx86.
Comment 14 Ulrich Müller gentoo-dev 2011-09-19 09:53:00 UTC
Any ETA for the python bug being fixed? Applying the workaround might still be worthwhile (depending on the time frame).
Comment 15 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-09-19 10:40:06 UTC
(In reply to comment #14)
> Any ETA for the python bug being fixed? Applying the workaround might still be
> worthwhile (depending on the time frame).

It should hit the gx86 patchsets in a few days (if it didn't already), then prolly usual stabilisation period for patchset bumps.
Comment 16 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-09-23 10:29:28 UTC
Ok, reopening this one to handle the EGG-FILE utf8 patch.
Comment 17 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-09-23 10:49:36 UTC
Created attachment 287485 [details, diff]
Patch to add the patch and revbump ebuilds
Comment 18 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2011-10-21 17:38:08 UTC
*** Bug 387993 has been marked as a duplicate of this bug. ***
Comment 19 Mike Gilbert gentoo-dev 2012-03-21 16:28:39 UTC
Thanks for the back port. I have committed python-3.1.4-r4 and python-3.2.2-r1. I will file a STABLEREQ in a week or so.
Comment 20 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2012-05-16 20:46:35 UTC
*** Bug 406027 has been marked as a duplicate of this bug. ***
Comment 21 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2012-05-23 16:38:42 UTC
That's fixed in python-3.2.3.