emerge docutils failed, but LANG=C emerge docutils work fine Reproducible: Always Steps to Reproduce: 1.emerge docutils Actual Results: emerge stops with error LANG=C emerge docutils work fine
emerge --info =dev-python/docutils-0.7 Portage 2.1.9.25 (default/linux/amd64/10.0, gcc-4.5.1, glibc-2.12.1-r3, 2.6.36-gentoo-r5 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-2.6.36-gentoo-r5-x86_64-AMD_Phenom-tm-_II_X4_965_Processor-with-gentoo-2.0.1 Timestamp of tree: Sun, 19 Dec 2010 18:00:01 +0000 app-shells/bash: 4.1_p9 dev-java/java-config: 2.1.11-r3 dev-lang/python: 2.7.1 dev-util/cmake: 2.8.3 sys-apps/baselayout: 2.0.1-r1 sys-apps/openrc: 0.6.8 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.68 sys-devel/automake: 1.10.3, 1.11.1 sys-devel/binutils: 2.21 sys-devel/gcc: 4.5.1-r1 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82 virtual/os-headers: 2.6.36.1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA AdobeFlash-10.1 PUEL skype-eula" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O3 -pipe -march=native" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O3 -pipe -march=native" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="ru_RU.UTF-8" LC_ALL="" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="ru" MAKEOPTS="-j5" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/multimedia /var/lib/layman/lxde /var/lib/layman/x11 /var/lib/layman/sunrise /var/lib/layman/xwing /var/lib/layman/gamerlay /usr/local/portage/overlay/booboo" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="3dnow 3dnowext X acl acpi alsa amd64 berkdb bzip2 cairo cli consolekit cracklib cxx dbus dga djvu dri enca extras fortran gdbm git graphite gtk hal hotkeys iconv idle ip1500 java jpeg jpeg2k lastfm libnotify libsamplerate mad mercurial mmx mmxext modules mp3 mudflap multilib ncurses nls nptl nptlonly nsplugin ogg opencl opengl openmp pam pcre png policykit postgres pppd radio readline secure-delete session smp sqlite srv sse sse2 sse3 ssl ssse3 startup-notification subversion svg sysfs tcpd threads tiff truetype udev unicode usb vorbis xorg xvmc zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="ru" LIRC_DEVICES="pixelview_bt878" PHP_TARGETS="php5-2" RUBY_TARGETS="ruby18" SANE_BACKENDS="genesys" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= dev-python/docutils-0.7 was built with the following: USE="(multilib) -emacs -glep"
emerge -pqv =dev-python/docutils-0.7 [ebuild R ] dev-python/docutils-0.7 USE="-emacs -glep"
Created attachment 257565 [details] Environment
Created attachment 257566 [details] Build log
exactly the same error for me. except that i need to "unmask" my LC_ALL as well as LANG: juno portage # LANG=C LC_ALL=C emerge -u docutils -1 my emerge --info: Portage 2.2.0_alpha12 (default/linux/amd64/10.0, gcc-4.5.2, glibc-2.12.1-r3, 2.6.35-gentoo-r15-03 x86_64) ================================================================= System uname: Linux-2.6.35-gentoo-r15-03-x86_64-Intel-R-_Core-TM-2_Quad_CPU_Q6600_@_2.40GHz-with-gentoo-2.0.1 Timestamp of tree: Mon, 03 Jan 2011 23:45:01 +0000 app-shells/bash: 4.1_p9 dev-java/java-config: 2.1.11-r3 dev-lang/python: 2.6.6-r1, 2.7.1 dev-util/cmake: 2.8.3-r1 sys-apps/baselayout: 2.0.1-r1 sys-apps/openrc: 0.6.8 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.13, 2.68 sys-devel/automake: 1.5-r1, 1.7.9-r2, 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.21 sys-devel/gcc: 4.5.2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82 virtual/os-headers: 2.6.35 (sys-kernel/linux-headers) Repositories: gentoo sunrise x-tsabi ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -march=core2 -mtune=core2 -pipe -msse -msse2 -mmmx -fomit-frame-pointer" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /opt/openfire/resources/security/ /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -march=core2 -mtune=core2 -pipe -msse -msse2 -mmmx -fomit-frame-pointer" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs buildpkg distlocks fixlafiles fixpackages metadata-transfer news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="hu_HU.utf8" LC_ALL="hu_HU.utf8" LDFLAGS="-Wl,-O1 -Wl,-z,now -Wl,-z,relro -Wl,--as-needed" LINGUAS="hu en" MAKEOPTS="-j1" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/sunrise /usr/local/portage/layman/tsabi" SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage" USE="aac accounting acl acpi acpi4linux activefilter adns amd64 apache2 apm arts avahi bash-completion bashlogger bcmath berkdb bzip2 bzlib c++ calendar cap caps cdparanoia cdr cdrom chroot clamac clamav cli cracklib crypt ctype cups curl curlwrappers cyrus dba dbase dbm dbus devfs devfs26 device-mapper devmap dhcp dio dmx dnd dnsdb dv dvb dvd dvdr dvdread encode erandom escreen ethereal evms2 exif expat extensions f2c fam fastcgi flac freetype fs ftp gd gdbm geoip gif gmp gnutls hal iconv idled idn image imagemagick imap inifile innodb intl ipv6 java javascript jikes jpeg jpeg2k kerberos lesstif libffi libg++ live lm_sensors logrotate lzma lzo lzw lzw-tiff memlimit mhash mime mmap mmx mmx2 mng modules mp3 mpeg mpeg4 mpm-worker mppe-mppc msdav msession mudflap multilib ncurses nethack network network-cron nls nptl nptlonly ntlm oav objc oggvorbis openal openmp openssh pam parse-clocks pcap pcntl pcre pdf perl pg-vacuumdelay php pic plugins pnp posix postgres pppd pthreads pwdb python readline recode rpc sasl session sftplogging shared sharedmem simplexml skey slang smime sms snmp sockets spell squid sse sse2 ssl svg symlink sysfs sysvipc tcl tcltk tcpd threads transcode truetype type1 underscores unicode urandom usb userlocales vhosts virus-scan wmf xattr xfs xinetd xml xmlrpc xorg xprint zero-penalty-hit zeroconf zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_alias authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cern_meta dav dav_fs dav_lock deflate dir disk_cache dumpio env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack version vhost_alias cgi proxy proxy_balancer proxy_connect proxy_http" APACHE2_MPMS="peruser" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="hu en" NGINX_MODULES_HTTP="access auth_basic autoindex browser charset empty_gif fastcgi gzip limit_req limit_zone map memcached proxy referer rewrite scgi split_clients upstream_ip_hash userid uwsgi flv gzip_static stub_status" PHP_TARGETS="php5-3" USERLAND="GNU" VIDEO_CARDS="none" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
First, please edit summary: not "filed", it's "failed". Second, I've got this bug too, LANG=C helped. # emerge --info =dev-python/docutils-0.7 Portage 2.1.9.25 (default/linux/amd64/10.0/desktop, gcc-4.4.4, glibc-2.11.2-r3, 2.6.34-gentoo-r12.23 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-2.6.34-gentoo-r12.23-x86_64-Pentium-R-_Dual-Core_CPU_T4200_@_2.00GHz-with-gentoo-2.0.1 Timestamp of tree: Wed, 16 Feb 2011 13:15:01 +0000 app-shells/bash: 4.1_p9 dev-lang/python: 2.6.6-r1 dev-util/cmake: 2.8.3-r1 sys-apps/baselayout: 2.0.1-r1 sys-apps/openrc: 0.7.0 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.13, 2.65-r1 sys-devel/automake: 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.4-r2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 virtual/os-headers: 2.6.30-r1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo" CXXFLAGS="-march=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps=y" FEATURES="assume-digests binpkg-logs distlocks fakeroot fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="ru_RU.UTF-8" LC_ALL="" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="ru en" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/enlightenment-niifaq /var/lib/layman/lcd-filtering /usr/local/portage" SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage" USE="X a52 aac acl acpi alsa amd64 amr apm bluetooth branding bzip2 cairo caps cdda cdio cdr cleartype cli consolekit cracklib cue cups cxx dbus dga dirac dri dts dvd dvdr emboss encode exif faad fam ffmpeg firefox flac fluidsynth gdu gif gmp gnutls gpm gtk hal iconv icq imlib ipv6 jadetex jpeg kde kdm laptop lcms libass libdvdcss lzma lzo mad matroska midi mikmod mmx mng modules mp3 mp4 mpeg mplayer mtp mudflap multilib ncurses network nls nptl nptlonly ogg openal opengl openmp pango pch pcmcia pcntl pcre pdf pic plasma png policykit posix ppds pppd projectm qt3support qt4 raw readline session sftp sndfile sockets spell sse sse2 ssl ssse3 startup-notification svg sysfs tcpd tga theora threads tiff truetype udev unicode usb utils v4l v4l2 vaapi vdpau videos vorbis wavpack wicd wifi wma wxwidgets x264 xcb xcomposite xine xml xorg xpm xscreensaver xulrunner xv xvid zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="ru en" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" SANE_BACKENDS="hp" USERLAND="GNU" VIDEO_CARDS="vesa vga nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= dev-python/docutils-0.7 was built with the following: USE="(multilib) -emacs -glep"
I noticed that people in this bug have only Python 2 installed. buildhtml.py needs to be run only once, so it is run only with the final Python ABI. When Python 2.7 and 3.1 are the only installed versions, then 3.1 is the final Python ABI by default. I have set LANG="ru_RU.UTF-8" LC_ALL="ru_RU.UTF-8" and I cannot reproduce failure of running of buildhtml.py with Python 2.6, 2.7 or 3.1.
Indeed, I have only dev-lang/python-2.7.1-r1 installed and no other versions. I can reproduce the bug. What information do I need to provide in order to help you reproduce it?
Does installation of dev-python/docutils-0.7 work with en_US.UTF-8 locale?
Working locales: en_US.UTF-8, fr_FR.UTF-8, de_DE.UTF-8, hi_IN.UTF-8, pl_PL.UTF-8 Non-working: ru_RU.UTF-8, cs_CZ.UTF-8, cs_CZ, ja_JP.UTF-8, ru_RU.KOI8-R, pl_PL
oops, I meant cs_CZ as non-working instead of pl_PL
Please join #gentoo-python IRC channel on Freenode and ask Arfrever for help in debugging.
There seems to be a timezone issue: you sent me an invitation to IRC after I went to sleep. I am in Dublin, so the local time is GMT. What is your GMT offset? When should we meet on IRC?
I have added a patch in dev-python/docutils-0.7.
Please test if this bug occurs in dev-python/docutils-0.8_pre7013 (which doesn't use that patch).
dev-python/docutils-0.8_pre7013 still fails to build with the same "bad unicode" error. 0.7 is indeed fixed by your patch.
The traceback might be slightly different. Please attach full build log.
Created attachment 270891 [details] Build log This is the build log obtained on a ~amd64 gentoo box that has multilib overlay enabled: [ebuild U ] dev-python/docutils-0.8_pre7013 [0.7] USE="-emacs -glep" MULTILIB_ABI="amd64 x86" 0 kB I hope it helps you.
Created attachment 271287 [details] build log Build for dev-python/docutils-0.8_pre7013 failed using locales en_US.ISO-8859-1 and en_US.UTF-8.
(In reply to comment #19) It's unrelated to this bug.
(In reply to comment #20) > (In reply to comment #19) > > It's unrelated to this bug. Should I open another bug? The error message that I've got in the build.log is UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 10: ordinal not in range(128)
(In reply to comment #21) > Should I open another bug? No. You reproduced a problem already reported somewhere else. > The error message that I've got in the build.log is UnicodeDecodeError But in a different file.
Please test dev-python/docutils-0.8_pre7031.
Created attachment 272889 [details] Failed log from dev-python/docutils-0.8_pre7031 The build still fails. And I have a question: why do the localized messages ever appear in that place of code? Shouldn't a documentation-building package strive for reproducible and locale-independent output and thus take steps (such as unsetting the locale) to avoid them?
I have similar problem, but my compilation fails with error: "ValueError: bad marshal data (unknown type code)" Should i open different bug?
Yes, your bug is different.
Please test dev-python/docutils-0.8_pre7034.
Created attachment 273231 [details] Failed log from dev-python/docutils-0.8_pre7034 Still fails
Please test dev-python/docutils-0.8_pre7036.
Created attachment 273499 [details] Failed build log from dev-python/docutils-0.8_pre7036 Could you please test the build yourself next time? If necessary, I will provide a kvm disk image that reproduces the problem.
I have managed to be able to reproduce this bug after changing LINGUAS variable and reinstalling sys-libs/glibc.
Fixed by upstream in dev-python/docutils-0.8_pre7038.
