Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 328721 - dev-python/docutils-0.7 raising UnicodeDecodeError during build
Summary: dev-python/docutils-0.7 raising UnicodeDecodeError during build
Status: RESOLVED DUPLICATE of bug 322545
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Unspecified (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Python Gentoo Team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-07-17 12:09 UTC by me
Modified: 2010-07-29 22:59 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
Output log of failing docutils build (1278955176-install-dev-python_docutils-0.7:0::gentoo.out,39.97 KB, text/plain)
2010-07-17 12:10 UTC, me
Details
docutils-0.7.ebuild.patch (docutils-0.7.ebuild.patch,377 bytes, patch)
2010-07-19 19:56 UTC, Arfrever Frehtes Taifersar Arahesis (RETIRED)
Details | Diff
Output of "cave info '=dev-python/docutils-0.7'" (cave-info_dev-python_docutils-0.7,11.35 KB, text/plain)
2010-07-20 07:26 UTC, me
Details

Note You need to log in before you can comment on or make changes to this bug.
Description me 2010-07-17 12:09:45 UTC
dev-python/docutils-0.7 fails to build, raising a UnicodeDecodeError.  Build output is attached.

Locale is "de_DE.utf-8":

LANG=de_DE.utf8
LC_CTYPE="de_DE.utf8"
LC_NUMERIC="de_DE.utf8"
LC_TIME="de_DE.utf8"
LC_COLLATE="de_DE.utf8"
LC_MONETARY="de_DE.utf8"
LC_MESSAGES="de_DE.utf8"
LC_PAPER="de_DE.utf8"
LC_NAME="de_DE.utf8"
LC_ADDRESS="de_DE.utf8"
LC_TELEPHONE="de_DE.utf8"
LC_MEASUREMENT="de_DE.utf8"
LC_IDENTIFICATION="de_DE.utf8"
LC_ALL=de_DE.utf8
Comment 1 me 2010-07-17 12:10:36 UTC
Created attachment 239127 [details]
Output log of failing docutils build
Comment 2 Jeroen Roovers (RETIRED) gentoo-dev 2010-07-19 16:16:55 UTC
Please post your `emerge --info' too.
Comment 3 me 2010-07-19 16:33:20 UTC
I do not use portage, but paludis, as you can see in the output log, so what information do you want from "emerge --info" output?
Comment 4 Arfrever Frehtes Taifersar Arahesis (RETIRED) gentoo-dev 2010-07-19 19:56:48 UTC
Created attachment 239435 [details, diff]
docutils-0.7.ebuild.patch

Please apply this patch and attach the new build log.
Comment 5 fkhp 2010-07-20 03:25:24 UTC
(In reply to comment #4)
> Created an attachment (id=239435) [details]
> docutils-0.7.ebuild.patch
> 
> Please apply this patch and attach the new build log.
> 
copying docutils/writers/s5_html/themes/big-black/__base__ -> build-3.1/lib/docutils/writers/s5_html/themes/big-black
PYTHONPATH=../build-3.1/lib python3.1 ../build-3.1/lib/tools/buildhtml.py --stylesheet-path=../html4css1.css --traceback ..
/// Processing directory: ..
    ::: Processing: THANKS.txt
Traceback (most recent call last):
  File "../build-3.1/lib/tools/buildhtml.py", line 244, in <module>
    Builder().run()
  File "../build-3.1/lib/tools/buildhtml.py", line 186, in run
    self.visit(recurse, root, dirs+files)
  File "../build-3.1/lib/tools/buildhtml.py", line 211, in visit
    prune = self.process_txt(directory, name)
  File "../build-3.1/lib/tools/buildhtml.py", line 237, in process_txt
    settings=settings)
  File "/var/tmp/paludis/dev-python-docutils-0.7/work/docutils-0.7/build-3.1/lib/docutils/core.py", line 357, in publish_file
    enable_exit_status=enable_exit_status)
  File "/var/tmp/paludis/dev-python-docutils-0.7/work/docutils-0.7/build-3.1/lib/docutils/core.py", line 641, in publish_programmatically
    output = pub.publish(enable_exit_status=enable_exit_status)
  File "/var/tmp/paludis/dev-python-docutils-0.7/work/docutils-0.7/build-3.1/lib/docutils/core.py", line 203, in publish
    self.settings)
  File "/var/tmp/paludis/dev-python-docutils-0.7/work/docutils-0.7/build-3.1/lib/docutils/readers/__init__.py", line 68, in read
    self.input = self.source.read()
  File "/var/tmp/paludis/dev-python-docutils-0.7/work/docutils-0.7/build-3.1/lib/docutils/io.py", line 258, in read
    data = self.source.read()
  File "/usr/lib64/python3.1/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 1546: ordinal not in range(128)

!!! ERROR in dev-python/docutils-0.7
Comment 6 fkhp 2010-07-20 03:28:26 UTC
there are utf-8 chars in the configuration, so ascii.py might not be able to
deal with it.  sourcode need to be modified to use utf_8.py to for general locale settings.


gentoo ~ # ls /usr/lib64/python3.1/encodings/utf*8*
/usr/lib64/python3.1/encodings/utf_8.py  
/usr/lib64/python3.1/encodings/utf_8_sig.py
/usr/lib64/python3.1/encodings/utf_8.pyc 
/usr/lib64/python3.1/encodings/utf_8_sig.pyc
/usr/lib64/python3.1/encodings/utf_8.pyo 
/usr/lib64/python3.1/encodings/utf_8_sig.pyo
gentoo ~ # ls /usr/lib64/python2.6/encodings/utf*8*
/usr/lib64/python2.6/encodings/utf_8.py  
/usr/lib64/python2.6/encodings/utf_8_sig.py
/usr/lib64/python2.6/encodings/utf_8.pyc 
/usr/lib64/python2.6/encodings/utf_8_sig.pyc
/usr/lib64/python2.6/encodings/utf_8.pyo 
/usr/lib64/python2.6/encodings/utf_8_sig.pyo
gentoo ~ # 
Comment 7 me 2010-07-20 07:26:50 UTC
Created attachment 239501 [details]
Output of "cave info '=dev-python/docutils-0.7'"

I've attached the output of "cave info '=dev-python/docutils-0.7'", which shows, that the build uses "LC_ALL=C".
Comment 8 Arfrever Frehtes Taifersar Arahesis (RETIRED) gentoo-dev 2010-07-20 13:52:03 UTC
I'm only interested in output from pkg_setup(). Please attach whole build log.
Comment 9 brent 2010-07-26 07:02:12 UTC
confirming under portage. emerge --info below.


zsh 7954 [1] # emerge --info
Portage 2.1.8.3 (default/linux/amd64/10.0/desktop, gcc-4.4.3, glibc-2.11.2-r0, 2.6.34-gentoo x86_64)
=================================================================
System uname: Linux-2.6.34-gentoo-x86_64-AMD_Athlon-tm-_64_FX-62_Dual_Core_Processor-with-gentoo-2.0.1
Timestamp of tree: Sun, 25 Jul 2010 23:15:01 +0000
distcc 3.1 x86_64-pc-linux-gnu [disabled]
ccache version 2.4 [enabled]
app-shells/bash:     4.1_p7
dev-java/java-config: 2.1.11
dev-lang/python:     2.5.4-r4, 2.6.5-r3, 3.1.2-r4
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.8.1-r2
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.6.1-r1
sys-apps/sandbox:    2.2
sys-devel/autoconf:  2.13, 2.65-r1
sys-devel/automake:  1.5-r1, 1.7.9-r2, 1.8.5-r4, 1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/gcc:       4.3.2-r3, 4.3.3-r2, 4.3.4, 4.4.1, 4.4.2, 4.4.3-r2
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.10
virtual/os-headers:  2.6.34
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=athlon-fx -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=athlon-fx -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests candy ccache distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://gentoo.chem.wisc.edu/gentoo"
LDFLAGS="-Wl,-O1"
MAKEOPTS="-j1"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage /usr/local/portage.bugfixes /usr/local/portage/layman/armagetron /usr/local/portage/layman/sunrise"
SYNC="rsync://rsync21.us.gentoo.org/gentoo-portage"
USE="X a52 aac acl acpi alsa amd64 async automount avahi bash-completion berkdb branding bzip2 cairo caps cdinstall cdr cli consolekit cracklib crypt cups curl cxx dbus directfb disk-partition dri dts dvd dvdr emboss encode exif extras fam fcgi fdt ffmpeg firefox flac fortran fuse gdbm gif gimp glitz gnome gnome-keyring gnutls gphoto2 gpm gtk hal iconv idn ipv6 jpeg lcms ldap libnotify loop-aes lzo mad mikmod mmx mng modules motif mp3 mp4 mpeg mudflap multilib ncurses nls nptl nptlonly offensive ogg opengl openmp overlays pam pango pcap pcre pdf perl php pic png policykit ppds pppd python qt3support qt4 quotas raw readline reflection samba sasl scanner sdl session smbkrb5passwd spell spl sse sse2 ssl startup-notification svg swat sysfs syslog tcpd theora tiff tools truetype tslib unicode usb utils v4l v4l2 vde videos vim-pager vim-syntax vim-with-x vorbis webkit winbind x264 xinetd xml xorg xulrunner xv xvid zeroconf zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias asis auth_digest cern_meta dumpio ident imagemap log_forensic proxy proxy_ajp proxy_balancer proxy_connect proxy_ftp proxy_http substitute" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="fbdev glint intel mach64 mga neomagic nv r128 radeon savage sis tdfx trident vesa via vmware voodoo" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 10 Arfrever Frehtes Taifersar Arahesis (RETIRED) gentoo-dev 2010-07-29 22:59:32 UTC

*** This bug has been marked as a duplicate of bug 322545 ***