Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 215508 - games-board/kwappen-1.1.5: fails to build with parser error (same as Bug 206370)
Summary: games-board/kwappen-1.1.5: fails to build with parser error (same as Bug 206370)
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Games (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Gentoo Games
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-03-31 01:08 UTC by Jabari R. Roberts
Modified: 2008-08-13 05:54 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments
Build log (build.log,15.32 KB, text/plain)
2008-03-31 01:10 UTC, Jabari R. Roberts
Details
EBuild environment file (environment,166.83 KB, text/plain)
2008-03-31 01:11 UTC, Jabari R. Roberts
Details
Modified ebuild, with sed accounting for octal notation in the regexp script (kwappen-1.1.5.ebuild,718 bytes, text/plain)
2008-04-01 23:33 UTC, Jabari R. Roberts
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jabari R. Roberts 2008-03-31 01:08:27 UTC
Tried to emerge games-board/kwappen (for the first time), and ended up with the exact same error as in Bug 206370 (my apologies if I'm reporting this wrong, but I couldn't find an option to re-open that bug report).

Here's the error output:
**************************

Making all in doc
make[2]: Entering directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc'
Making all in .
make[3]: Entering directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc'
make[3]: Nothing to be done for `all-am'.
make[3]: Leaving directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc'
Making all in de
make[3]: Entering directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/de'
/usr/kde/3.5/bin/meinproc --check --cache index.cache.bz2 ./index.docbook
make[3]: Leaving directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/de'
Making all in en
make[3]: Entering directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/en'
/usr/kde/3.5/bin/meinproc --check --cache index.cache.bz2 ./index.docbook
make[3]: Leaving directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/en'
Making all in pt
make[3]: Entering directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt'
/usr/kde/3.5/bin/meinproc --check --cache index.cache.bz2 ./index.docbook
index.docbook:122: parser error : Input is not proper UTF-8, indicate encoding !
Bytes: 0x8D 0x9B 0x65 0x73
<title>Op��es</title>
         ^
make[3]: *** [index.cache.bz2] Error 1
make[3]: Leaving directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5'
make: *** [all] Error 2
 *
 * ERROR: games-board/kwappen-1.1.5 failed.
 * Call stack:
 *               ebuild.sh, line   49:  Called src_compile
 *             environment, line 4110:  Called kde_src_compile
 *             environment, line 2843:  Called kde_src_compile 'src_compile'
 *             environment, line 2964:  Called kde_src_compile 'src_compile' 'all' 'myconf'
 *             environment, line 2960:  Called die
 * The specific snippet of code:
 *                   emake || die "died running emake, $FUNCNAME:make"
 *  The die message:
 *   died running emake, kde_src_compile:make
 *
 * If you need support, post the topmost build error, and the call stack if relevant.
 * A complete build log is located at '/var/tmp/portage/games-board/kwappen-1.1.5/temp/build.log'.
 * The ebuild environment file is located at '/var/tmp/portage/games-board/kwappen-1.1.5/temp/environment'.
 *

**************************

Thanks for the assistance!

Reproducible: Always

Steps to Reproduce:
1. emerge games-board/kwappen

Actual Results:  
Fails with the error
"index.docbook:122: parser error : Input is not proper UTF-8, indicate encoding !"

Expected Results:  
Successful compile and install of kwappen.

Output from 'emerge --info':
*****************************

Portage 2.1.4.4 (default-linux/x86/2007.0/desktop, gcc-4.1.2, glibc-2.6.1-r0, 2.6.24-gentoo-r3 i686)
=================================================================
System uname: 2.6.24-gentoo-r3 i686 AMD Athlon(tm) XP 3000+
Timestamp of tree: Sun, 30 Mar 2008 14:45:03 +0000
distcc 2.18.3 i686-pc-linux-gnu (protocols 1 and 2) (default port 3632) [disabled]
ccache version 2.4 [enabled]
app-shells/bash:     3.2_p17-r1
dev-java/java-config: 1.3.7, 2.1.4
dev-lang/python:     2.4.4-r9
dev-python/pycrypto: 2.0.1-r6
dev-util/ccache:     2.4-r7
sys-apps/baselayout: 1.12.11.1
sys-apps/sandbox:    1.2.18.1-r2
sys-devel/autoconf:  2.13, 2.61-r1
sys-devel/automake:  1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10
sys-devel/binutils:  2.18-r1
sys-devel/gcc-config: 1.4.0-r4
sys-devel/libtool:   1.5.26
virtual/os-headers:  2.6.23-r3
ACCEPT_KEYWORDS="x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=athlon-xp -O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config"
CONFIG_PROTECT_MASK="/etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/revdep-rebuild /etc/terminfo /etc/texmf/web2c /etc/udev/rules.d"
CXXFLAGS="-march=athlon-xp -O2 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
FEATURES="ccache distlocks metadata-transfer parallel-fetch sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="http://mirror.datapipe.net/gentoo http://distfiles.gentoo.org http://www.ibiblio.org/pub/Linux/distributions/gentoo"
LANG="en_US.UTF-8"
LC_ALL="en_US.UTF-8"
LINGUAS="en en_US ja"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/portage/local/layman/sunrise /usr/local/portage"
SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext 7zip X Xaw3d a52 aac aalib accessibility acl acpi activefilter ada addbookmarks additions adplug aio akode alisp allegro alsa amr amrnb amrwb anthy ao arts artswrappersuid artworkextra asterisk asyncns audiofile autoipd autoreplace avahi bash-completion bcp bdf beagle berkdb bidi bjam bl branding bzip2 cairo caps cdda cddb cdio cdparanoia cdr charconv chardet chm chroot cjk clearcase cli connectionstatus contactnotes cracklib crypt cscope css cups curl cvs d daap dar64 dbus dc1394 device-mapper devil dga dhcp disk-partition diskio divx djbfft djvu doc dts dv dvd dvdr dvdread dvi eap-tls eds elf emboss emovix enca encode escreen esd etwin evo examples exif expat extra-cardsets fam fame fat ffmpeg fftw firefox flac fontconfig foomaticdb fortran fpx freetts ftp galago gd gdbm gecko gif gimp glib glitz gmedia gmp gnokii gnome gnutls gphoto2 gpm grammar graphviz gs gsl gstreamer gtk gtkhtml guile hal hdri hfs highlight history howl-compat hpn ical iconv icu id3tag idn ieee1394 imagemagick imlib immqt-bc insecure-savers ipv6 irc isdnlog jack jai java javascript jbig jce jingle jmf joystick jpeg jpeg2k jsapi justify kde kdehiddenvisibility kerberos keyring kig-scripting kipi kpathsea ladspa lame lapack latex lcms ldap libcaca libgda libnotify libsamplerate live lm_sensors logitech-mouse loop-aes lua lzo m17n-lib mad math matroska mbrola md5sum mdnsresponder-compat meanwhile mfd-rewrites midi mikmod mime mjpeg mmap mmx mmxext mng modplug mono motif mp2 mp3 mpeg mplayer mtp mudflap musepack musicbrainz nas ncurses nemesi nethack netjack netmeeting network network-cron networking networkmanager nfs nls nntp nowlistening npp nptl nptlonly nsplugin ntfs objc objc++ objc-gc ocaml offensive ogg ole openal openexr opengl openmp oss ots overlays pam pango parse-clocks pascal pccts pch pcre pda pdf perforce perl physfs pike png pnm portaudio povray ppds pppd prediction prime pth pulseaudio pyste python qt3 qt3support qt4 quicktime rar rdesktop readline real realmedia reflection regex reiser4 reiserfs remote replytolist rle rpm rrdcgi rtc rtsp ruby samba sametime sasl scanner sdl sdl-image sdlaudio sensord serial session shout sid silc skins slang slp sms sndfile snmp solver soundex source speex spell spl sql sqlite sqlite3 srt sse ssl statistics stream subtitles subversion svg swat symlink sysfs syslog t1lib talkfilters tcl tcpd teletext tetex texteffect tga theora thesaurus threads tiff timidity tivo tk toolbar tools translator truetype tta unicode usb utempter utils v4l v4l2 vcd vidix vim-pager vim-syntax vim-with-x vlm vorbis vorbis-psy wavpack webpresence win32codecs winpopup wma wmf wmp wordperfect wxwindows x264 x86 xanim xattr xcomposite xerces-c xext xft xine xinerama xml xorg xosd xpm xscreensaver xv xvid xvmc yahoo yp yv12 zeroconf zlib zoran zvbi" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="evdev keyboard joystick mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en en_US ja" USERLAND="GNU" VIDEO_CARDS="nvidia"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LDFLAGS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Jabari R. Roberts 2008-03-31 01:10:13 UTC
Created attachment 147760 [details]
Build log
Comment 2 Jabari R. Roberts 2008-03-31 01:11:52 UTC
Created attachment 147761 [details]
EBuild environment file
Comment 3 Mr. Bones. (RETIRED) gentoo-dev 2008-03-31 21:09:10 UTC
head -n 122 index.docbook | tail -n 1
<title>Opï¿es</title>

Should look like that in the /var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt directory.  Does it?
Comment 4 Jabari R. Roberts 2008-04-01 01:20:41 UTC
(In reply to comment #3)
> head -n 122 index.docbook | tail -n 1
> <title>Opï¿es</title>
> 
> Should look like that in the
> /var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt directory.
>  Does it?
> 

Unfortunately, no; it gives the same Unicode "Unknown character" symbol in any application I tried.

Output from Konsole:

****************
Chaos-X3 ~ # cd /var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt
Chaos-X3 pt # head -n 122 index.docbook | tail -n 1
<title>Op��es</title>
Chaos-X3 pt #
****************


Output from XTerm
(yes, it's the same as Konsole, but just checking to make sure it wasn't my term charset I setup in KDE):

****************
Chaos-X3 ~ # cd /var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt
Chaos-X3 pt # head -n 122 index.docbook | tail -n 1
<title>Op��es</title>
Chaos-X3 pt # 
****************


Output from the area around line 122 from vim:

****************
</sect1>
</chapter>

<chapter id="options">
<title>Op<8d><9b>es</title>

<sect1 id="autoshrink">
<title>Tempo da autoredução</title>
<para>
****************


Output from the area around line 122 from KWrite
(note that KWrite can translate the Portuguese characters correctly):

****************
</sect1>
</chapter>

<chapter id="options">
<title>Op��es</title>

<sect1 id="autoshrink">
<title>Tempo da autoredução</title>
<para>
****************

So it seems to be a problem in the source tarball (i.e. a problem from upstream)?
Comment 5 Mr. Bones. (RETIRED) gentoo-dev 2008-04-01 01:37:56 UTC
What's the output from:

head -n 3 kwappen-1.1.5.ebuild
Comment 6 Jabari R. Roberts 2008-04-01 03:42:11 UTC
(In reply to comment #5)
> What's the output from:
> 
> head -n 3 kwappen-1.1.5.ebuild
> 

Chaos-X3 ~ # cd /usr/portage/games-board/kwappen/
Chaos-X3 kwappen # head -n 3 kwappen-1.1.5.ebuild
# Copyright 1999-2008 Gentoo Foundation
# Distributed under the terms of the GNU General Public License v2
# $Header: /var/cvsroot/gentoo-x86/games-board/kwappen/kwappen-1.1.5.ebuild,v 1.3 2008/01/28 01:55:34 mr_bones_ Exp $
Chaos-X3 kwappen #
Comment 7 Mr. Bones. (RETIRED) gentoo-dev 2008-04-01 05:29:51 UTC
After you unpack it, what's the output from:

grep "title>Op" index.docbook | od -cN14

in the pt directory?
Comment 8 Jabari R. Roberts 2008-04-01 07:04:12 UTC
(In reply to comment #7)
> After you unpack it, what's the output from:
> 
> grep "title>Op" index.docbook | od -cN14
> 
> in the pt directory?


knuckles@Chaos-X3 ~ $ tar -xzf /usr/portage/distfiles/kwappen-1.1.5.tar.gz -C tmp/
knuckles@Chaos-X3 ~ $ cd tmp/kwappen-1.1.5/doc/pt
knuckles@Chaos-X3 ~/tmp/kwappen-1.1.5/doc/pt $ grep "title>Op" index.docbook | od -cN14
0000000   <   t   i   t   l   e   >   O   p 215 233   e   s   <
0000016
knuckles@Chaos-X3 ~/tmp/kwappen-1.1.5/doc/pt $
Comment 9 Jabari R. Roberts 2008-04-01 07:11:49 UTC
Just in case you were about to ask ;-)...

knuckles@Chaos-X3 ~ $ sha1sum /usr/portage/distfiles/kwappen-1.1.5.tar.gz
a07208d0a9a011ec5cf64a93b2d07f7e2775d220  /usr/portage/distfiles/kwappen-1.1.5.tar.gz
knuckles@Chaos-X3 ~ $ grep a07208d0a9a011ec5cf64a93b2d07f7e2775d220 /usr/portage/games-board/kwappen/Manifest
DIST kwappen-1.1.5.tar.gz 1138413 RMD160 6ce9e0a9cf6a1999a7f91e2355c89b039ff9d114 SHA1 a07208d0a9a011ec5cf64a93b2d07f7e2775d220 SHA256 42e2d8677704f1c0b7b489afc50e5ffdb5c747cfa24aa28bfcaecc65ae6c9679
knuckles@Chaos-X3 ~ $
Comment 10 Mr. Bones. (RETIRED) gentoo-dev 2008-04-01 15:28:41 UTC
No, do the od after the unpack from the ebuild.  I already know the tarball is wrong.  That's why the sed is in src_unpack.
Comment 11 Jabari R. Roberts 2008-04-01 23:31:55 UTC
(In reply to comment #10)
> No, do the od after the unpack from the ebuild.  I already know the tarball is
> wrong.  That's why the sed is in src_unpack.
> 

Sorry about that.  Here's the output:

Chaos-X3 ~ # rm -R /var/tmp/portage/games-board/kwappen-1.1.5/
Chaos-X3 ~ # ebuild /usr/portage/games-board/kwappen/kwappen-1.1.5.ebuild unpack
 * kwappen-1.1.5.tar.gz RMD160 SHA1 SHA256 size ;-) ...                                                                                                         [ ok ]
 * checking ebuild checksums ;-) ...                                                                                                                            [ ok ]
 * checking auxfile checksums ;-) ...                                                                                                                           [ ok ]
 * checking miscfile checksums ;-) ...                                                                                                                          [ ok ]
 * checking kwappen-1.1.5.tar.gz ;-) ...                                                                                                                        [ ok ]
>>> Unpacking source...
>>> Unpacking kwappen-1.1.5.tar.gz to /var/tmp/portage/games-board/kwappen-1.1.5/work
>>> Source unpacked.
Chaos-X3 ~ # cd /var/tmp/portage/games-board/kwappen-1.1.5/work/kwappen-1.1.5/doc/pt
Chaos-X3 pt # grep "title>Op" index.docbook | od -cN14
0000000   <   t   i   t   l   e   >   O   p 215 233   e   s   <
0000016
Chaos-X3 pt #


In other words, same output as from the source tarball and from what I got after the emerge error.

So after doing some reading on the sed docs, I tried this command, factoring in the octal notation, as a test:

sed -i -e "122 s/Op\o215\o233/OpHI/" index.docbook

and it worked!:

</sect1>
</chapter>

<chapter id="options">
<title>OpHIes</title>

<sect1 id="autoshrink">
<title>Tempo da autoredução</title>
<para>


I put the new code in the ebuild, and it now emerges OK.
It's a simple one-line change:

        sed -i \
-               -e "122 s/Op../Opï¿/" \
+               -e "122 s/Op\o215\o233/Opï¿/" \
                doc/pt/index.docbook \

An ebuild with this change will be attached; see if it works for you.

Thanks for pointing me in the right direction with this!
Comment 12 Jabari R. Roberts 2008-04-01 23:33:45 UTC
Created attachment 148026 [details]
Modified ebuild, with sed accounting for octal notation in the regexp script
Comment 13 Mr. Bones. (RETIRED) gentoo-dev 2008-04-02 17:50:16 UTC
What sed do you have that doesn't work with the current ebuild?
Comment 14 Jabari R. Roberts 2008-04-02 22:27:35 UTC
(In reply to comment #13)
> What sed do you have that doesn't work with the current ebuild?
> 

The usual one, marked as stable:

Chaos-X3 ~ # eix ^sed$
[I] sys-apps/sed
     Available versions:  4.1.5 4.1.5-r1 {nls static}
     Installed versions:  4.1.5-r1(11:27:01 AM 03/30/2008)(nls -static)
     Homepage:            http://sed.sourceforge.net/
     Description:         Super-useful stream editor


Now that I look at the changelog, the -r1 version was marked stable for x86 on March 28th, only five days ago from this writing (see Bug 215072)...would this change (from the changelog)

" 30 Jan 2008; Mike Frysinger <vapier@gentoo.org>
  +files/sed-4.1.5-prototypes.patch, +sed-4.1.5-r1.ebuild:
  Default to using regex from the libc so as to get a smaller sed binary. "

affect anything?
Comment 15 Mr. Bones. (RETIRED) gentoo-dev 2008-04-03 17:32:22 UTC
Same sed I'm using and it works fine for me.  Please figure out why the sed in the ebuild doesn't work for you.
Comment 16 Jabari R. Roberts 2008-04-04 21:41:07 UTC
(In reply to comment #15)
> Same sed I'm using and it works fine for me.  Please figure out why the sed in
> the ebuild doesn't work for you.
> 

Hmm...what are your LANG and LC_ALL locale variables set to?
I did some more testing, and I'm pretty sure I've found the problem:

* when environment vars are set to 'LANG=C' and 'LC_ALL=C': sed commands in the original ebuild works

* when environment vars are set to 'LANG=en_US.UTF8' and 'LC_ALL=en_US.UTF8' (as I have set by default on my machine): sed commands in the orginial ebuild do NOT work
Comment 17 Mr. Bones. (RETIRED) gentoo-dev 2008-08-13 05:54:35 UTC
changed it to use epatch instead of sed.  reopen if it still doesn't work.