Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 290103 - groff fails to produce output with japanese patch in various ebuilds
Summary: groff fails to produce output with japanese patch in various ebuilds
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Library (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: CJK Team
URL:
Whiteboard:
Keywords:
: 290719 290844 (view as bug list)
Depends on:
Blocks:
 
Reported: 2009-10-22 07:10 UTC by Andrew Savchenko
Modified: 2010-01-23 05:37 UTC (History)
11 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
bulid.log (build.log,15.50 KB, text/plain)
2009-10-22 07:11 UTC, Andrew Savchenko
Details
environment (environment,126.56 KB, text/plain)
2009-10-22 07:11 UTC, Andrew Savchenko
Details
patch for the japanese patch (groff-1.20.1-japanese.patch.patch,1.59 KB, patch)
2009-10-30 05:48 UTC, Naohiro Aota
Details | Diff
patch for the ebuild to apply the above patch and the japanese patch (groff-1.20.1-r1.ebuild.patch,355 bytes, patch)
2009-10-30 05:53 UTC, Naohiro Aota
Details | Diff
adds doc USE flag, disabling which works around groff failing on libX11 specification docs (libX11-1.3.2-r1.ebuild.patch,819 bytes, patch)
2009-10-31 17:32 UTC, Vladimir Brik
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Andrew Savchenko gentoo-dev 2009-10-22 07:10:20 UTC
Hello,

with USE="doc" I got this:

make[2]: Entering directory `/var/tmp/portage/x11-libs/libXaw-1.0.7/work/libXaw-1.0.7/spec'
  GEN    widgets.ps
  GEN    widgets.txt
  GEN    widgets.html
/usr/share/groff/1.20.1/font/devps/M:5: error: I didn't seem to find any characters
/usr/share/groff/1.20.1/font/devps/G:5: error: I didn't seem to find any characters
make[2]: *** [widgets.ps] Error 1

Without "doc" USE flag it compiles OK.

$ emerge --info
Portage 2.2_rc46 (default/linux/x86/2008.0, gcc-4.4.2, glibc-2.10.1-r0, 2.6.30.5-yoruichi i686)
=================================================================
System uname: Linux-2.6.30.5-yoruichi-i686-AMD_Athlon-tm-_XP_3200+-with-gentoo-2.0.1
Timestamp of tree: Wed, 21 Oct 2009 17:20:01 +0000
distcc 3.1 i686-pc-linux-gnu [disabled]
ccache version 2.4 [enabled]
app-shells/bash:     4.0_p33
dev-java/java-config: 2.1.9-r1
dev-lang/python:     2.6.3, 3.1.1-r1
dev-python/pycrypto: 2.0.1-r8
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.6.4-r3
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.5.2-r1
sys-apps/sandbox:    2.1
sys-devel/autoconf:  2.13, 2.63-r1
sys-devel/automake:  1.4_p6, 1.6.3, 1.8.5-r3, 1.9.6-r2, 1.10.2, 1.11
sys-devel/binutils:  2.20
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6a
virtual/os-headers:  2.6.30-r1
ACCEPT_KEYWORDS="x86 ~x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=athlon-xp -m32 --param l1-cache-line-size=64 --param l1-cache-size=64 --param l2-cache-size=512 -O2 -funswitch-loops -fpredictive-commoning -fgcse-after-reload -fomit-frame-pointer -mfpmath=sse -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/X11/xkb /usr/share/config /var/bind /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /etc/udev/rules.d"
CXXFLAGS="-march=athlon-xp -m32 --param l1-cache-line-size=64 --param l1-cache-size=64 --param l2-cache-size=512 -O2 -funswitch-loops -fpredictive-commoning -fgcse-after-reload -fomit-frame-pointer -mfpmath=sse -pipe"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--with-bdeps y"
FEATURES="assume-digests ccache collision-protect distlocks fixpackages news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch userpriv usersandbox"
FFLAGS="-march=athlon-xp -m32 --param l1-cache-line-size=64 --param l1-cache-size=64 --param l2-cache-size=512 -O2 -funswitch-loops -fpredictive-commoning -fgcse-after-reload -fomit-frame-pointer -mfpmath=sse -pipe"
GENTOO_MIRRORS=" ftp://orionis/distributions/1Linux/gentoo/portage ftp://ftp.chg.ru/pub/Linux/gentoo http://mirror.yandex.ru/gentoo-distfiles  ftp://ftp.corbina.net/pub/Linux/gentoo http://distfiles.gentoo.org http://www.ibiblio.org/pub/Linux/distributions/gentoo http://mirror.netcologne.de/gentoo"
LANG="en_US.UTF-8"
LC_ALL=""
LDFLAGS="-Wl,-O1"
LINGUAS="ru en ja"
MAKEOPTS="-j4"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage/layman/science /usr/local/portage/layman/java-overlay /usr/local/portage/layman/sunrise /usr/local/portage"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="3dnow X a52 aac aalib acl acpi adns afs aften aim alsa amr amrnb amrwb ao audiofile bash-completion bcmath bidi binfilter blas bluetooth branding bzip2 cairo calendar canna caps ccache cddb cdinstall cdparanoia cdr chasen cjk cleartype cli clisp colordiff cracklib crypt cscope css ctype cups curl curlwrappers cvs cxx cyrillic dbus device-mapper dga dia dirac directfb djvu dmx doc dri dts dv dvd dvdr dvdread dvi editor elf encode enscript ermt examples exif expat faac faad fbcon festival ffmpeg fftw firefox flac fontconfig foomaticdb fortran fpx freetds freetype ftp gcj gcrypt gd gdbm geoip ggi gif gimp ginac git glibc-omitfp glitz glut gmp gnuplot gnutls gpgme gphoto2 gpm gps graphviz gs gsl gsm gtk gucharmap h224 h281 h323 hdf5 hdri iconv icq icu id3tag idn imagemagick imap imlib immqt-bc inkjar ipod iproute2 ipv6 isdnlog jabber jack jadetex java6 javascript jbig jingle jpeg jpeg2k kdehiddenvisibility kerberos keyscrub kpathsea kqemu ladspa lame lapack lash latex lcms libcaca libnotify libsamplerate libwww lm_sensors logrotate lzo mad maildir mailwrapper matroska md5sum mhash mikmod mime mjpeg mmap mmx mng modplug modules mp3 mpeg mplayer mppe-mppc msn mudflap musepack musicbrainz mysql mysqli nas ncurses netcdf network network-cron nls nntp nocd nodrm nptlonly nsplugin nuv objc objc++ offensive ogg openal openexr opengl oscar otr pam pango pcntl pcre pda pdf perl pgf plotutils png pop portaudio posix postproc postscript ppds pppd pronounce pstricks qt3 qt3support qt4 quicktime raw rdesktop readline recode reflection restrict-javascript rle rrdtool samba scanner schroedinger sdl session sharedmem shorten sip sipim slang slp smi smime sms smtp sndfile sockets socks5 soundtouch sox sparse speex spell spl sqlite sqlite3 srtp sse ssl startup-notification subversion supernodal svg svga sysfs syslog szip t1lib taglib tcpd theora tiff timezone timidity tordns truetype twolame type3 unicode usb utempter v4l v4l2 vamp vcd videos vim vim-syntax vnc vorbis wav wavpack wifi win32codecs wireshark wmf x264 x86 xattr xcb xface xft xinerama xorg xosd xpm xprint xrandr xscreensaver xulrunner xv xvid yahoo yaz ziffy zlib" ALSA_CARDS="intel8x0" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="authz_host dir mime" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="ru en ja" USERLAND="GNU" VIDEO_CARDS="nvidia nv vesa"
Unset:  CPPFLAGS, CTARGET, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Andrew Savchenko gentoo-dev 2009-10-22 07:11:03 UTC
Created attachment 207890 [details]
bulid.log
Comment 2 Andrew Savchenko gentoo-dev 2009-10-22 07:11:17 UTC
Created attachment 207891 [details]
environment
Comment 3 Dmitry Karasik 2009-10-27 07:29:15 UTC
This is caused by the japanese patch to groff. Building groff with -linguas_ja allows the emerge to succeed.
Comment 4 Tomáš Chvátal (RETIRED) gentoo-dev 2009-10-27 13:24:25 UTC
*** Bug 290719 has been marked as a duplicate of this bug. ***
Comment 5 Tomáš Chvátal (RETIRED) gentoo-dev 2009-10-27 13:39:48 UTC
linguas_jp useflag masked.

Please base guys review and remove the support if needed or fix and unmask.
Comment 6 SpanKY gentoo-dev 2009-10-27 13:42:02 UTC
we dont handle CJKV issues
Comment 7 Nick Bowler 2009-10-27 19:09:08 UTC
The useflag is called linguas_ja, not linguas_jp.
Comment 8 Naohiro Aota gentoo-dev 2009-10-30 05:48:09 UTC
Created attachment 208693 [details, diff]
patch for the japanese patch
Comment 9 Naohiro Aota gentoo-dev 2009-10-30 05:53:53 UTC
Created attachment 208695 [details, diff]
patch for the ebuild to apply the above patch and the japanese patch
Comment 10 Naohiro Aota gentoo-dev 2009-10-30 06:08:33 UTC
First, I found that the Japanese patch didn't affected the C++
code. Apply the Japanese patch, "./configure --enable-japanese" and
check "src/include/config.h". There wouldn't be "#define NIPPON" line
to enable Japanese patch features. This caused the error
"/usr/share/groff/1.20.1/font/devps/M:5: error: I didn't seem to find
any characters". We need to rebuild "src/include/config.hin" by
calling "eautoheader".

Then, the Japanese patch is so old that compile fails with some
errors. I needed the above patch to build.

I've confirmed that the above patch fixed all above errors. I was able
to see Japanese man pages with patch applied package.
Comment 11 Dmitry Karasik 2009-10-30 06:33:59 UTC
Is maintaining this patch really the best option? It seems to originate from debian and they have moved on to a newer multi-byte patch, and then dropped even that saying:

  * Dropped multibyte patch. CJK is partially supported by way of Unicode
    input, but widths are wrong and proper line breaking is not implemented;
    this is planned to be added by way of "character classes". However, I
    can't justify holding new groff code out of Debian any longer when CJK
    manual pages can more or less be read with the new release.
Comment 12 hiyuh 2009-10-30 06:58:57 UTC
(In reply to comment #11)

iirc, that patch comes from momonga.

i think that non-patched broken unicode support that produces wrong width and improper line breaking is simply useless for cjk peeps. i know incomplete cjk patch often annoy non-cjk peeps, and im feel so sorry about that. but please calm down, maintain l10n, and go for i18n.

kthx
Comment 13 Tomáš Chvátal (RETIRED) gentoo-dev 2009-10-30 18:56:12 UTC
*** Bug 290844 has been marked as a duplicate of this bug. ***
Comment 14 Dmitry Karasik 2009-10-30 20:54:07 UTC
I agree that we should strive for better CJK. I didn't mean to imply that we should drop the patch, more asking whether the multibyte patch that succeeded it in Debian is better than the original?
Comment 15 Vladimir Brik 2009-10-31 17:32:10 UTC
Created attachment 208876 [details, diff]
adds doc USE flag, disabling which works around groff failing on libX11 specification docs

Current x11-libs/libX11-1.3.2.ebuild fails due to a groff problem when building specs docs. With this patch specs docs are built only if the doc USE flag is enabled, allowing to bypass the groff issue until it is solved.
Comment 16 MATSUU Takuto (RETIRED) gentoo-dev 2009-11-07 06:10:31 UTC
(In reply to comment #14)
> I agree that we should strive for better CJK. I didn't mean to imply that we
> should drop the patch, more asking whether the multibyte patch that succeeded
> it in Debian is better than the original?
> 

Debian stable keeps old version (groff-1.18.1) for japanese issue. It contains japanese patch but it couldn't apply to latest groff. The attached patch is better way I think.
Debian testing uses groff-1.20.1-6 and it has no japanese patch so 'groff -Tnippon -mandocj' doesn't work.

btw, sys-apps/man-db can show japanese manpages but it had not supported Japanese hyphenation yet.

I commit groff-1.20.1-r2.ebuild now.
Comment 17 hiyuh 2010-01-23 05:31:50 UTC
FYI from my test of groff-1.20.1-r2 w/ linguas_ja,
 * it shows correct japanese man page.
 * failure libX11 w/ doc is gone.
Comment 18 MATSUU Takuto (RETIRED) gentoo-dev 2010-01-23 05:37:23 UTC
profiles/base/package.use.mask:
-sys-apps/groff linguas_ja
+<sys-apps/groff-1.20.1-r2 linguas_ja