Bug 268295 – app-office/openoffice-3.0.0 and -3.1.0_beta6 fail to build with either java or opengl useflag

• Status: RESOLVED FIXED
• Product: Gentoo Linux

[Description Thomas Sachau 2009-05-02 14:39:50 UTC]

With either the java or opengl useflag, a checkdll call segfaults. This happens on a hardened profile, but is reproduceable with:

-nonhardened kernel
-hardened gcc-4.3.3
-vanilla gcc-4.3.3
-hardened gcc-3.4.6
-vanilla gcc-3.4.6

Last lines of build.log:

Making: ../../unxlngx6.pro/slo/com_sun_star_beans_LocalOfficeWindow.obj
gcc -Wreturn-type -fmessage-length=0 -c -O2 -fno-strict-aliasing -Wuninitialized -DENABLE_LAYOUT_EXPERIMENTAL=0   -I.  -I../../unxlngx6.pro/inc/officebean -I../inc -I../../inc/pch -I../../inc -I../../unx/inc -I../../unxlngx6.pro/inc -I. -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/incdont_use_stl -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/inc/external -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/inc -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/unxlngx6/inc -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/inc -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/res -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/incdont_use_stl -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/inc/Xp31 -I/usr/lib/icedtea6/include -I/usr/lib/icedtea6/include/linux -I/usr/lib/icedtea6/include/native_threads/include -Idefault_x_includes  -I/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/inc/offuh -I. -I../../res -I. -pipe -march=nocona -pipe -ggdb -fno-stack-protector -DGL_GLEXT_PROTOTYPES  -Wall -Wextra -Wendif-labels -fpic -DLINUX -DUNX -DVCL -DGCC -DC341 -DX86_64 -DCVER=C341 -DNPTL -DGLIBC=2 -DX86_64 -D_PTHREADS -D_REENTRANT -DNEW_SOLAR -D_USE_NAMESPACE=1 -DSTLPORT_VERSION=400 -DHAVE_GCC_VISIBILITY_FEATURE -D__DMAKE -DUNIX -DCPPU_ENV=gcc3 -DGXX_INCLUDE_PATH=/usr/lib/gcc/x86_64-pc-linux-gnu/4.3.3/include/g++-v4 -DSUPD=310 -DPRODUCT -DNDEBUG -DPRODUCT_FULL -DOSL_DEBUG_LEVEL=0 -DOPTIMIZE -DENABLE_LAYOUT=1 -DCUI -DSOLAR_JAVA   -DSHAREDLIB -D_DLL_    -o ../../unxlngx6.pro/slo/com_sun_star_beans_LocalOfficeWindow.o com_sun_star_beans_LocalOfficeWindow.c
if test -e ../../unxlngx6.pro/slo/com_sun_star_beans_LocalOfficeWindow.o ; then touch ../../unxlngx6.pro/slo/com_sun_star_beans_LocalOfficeWindow.obj ; fi
------------------------------
Making: ../../unxlngx6.pro/slb/officebean.lib
echo unxlngx6.pro/slo/com_sun_star_comp_beans_LocalOfficeWindow.o unxlngx6.pro/slo/com_sun_star_beans_LocalOfficeWindow.o | xargs -n1 > ../../unxlngx6.pro/slb/officebean.lib
-----------------------------
SHL1FILTERFILE not set!
-----------------------------
dummy file to keep the dependencies for later use.
------------------------------
Making: ../../unxlngx6.pro/lib/libofficebean.so
g++ -Wl,-z,combreloc -Wl,-z,defs -Wl,--as-needed -Wl,-Bsymbolic-functions -Wl,--dynamic-list-cpp-new -Wl,--dynamic-list-cpp-typeinfo -Wl,-rpath,'$ORIGIN:$ORIGIN/../ure-link/lib' -shared -L../../unxlngx6.pro/lib -L../lib -L/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/unxlngx6/lib -L/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/lib -L/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/unxlngx6/lib -L/usr/lib/icedtea6/lib64 -L/usr/lib/icedtea6/jre/lib/amd64 -L/usr/lib/icedtea6/jre/lib/amd64/server -L/usr/lib/icedtea6/jre/lib/amd64/native_threads -L/usr/lib -L/usr/lib64/xulrunner-1.9/sdk/lib ../../unxlngx6.pro/slo/officebean_version.o -o ../../unxlngx6.pro/lib/libofficebean.so ../../unxlngx6.pro/slo/com_sun_star_comp_beans_LocalOfficeWindow.o ../../unxlngx6.pro/slo/com_sun_star_beans_LocalOfficeWindow.o -ljawt -lstdc++ -ldl -lpthread -lm
rm -f ../../unxlngx6.pro/lib/check_libofficebean.so
mv ../../unxlngx6.pro/lib/libofficebean.so ../../unxlngx6.pro/lib/check_libofficebean.so
/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/bin/checkdll.sh -L../../unxlngx6.pro/lib -L/home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solver/310/unxlngx6.pro/lib  ../../unxlngx6.pro/lib/check_libofficebean.so
Checking DLL ../../unxlngx6.pro/lib/check_libofficebean.so .../home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/solenv/bin/checkdll.sh: line 94: 25581 Segmentation fault      $checkdll "$*"
dmake:  Error code 1, while making '../../unxlngx6.pro/lib/libofficebean.so'

ERROR: Error 65280 occurred while making /home/thomas/daten/portage/app-office/openoffice-3.1.0_beta6/work/ooo/build/ooo310-m10/bean/native/unix
rmdir /tmp/8423
make: *** [stamp/build] Error 1

emerge --info:

Portage 2.2_rc31 (hardened/amd64/multilib, gcc-4.3.3, glibc-2.9_p20081201-r5, 2.6.28-hardened-r7 x86_64)
=================================================================
System uname: Linux-2.6.28-hardened-r7-x86_64-Intel-R-_Core-TM-2_Quad_CPU_Q6600_@_2.40GHz-with-gentoo-2.0.0
Timestamp of tree: Sat May 2 07:40:41 CEST 2009
app-shells/bash:     3.2_p39
dev-java/java-config: 2.1.7
dev-lang/python:     2.5.4-r2, 2.6.2
dev-util/cmake:      2.6.3-r1
sys-apps/baselayout: 2.0.0
sys-apps/openrc:     0.4.3-r2
sys-apps/sandbox:    1.9
sys-devel/autoconf:  2.13, 2.63-r1
sys-devel/automake:  1.4_p6, 1.9.6-r2, 1.10.2
sys-devel/binutils:  2.18-r4
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6a
virtual/os-headers:  2.6.28-r1
ACCEPT_KEYWORDS="amd64 ~amd64"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=nocona -O2 -pipe -ggdb"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-march=nocona -O2 -pipe -ggdb"
DISTDIR="/usr/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going"
FEATURES="autoconfig collision-protect distlocks fixpackages metadata-transfer parallel-fetch preserve-libs protect-owned sandbox sfperms sign splitdebug strict unmerge-orphans userfetch userpriv usersandbox"
GENTOO_MIRRORS="ftp://mirror.cambrium.nl/pub/os/linux/gentoo/ http://mirror.muntinternet.net/pub/gentoo/"
LANG="de_DE.UTF-8@euro"
LC_ALL="de_DE.UTF-8@euro"
LDFLAGS="-Wl,--as-needed"
LINGUAS="de"
MAKEOPTS="-j5 --load-average=8"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/home/thomas/daten"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage/layman/toolchain-overlay /usr/local/portage/layman/toolchain-overlay-testing /usr/local/portage/layman/multilib-overlay /usr/local/portage/layman/sunrise /usr/local/portage/layman/java-overlay /usr/local/portage/layman/enlightenment /usr/local/portage"
SYNC="cvs://[e-mail]:/var/cvsroot"
USE="3dnow X alsa amd64 berkdb cracklib crypt cups custom-cflags custom-cxxflags gpm hardened justify midi ncurses nls nptl nptlonly nsplugin ogg opengl openmp pam pic readline scanner sse sse2 ssl tcpd unicode urandom vorbis xorg zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="de" USERLAND="GNU" VIDEO_CARDS="nv nvidia"
Unset:  CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

[Comment 1 Dror Levin (RETIRED) 2009-05-15 23:24:28 UTC]

I tried building version 3.1.0 on amd64 and got the same segfault. I'm using --as-needed as well, so I'm thinking that's the problem. I'll try rebuilding without it and see how that goes.

[Comment 2 Thomas Sachau 2009-05-16 13:18:41 UTC]

(In reply to comment #1)
> I tried building version 3.1.0 on amd64 and got the same segfault. I'm using
> --as-needed as well, so I'm thinking that's the problem. I'll try rebuilding
> without it and see how that goes.
> 

3.1.0? Where did you get that? :-)

I tried without setting any LDFLAGS, but the result was the same for me.

[Comment 3 Dror Levin (RETIRED) 2009-05-16 14:45:54 UTC]

With empty LDFLAGS I don't get a segfault, but the build still fails because lightproof-1.0.oxt doesn't exist, whatever that means :/
It could be that I forgot to change something in the ebuild when I bumped to 3.1.0, but I did change MY_PV.

[Comment 4 Andreas Proschofsky (RETIRED) 2009-05-26 18:06:50 UTC]

Did you try this with a recent release of OOo 3.1.0?

[Comment 5 Thomas Sachau 2009-05-26 18:39:42 UTC]

(In reply to comment #4)
> Did you try this with a recent release of OOo 3.1.0?
> 

Yes, still parallel build issue (so currenlty forced to use -j1) and still the segfault with either opengl or java.
I did try to run that checkdll binary with the so as argument in gdb, but the backtrace is not complete, so i fear that this binary is not compiled, but part of the source tarball. Since my time is a bit limited, that is all i found out until now.
But if you have special testcases or other questions, i can surely run another ooo compile over night.

[Comment 6 Dror Levin (RETIRED) 2009-06-15 14:38:10 UTC]

Version 3.1.0 with both java and opengl enabled compiles and runs fine for me on ~amd64. Is this bug still relevant?

[Comment 7 Thomas Sachau 2009-06-21 01:15:20 UTC]

(In reply to comment #6)
> Version 3.1.0 with both java and opengl enabled compiles and runs fine for me
> on ~amd64. Is this bug still relevant?
> 

Still happens to me with 3.1.0.6

[Comment 8 Andreas Proschofsky (RETIRED) 2009-11-28 22:02:02 UTC]

Still getting this with 3.1.1? Guess this is hardened related, never got it with non-hardened system...

[Comment 9 Thomas Sachau 2010-04-18 19:24:48 UTC]

(In reply to comment #8)
> Still getting this with 3.1.1? Guess this is hardened related, never got it
> with non-hardened system...
> 

This issue is related to hardened, it seems like this checkdll binary does some in-memory actions, which are prevented by PaX.

[Comment 10 Tomáš Chvátal (RETIRED) 2011-07-26 21:19:07 UTC]

lo-3.4.2.2 seems to run on hardened. Please reopen this bug if you still have compilation failures. Thanks