Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 746215 - www-client/firefox-81.0.1 and mail-client/thunderbird-78.3.1 don't emerge in non-Unicode environment
Summary: www-client/firefox-81.0.1 and mail-client/thunderbird-78.3.1 don't emerge in ...
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Mozilla Gentoo Team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2020-10-03 11:03 UTC by Klaus Kusche
Modified: 2020-10-03 12:09 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments
Compressed firefox build log (www-client:firefox-81.0.1:20201003-101607.log.xz,57.74 KB, application/x-xz)
2020-10-03 11:03 UTC, Klaus Kusche
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Klaus Kusche 2020-10-03 11:03:39 UTC
Created attachment 663583 [details]
Compressed firefox build log

Emerging firefox and/or thunderbird fails on my system with 

8Exception in thread ProcessReader:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/var/portage/portage/www-client/firefox-81.0.1/work/firefox-81.0.1/testing/mozbase/mozprocess/mozprocess/processhandler.py", line 1116, in _read
    callback(line.rstrip())
  File "/var/portage/portage/www-client/firefox-81.0.1/work/firefox-81.0.1/testing/mozbase/mozprocess/mozprocess/processhandler.py", line 1026, in __call__
    e(*args, **kwargs)
  File "/var/portage/portage/www-client/firefox-81.0.1/work/firefox-81.0.1/python/mach/mach/mixin/process.py", line 96, in handleLine
    line_handler(line)
  File "/var/portage/portage/www-client/firefox-81.0.1/work/firefox-81.0.1/python/mozbuild/mozbuild/controller/building.py", line 710, in on_line
    self.log(logging.INFO, 'build_output', {'line': message}, '{line}')
  File "/var/portage/portage/www-client/firefox-81.0.1/work/firefox-81.0.1/python/mach/mach/mixin/logging.py", line 54, in log
    extra={'action': action, 'params': params})
  File "/usr/lib/python3.7/logging/__init__.py", line 1444, in log
    self._log(level, msg, args, **kwargs)
  File "/usr/lib/python3.7/logging/__init__.py", line 1514, in _log
    self.handle(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 1524, in handle
    self.callHandlers(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 1586, in callHandlers
    hdlr.handle(record)
  File "/usr/lib/python3.7/logging/__init__.py", line 894, in handle
    self.emit(record)
  File "/var/portage/portage/www-client/firefox-81.0.1/work/firefox-81.0.1/python/mozbuild/mozbuild/controller/building.py", line 594, in emit
    self.fh.write(msg)
  File "/usr/lib/python3.7/encodings/iso8859_15.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\u2013' in position 298: character maps to <undefined>

Full firefox build log attached, thunderbird error is identical.

The reason is most likely that this is a non-unicode system:
LC_ALL="en_DE.iso885915"
LANG="en_DE.iso885915"
CHARSET="ISO-8859-15"

Emerging worked fine one week ago for firefox-80.0.1-r1 with the same language settings.

emerge --info
Portage 3.0.8 (python 3.7.9-final-0, default/linux/amd64/17.1/no-multilib, gcc-10.2.0, glibc-2.32-r2, 5.8.11-gentoo x86_64)
=================================================================
System uname: Linux-5.8.11-gentoo-x86_64-Intel-R-_Core-TM-_i9-9980HK_CPU_@_2.40GHz-with-gentoo-2.7
KiB Mem:    49167868 total,  27296196 free
KiB Swap:   67108860 total,  67108860 free
Timestamp of repository gentoo: Sat, 03 Oct 2020 06:15:01 +0000
Head commit of repository gentoo: 411c82e31cfb8f2f11079df4e4319566c5125a02
Head commit of repository ace: 65d857ffbaecd95263ce525a1d7f07be362a6a16

sh bash 5.0_p18
ld GNU gold (Gentoo 2.35.1 p1 2.35.1) 1.16
app-shells/bash:          5.0_p18::gentoo
dev-java/java-config:     2.3.1::gentoo
dev-lang/perl:            5.30.3-r1::gentoo
dev-lang/python:          2.7.18-r4::gentoo, 3.7.9::gentoo
dev-util/cmake:           3.18.3::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/sandbox:         2.20::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r5::gentoo
sys-devel/automake:       1.13.4-r2::gentoo, 1.16.2::gentoo
sys-devel/binutils:       2.35.1::gentoo
sys-devel/gcc:            10.2.0-r2::gentoo
sys-devel/gcc-config:     2.3.2::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.3::gentoo
sys-kernel/linux-headers: 5.8::gentoo (virtual/os-headers)
sys-libs/glibc:           2.32-r2::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.de.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 24
    sync-rsync-extra-opts: --new-compress
    sync-rsync-verify-metamanifest: yes

archive
    location: /usr/local/portage
    masters: gentoo

ace
    location: /var/lib/layman/ace
    sync-type: git
    sync-uri: https://github.com/ace13/overlay.git
    masters: gentoo
    priority: 50

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="* -@EULA dlj-1.1 AdobeFlash-11.x Oracle-BCLA-JavaSE google-chrome googleearth Vivaldi FraunhoferFDK"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -mtune=native -msahf -flto -fuse-linker-plugin -O3 -fomit-frame-pointer -fsched-pressure -fgcse-after-reload -flive-range-shrinkage -fweb -ftracer -fivopts -ftree-loop-im -frename-registers -fstdarg-opt -maccumulate-outgoing-args -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=native -mtune=native -msahf -flto -fuse-linker-plugin -O3 -fomit-frame-pointer -fsched-pressure -fgcse-after-reload -flive-range-shrinkage -fweb -ftracer -fivopts -ftree-loop-im -frename-registers -fstdarg-opt -maccumulate-outgoing-args -pipe"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--quiet-build --quiet-fail --with-bdeps=y"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs collision-protect config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox keeptemp keepwork merge-sync multilib-strict network-sandbox news noclean parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://mirror.netcologne.de/gentoo/ http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ http://ftp.fau.de/gentoo http://distfiles.gentoo.org"
LANG="en_DE.iso885915"
LC_ALL="en_DE.iso885915"
LDFLAGS="-march=native -mtune=native -msahf -flto -fuse-linker-plugin -O3 -fomit-frame-pointer -fsched-pressure -fgcse-after-reload -flive-range-shrinkage -fweb -ftracer -fivopts -ftree-loop-im -frename-registers -fstdarg-opt -maccumulate-outgoing-args -pipe"
LINGUAS="en"
MAKEOPTS="-j16"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--new-compress"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/portage"
USE="10bit 12bit 64bit 8bit X \ a52 aac adobe-cff alsa alt-svc amd64 apng applet archive arping asm ass avx brotli bzip2 cacert cairo cdda cdparanoia clang cli clipboard clockdiff contrast cpu-flags-x86-rdrand cube cups curl custom-cflags custom-optimization cxx dav1d dbus dconf debug-frame default-gold dell demosaic detex devfs-compat dga divx dns dns-over-tls dot dri dri3 drm dts dvd dvdnav dvdr dvi dvipdfm eapol-test egl eme-free encode epspdf evdev exif expat extra faad fdk ffmpeg fftw flac fontconfig fonts foomaticdb fts3 g3dvl gallium gbm gdk-pixbuf gegl gif gimp glamor gles gles1 gles2 glib glibc-omitfp gmp gold graphics graphviz gs gstreamer gtk gtk3 gudev hardlink harfbuzz highbitdepth hostonly hpack-tools hpn htmlreport http http2 hugepages hwaccel hwdb iconv icu ilbc imagemagick inotify javascript jbig jemalloc jemalloc3 jit jpeg jpeg2k jumbo-build keybinder keyrecord kms kpathsea kvazaar lasi latex latex3 lazy-lock lcdfilter lcms leaps-timezone lensfun libaom libdrm libevent libglvnd libgtop libilbc libkms libmpv libnotify libopts libsamplerate libtirpc libwww lightning llvm llvm-gcc llvm-shared-libs lto lz4 lzma lzo mad matroska metalink metric midi minizip mmap mms mmx mmxext mng modern-top mp3 mpeg mpfr mta mudflap multicall native-extensions natspec ncat ncurses ndiff nghttp2 nping nptl nvme offensive ogg oldnet opengl openh264 openmax openmp openssl openvg optimize opus orc osmesa pam pango pcap pcre pcre16 pdf pdfimport pkcs7 plugins png policykit postproc postscript ppds printsupport proprietary-codecs pstricks pth pulseaudio qmanifest quicktime r600-llvm-compiler rar raw readline realmedia right_timezone rpc rsync-verify rtc rule_generator sanitize scanner schroedinger scope seccomp secure-delete session sha3 smp snappy sndfile sound speex split-usr sqlite sqlite3 srtp sse sse2 sse3 sse4 sse4_1 sse4_2 ssh ssl ssse3 svg symlink sync-plugin-portage system-av1 system-bootstrap system-bzip2 system-cairo system-cmark system-digest system-ffmpeg system-harfbuzz system-hunspell system-icu system-jpeg system-jsoncpp system-libevent system-libvpx system-libwebp system-libyaml system-llvm system-lua system-sqlite system-ssl system-webp system-zlib systemd sysv-utils t1lib texi2html theora threads thunar thunderbolt tiff tls-heartbeat tools tracepath tremor truetype udev uefi unicode unlock-notify unwind usb utils v4l v4l2 vaapi vdpau video vim-with-x vorbis vpx vulkan webkit2 webp wext wifi wmf wmp wxwidgets x264 x265 xcb xetex xkb xmp xorg xpm xpresent xrandr xulrunner xv xvid xxhash zenmap zip zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3" CURL_SSL="openssl" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev libinput" KERNEL="linux" L10N="en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer pdfimport" LLVM_TARGETS="AMDGPU BPF X86" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python3_7" RUBY_TARGETS="ruby27" SANE_BACKENDS="epson" USERLAND="GNU" VIDEO_CARDS="radeonsi amdgpu" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
Comment 1 Thomas Deutschmann (RETIRED) gentoo-dev 2020-10-03 11:56:14 UTC
I wonder how you created

> LC_ALL="en_DE.iso885915"
>         ^^^^^

like there is no en_DE in /usr/share/i18n/locales...

Incoming fix...
Comment 2 Larry the Git Cow gentoo-dev 2020-10-03 11:59:29 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=930aa75da9fd6c23c6859a6257cdfe786d0318c1

commit 930aa75da9fd6c23c6859a6257cdfe786d0318c1
Author:     Thomas Deutschmann <whissi@gentoo.org>
AuthorDate: 2020-10-03 11:59:10 +0000
Commit:     Thomas Deutschmann <whissi@gentoo.org>
CommitDate: 2020-10-03 11:59:23 +0000

    www-client/firefox: force LC_ALL=C
    
    Closes: https://bugs.gentoo.org/746215
    Package-Manager: Portage-3.0.8, Repoman-3.0.1
    Signed-off-by: Thomas Deutschmann <whissi@gentoo.org>

 www-client/firefox/firefox-78.3.1.ebuild | 3 +++
 www-client/firefox/firefox-81.0.1.ebuild | 3 +++
 2 files changed, 6 insertions(+)

Additionally, it has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=af2da6a57ac33f3473ae6bd324b940178ec25451

commit af2da6a57ac33f3473ae6bd324b940178ec25451
Author:     Thomas Deutschmann <whissi@gentoo.org>
AuthorDate: 2020-10-03 11:58:12 +0000
Commit:     Thomas Deutschmann <whissi@gentoo.org>
CommitDate: 2020-10-03 11:59:22 +0000

    mail-client/thunderbird: force LC_ALL=C
    
    Bug: https://bugs.gentoo.org/746215
    Package-Manager: Portage-3.0.8, Repoman-3.0.1
    Signed-off-by: Thomas Deutschmann <whissi@gentoo.org>

 mail-client/thunderbird/thunderbird-78.3.1.ebuild | 3 +++
 1 file changed, 3 insertions(+)
Comment 3 Klaus Kusche 2020-10-03 12:09:17 UTC
(In reply to Thomas Deutschmann from comment #1)
> I wonder how you created
> 
> > LC_ALL="en_DE.iso885915"
> >         ^^^^^
> 
> like there is no en_DE in /usr/share/i18n/locales...

Yes, that's a locally created language profile.
It combines e.g. english month and day names with german date and time formatting and euro instead of dollar currency.