Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 388753 - either "watch" or "ls" doesn#t handle german umlauts within utf8 system
Summary: either "watch" or "ls" doesn#t handle german umlauts within utf8 system
Status: RESOLVED DUPLICATE of bug 291613
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Gentoo's Team for Core System packages
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-10-28 09:28 UTC by Toralf Förster
Modified: 2011-10-31 20:46 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Toralf Förster gentoo-dev 2011-10-28 09:28:21 UTC
Well, I've this file:
tfoerste@n22 ~/Downloads $ ls -l M*
-rwxr-xr-x 1 tfoerste users 2537115836 Oct 21 00:05 Meeresfrüchte.m2t


If I however run the command "watch -n 60 ls -l M*", the outout is :

Every 60.0s: ls -l MeeresfrM CM-<chte.m2t     Fri Oct 28 11:22:27 2011

-rwxr-xr-x 1 tfoerste users 2537115836 Oct 21 00:05 Meeresfrchte.m2t



A simple "watch ls -l" gives the same output (the "ü" is missing), therefore both ls and watch are affected, isn't it ?


Reproducible: Always




tfoerste@n22 ~/Downloads $ locale -a
C
de_DE
de_DE@euro
de_DE.iso88591
de_DE.iso885915@euro
de_DE.utf8
de_DE.utf8@euro
deutsch
en_US
en_US.iso88591
en_US.iso885915
en_US.utf8
german
POSIX

tfoerste@n22 ~/Downloads $ env | grep LANG
LANG=en_US.utf8
LANGUAGE=

tfoerste@n22 ~/Downloads $ emerge --info sys-apps/coreutils
Portage 2.1.10.31 (default/linux/x86/10.0/desktop/kde, gcc-4.5.3, glibc-2.12.2-r0, 3.0.8 i686)
=================================================================
                        System Settings
=================================================================
System uname: Linux-3.0.8-i686-Intel-R-_Core-TM-2_Duo_CPU_P8600_@_2.40GHz-with-gentoo-2.0.3
Timestamp of tree: Fri, 28 Oct 2011 06:45:01 +0000
ccache version 2.4 [enabled]
app-shells/bash:          4.1_p9
dev-java/java-config:     2.1.11-r3
dev-lang/python:          2.7.2-r3, 3.1.4-r3
dev-util/ccache:          2.4-r9
dev-util/cmake:           2.8.4-r1
dev-util/pkgconfig:       0.26
sys-apps/baselayout:      2.0.3
sys-apps/openrc:          0.8.3-r1::toralf
sys-apps/sandbox:         2.4
sys-devel/autoconf:       2.13, 2.68
sys-devel/automake:       1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:       2.20.1-r1
sys-devel/gcc:            4.5.3-r1
sys-devel/gcc-config:     1.4.1-r1
sys-devel/libtool:        2.4-r1
sys-devel/make:           3.82-r1
sys-kernel/linux-headers: 2.6.39 (virtual/os-headers)
sys-libs/glibc:           2.12.2
Repositories: gentoo betagarden toralf
ACCEPT_KEYWORDS="x86"
ACCEPT_LICENSE="*"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-O2 -march=native -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -march=native -pipe"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--autounmask=n"
FEATURES="assume-digests binpkg-logs ccache compress-build-logs distlocks ebuild-locks fixlafiles news parallel-fetch protect-owned sandbox sfperms strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch"
FFLAGS=""
GENTOO_MIRRORS="http://mirror.leaseweb.com/gentoo/ http://gentoo.mirror.dkm.cz/pub/gentoo/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo http://gentoo.mneisen.org/ http://www.gtlib.gatech.edu/pub/gentoo"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="en en_GB"
MAKEOPTS="-j 3"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/betagarden /usr/local/portage"
SYNC="rsync://rsync.de.gentoo.org/gentoo-portage"
USE="X a52 aac acl acpi alsa apache2 berkdb bittorrent bluetooth branding bzip2 cairo cdda cdr classic cli consolekit cracklib crypt css cups cxx dbus declarative dri dts dvb dvd dvdr emboss encode exif fam fastbuild fat ffmpeg firefox flac fortran gdbm gdu gif git gmp gphoto2 gpm gtk hyphenation iconv ipv6 java jpeg kde kipi kqemu kvm lastfm lcms ldap libnotify lirc logrotate mad mbox mmx mng modules mp3 mp4 mpeg mudflap mysql mysqli ncurses nls nptl nptlonly nsplugin ntfs ogg opengl openmp pam pango pcre pdf phonon plasma png policykit ppds pppd qt3support qt4 rdesktop readline sdl semantic-desktop session sieve spell sse sse2 sse3 ssl ssse3 startup-notification svg sysfs tcpd thinkpad tiff tk transparent-proxy truetype udev unicode usb vaapi vim-syntax vnc vorbis wmf x264 x86 xcb xcomposite xinerama xml xorg xpm xscreensaver xulrunner xv xvid zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en en_GB" LIRC_DEVICES="devinput inputlirc" PHP_TARGETS="php5-3" QEMU_SOFTMMU_TARGETS="i386 x86_64" QEMU_USER_TARGETS="i386 x86_64" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="intel" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

=================================================================
                        Package Settings
=================================================================

sys-apps/coreutils-8.7 was built with the following:
USE="acl (consolekit) gmp nls (policykit) unicode -caps (-selinux) -static -vanilla -xattr"
CFLAGS="-O2 -march=native -pipe -g -ggdb"
CXXFLAGS="-O2 -march=native -pipe -g -ggdb"
Comment 1 Lars Wendler (Polynomial-C) (RETIRED) gentoo-dev 2011-10-28 12:10:49 UTC
The entire output of 

  locale

(without -a option) might be of help, too.
Comment 2 Rafał Mużyło 2011-10-28 13:02:45 UTC
(In reply to comment #1)
> The entire output of 
> 
>   locale
> 
> (without -a option) might be of help, too.

Actually, more helpful would be following:
- filesystem type and mount options of ~/Downloads
- 'LANG=C ls -b M*' of ~/Downloads

There' also a chance, that the terminal you're using is misconfigured.
Comment 3 Toralf Förster gentoo-dev 2011-10-28 16:17:22 UTC
(In reply to comment #2)
> (In reply to comment #1)
> > The entire output of 
> > 
> >   locale

tfoerste@n22 ~ $ locale
LANG=en_US.utf8
LC_CTYPE="en_US.utf8"
LC_NUMERIC="en_US.utf8"
LC_TIME="en_US.utf8"
LC_COLLATE="en_US.utf8"
LC_MONETARY="en_US.utf8"
LC_MESSAGES="en_US.utf8"
LC_PAPER="en_US.utf8"
LC_NAME="en_US.utf8"
LC_ADDRESS="en_US.utf8"
LC_TELEPHONE="en_US.utf8"
LC_MEASUREMENT="en_US.utf8"
LC_IDENTIFICATION="en_US.utf8"
LC_ALL=

> > (without -a option) might be of help, too.
> 
> Actually, more helpful would be following:
> - filesystem type and mount options of ~/Downloads

tfoerste@n22 ~ $ ls -ld Downloads
lrwxrwxrwx 1 tfoerste users 16 Oct 12 21:06 Downloads -> /mnt/E/download/
tfoerste@n22 ~ $ mount | grep E
/dev/sda2 on /mnt/E type fuseblk (rw,noexec,nosuid,nodev,noatime,allow_other,blksize=4096,default_permissions)

but I've a similar problem with my $HOME directory which is ext3

tfoerste@n22 ~ $ export LANG=de_DE.utf8
tfoerste@n22 ~ $ ls -l m*
-rw-r----- 1 tfoerste users 0 Okt 28 18:09 mähmöhmüh

tfoerste@n22 ~ $ export LANG=C
tfoerste@n22 ~ $ ls -l m*
-rw-r----- 1 tfoerste users 0 Oct 28 18:09 m??hm??hm??h

and this is the output of "watch -n 60 ls -l m*":
Every 60.0s: ls -l mähmöhmüh              Fri Oct 28 18:15:24 2011

-rw-r----- 1 tfoerste users 0 Oct 28 18:09 mhmhmh


> There' also a chance, that the terminal you're using is misconfigured.
I'm using KOnsole
Comment 4 Rafał Mużyło 2011-10-28 16:52:16 UTC
It was "ls -b", not "ls -l", but it does seem that the names are utf-8.
Also, fuseblk is a bit meaningless - I was asking about the actual filesystem type.

Try 'ls -l > output' in your own locale, then open it in any gtk+/qt editor - if it's displayed correctly, the problem lies in your terminal config.
Comment 5 Toralf Förster gentoo-dev 2011-10-28 18:23:43 UTC
(In reply to comment #4)
> It was "ls -b", not "ls -l", but it does seem that the names are utf-8.
> Also, fuseblk is a bit meaningless - I was asking about the actual filesystem
> type.
> 
> Try 'ls -l > output' in your own locale, then open it in any gtk+/qt editor -
> if it's displayed correctly, the problem lies in your terminal config.

This works :

tfoerste@n22 ~ $ echo $LANG
en_US.utf8
tfoerste@n22 ~ $  ls -b ~/Downloads/M*
/home/tfoerste/Downloads/Meeresfrüchte.m2t


but as soon as I put that command into watch I get the output above.

BTW the redirection into a file and opening it with an editor (Kate) works fine and give reasonable results.
Comment 6 Rafał Mużyło 2011-10-28 20:42:01 UTC
Well, at least it means it's not a matter of fonts.
'LANG=C ls -b' would only matter as that would have printed anything outside of ascii as octal escapes. If it's an utf-8 locale, it shouldn't have mattered.
IIRC (but I don't use KDE), KDE uses a var or two more than just LANG/LC_*, but I don't recall details.
Comment 7 SpanKY gentoo-dev 2011-10-31 20:46:22 UTC

*** This bug has been marked as a duplicate of bug 291613 ***