Bug 339847 – app-misc/tracker-0.8.17 (full) re-indexing on every login

• Status: RESOLVED INVALID
• Product: Gentoo Linux

[Description Kete Tefid 2010-10-05 17:02:21 UTC]

This is one of the most annoying bugs I've ever seen. After every login to gnome, tracker starts its activity showing indexing all the data. It goes on and on and on until it indexes all the data. This happens every time the user logins. This process eats up cpu and also HDD so a bad hog appears which prevents the user from doing any activity.

emerge tracker:
These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild   R   ] app-misc/tracker-0.8.17  USE="applet eds exif flac gnome-keyring gsf gstreamer gtk hal iptc jpeg laptop mp3 nautilus pdf playlist rss tiff vorbis xine xml xmp -debug -doc -kmail -strigi -test" 0 kB

Total: 1 package (1 reinstall), Size of downloads: 0 kB



emerge --info
Portage 2.1.8.3 (default/linux/amd64/10.0, gcc-4.4.3, glibc-2.11.2-r0, 2.6.35-tuxonice-r3 x86_64)
=================================================================
System uname: Linux-2.6.35-tuxonice-r3-x86_64-AMD_Athlon-tm-_7850_Dual-Core_Processor-with-gentoo-1.12.13
Timestamp of tree: Tue, 05 Oct 2010 16:30:01 +0000
distcc 3.1 x86_64-pc-linux-gnu [disabled]
ccache version 2.4 [enabled]
app-shells/bash:     4.0_p37
dev-java/java-config: 2.1.11
dev-lang/python:     2.6.5-r3, 3.1.2-r4
dev-util/ccache:     2.4-r7
dev-util/cmake:      2.8.1-r2
sys-apps/baselayout: 1.12.13
sys-apps/sandbox:    2.3-r1
sys-devel/autoconf:  2.13, 2.65-r1
sys-devel/automake:  1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/gcc:       4.4.3-r2
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6b
sys-devel/make:      3.81-r2
virtual/os-headers:  2.6.30-r1
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA PUEL sun-bcla-java-vm skype-eula dlj-1.1 RTCW-ETEULA AdobeFlash-10.1 AdobeFlash-10"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=amdfam10 -pipe -fomit-frame-pointer -funroll-loops -fprefetch-loop-arrays"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -march=amdfam10 -pipe -fomit-frame-pointer -funroll-loops -fprefetch-loop-arrays"
DISTDIR="/mnt/e/distfiles/"
FEATURES="assume-digests buildpkg ccache distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms unmerge-logs userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LDFLAGS="-Wl,-z,now,--as-needed,-O1,--hash-style=gnu,--sort-common"
LINGUAS="en ar fa"
MAKEOPTS="-j3"
PKGDIR="/mnt/e/GentooPackages/"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/sunrise /var/lib/layman/zugaina /var/lib/layman/dotnet /var/lib/layman/games /var/lib/layman/gnome"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="3dnow 3dnowext 3gp X a52 aac aalib acc acl acpi acpid alsa amd64 amr apache2 applet archive ares asf audacious autoipd automount avahi avi beagle berkdb bidi bluetooth bmp bonjour bookmarks browserplugin bttv bzip2 cairo cd cdda cddax cddb cdio cdparanoia cdr cli consolekit cpudetection cracklib crypt cups cxx dbus dhcpcd dia directfb divx4linux djvu dmix docbook dot dts dv dvb dvd dvdnav dvdr dxr3 encode esd evdev excel extras fa faac faad farsi fasttrack fbcon fbcondecor fbsplash ffmpeg firefox flac flash flashplayer fltk fontconfig fortran fortran95 freetype fuse galago gd gdbm gdu gif gmp gnome gnome-keyring gnutella gnutls gpm gstreamer gtk gtk2 h323 hal html httpd iconv id3tag imagemagick ioplug iplayer ipv6 java java6 javascript jpeg jpeg2k jpg lame latex lcms libnotify lirc live m4a mad matroska mid mjpeg mmx mmxext modules mov mozilla mp3 mp4 mpeg mpg mudflap multilib mysql nautilus ncurses network networkmanager new-login nfs nls nptl nptlonly nsplugin nvidia ogg oggvorbis ogm openal opencore-amr openft opengl openmp oss pam pcre pdf perl persian php pipechan plug png pnm policykit pppd projectm proxy ps python quicktime ra ram rar rcs readline reflection rm rtf samba sdl session sip slp smp socks socks5 spell sqlite sse sse2 ssl static-libs stream svg svn symlink sysfs taglib tcpd theora tiff tk tracker truetype udev unicode unrar usb v4l vcd vcdinfo vcdx vdpau vlm vorbis wav wavpack wma wmf wmv wxwindows x264 xanim xattr xcb xine xml xmms xorg xpm xulrunner xv xvid xvmc yahoo youtube zeroconf zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CAMERAS="stv0680" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en ar fa" LIRC_DEVICES="pctv" RUBY_TARGETS="ruby18" SANE_BACKENDS="gt68xx" USERLAND="GNU" VIDEO_CARDS="nvidia vesa" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LANG, LC_ALL, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

[Comment 1 Gilles Dartiguelongue (RETIRED) 2010-10-06 09:39:30 UTC]

Did you check this is not actually just checking files mtimes for example. I sure known it's not wiping it's database since content scanned on my nfs mounts are still in the db even when they are not mounted.

[Comment 2 Sergey Zolotorev 2010-10-06 22:19:41 UTC]

I wish to confirm: I have the same issue with app-misc/tracker-0.8.17 and panel applet shows "File System 1%" every time after login. It seems it scans every file on FS, not only changed.

I'm going to enable verbose logging and see what it doing.

[Comment 3 Sergey Zolotorev 2010-10-07 10:34:31 UTC]

I've found a very strange warning in tarcker debug output:

(tracker-miner-fs:12072): Tracker-WARNING **: Could not add monitor for path:'/home/serzh/Documents/books.all/Catalog_GOST/Catalog/Data/65/6573'
07 Окт 2010, 14:30:15: Tracker: Generating mtime cache for URI 'file:///home/serzh/Documents/books.all/Catalog_GOST/Catalog/Data/65/6573'
(tracker-miner-fs:12072): Tracker-DEBUG: Generating mtime cache for URI 'file:///home/serzh/Documents/books.all/Catalog_GOST/Catalog/Data/65/6573'
07 Окт 2010, 14:30:15: Tracker: Populated mtime cache with '2' items
(tracker-miner-fs:12072): Tracker-DEBUG: Populated mtime cache with '2' items
Adding INotify watch:: No space left on device

There is a lot of messages about "Adding INotify watch:: No space left on device". About which device tracker said? May be this warning a root of issue? All devices contain enough space.

[Comment 4 Sergey Zolotorev 2010-10-13 12:31:05 UTC]

Hmm, '32768' in /proc/sys/fs/inotify/max_user_watches has fixes warning about 'No space left on device' but trackerd reindexes all files on every login.

[Comment 5 Derek Dolney 2010-10-23 19:07:37 UTC]

It's a shame that tracker-0.8.15 was just removed from the portage tree. I think 0.8.17 is unusable because of this bug.

[Comment 6 Kete Tefid 2010-11-17 11:13:38 UTC]

(In reply to comment #5)
> It's a shame that tracker-0.8.15 was just removed from the portage tree. I
> think 0.8.17 is unusable because of this bug.
> 

I had to unmerge tracker...and now I have to use locate to find something among millions of files...

[Comment 7 Gilles Dartiguelongue (RETIRED) 2010-11-17 13:23:18 UTC]

Please report a bug upstream and paste the URL here. Afaik, the problem is still manifesting with tracker-0.9/master, ebuilds to test this are in tree so you can test easily whatever upstream asks you to do, even if they don't support 0.8 anymore.

[Comment 8 Gilles Dartiguelongue (RETIRED) 2011-11-26 13:07:13 UTC]

The files are not actually re-indexed but checked for modifications on every startup (by default). I guess upstream is unlikely to modify this behavior.