Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 327883 - emerge logs are sometimes removed/lost (/var/log/portage/*)
Summary: emerge logs are sometimes removed/lost (/var/log/portage/*)
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Core (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS
Depends on:
Blocks: 335925
  Show dependency tree
 
Reported: 2010-07-12 08:51 UTC by DEMAINE Benoît-Pierre, aka DoubleHP
Modified: 2010-09-04 08:39 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description DEMAINE Benoît-Pierre, aka DoubleHP 2010-07-12 08:51:51 UTC
I have bash with bash-history. From /var/log/messages:

Jul 12 02:26:42 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log' | wgetpaste

From pidgin history:
(02:26:51) doublehp_f: full log : http://paste.pocoo.org/show/236293/

For various reasons, I wanted to read this log again one hour later:
Jul 12 03:21:50 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log'
Jul 12 03:21:55 uranus bash: HISTORY: PID=11360 UID=0 cat /var/log/portage/media-libs:imlib2-9999:20100712-002446.log
Jul 12 03:22:01 uranus cron[10723]: (root) CMD (. /etc/conf_local ; ups_refresh)
Jul 12 03:22:07 uranus exim[11029]: 2010-07-12 03:22:07 Start queue run: pid=11029
Jul 12 03:22:07 uranus exim[11029]: 2010-07-12 03:22:07 End queue run: pid=11029
Jul 12 03:22:39 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log'
Jul 12 03:22:45 uranus bash: HISTORY: PID=11360 UID=0 cat "/var/log/portage/media-libs:imlib2-9999:20100712-002446.log"

but the file did not exist anymore.

As you can see (even if the paste may be removed in a few weeks, you can check this *NOW*), at 2:26, the file did exist, and was not empty.

I hd no system crash in the mean time; I had one before, and after, but not between 2:26 and 3:21 .

The file just faded away. And, I dislike this behaviour. And hope it is un-intended, and will be fixed. The file is not empty; it is non-existant !
Comment 1 DEMAINE Benoît-Pierre, aka DoubleHP 2010-07-12 08:58:48 UTC
Jul 12 02:08:49 uranus -bash: HISTORY: PID=11244 UID=1000 su
Jul 12 02:08:54 uranus bash: HISTORY: PID=11360 UID=0 emerge -va @enlightenment-layman
Jul 12 02:13:48 uranus bash: HISTORY: PID=11360 UID=0 emerge -va @enlightenment-layman ; Z
Jul 12 02:18:39 uranus bash: HISTORY: PID=11360 UID=0 rm -rf /mnt/big/My_distfiles/svn-src/enlightenment/imlib2/
Jul 12 02:18:42 uranus bash: HISTORY: PID=11360 UID=0 emerge -va @enlightenment-layman ; Z
Jul 12 02:22:08 uranus bash: HISTORY: PID=11360 UID=0 rm -rf /mnt/big/My_distfiles/svn-src/enlightenment
Jul 12 02:22:43 uranus -bash: HISTORY: PID=14639 UID=1000 $(date +%F%H%M)
Jul 12 02:22:47 uranus -bash: HISTORY: PID=14639 UID=1000 echo $(date +%F%H%M)
Jul 12 02:23:17 uranus bash: HISTORY: PID=11360 UID=0 emerge -va @enlightenment-layman ; Z
Jul 12 02:26:42 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log' | wgetpaste
Jul 12 02:27:41 uranus bash: HISTORY: PID=11360 UID=0 df -h
Jul 12 02:30:01 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log' | wgetpaste
Jul 12 02:30:14 uranus -bash: HISTORY: PID=27665 UID=1000 burnK7
Jul 12 02:30:14 uranus -bash: HISTORY: PID=27534 UID=1000 burnK7
Jul 12 02:30:15 uranus -bash: HISTORY: PID=27623 UID=1000 burnK7
Jul 12 02:30:16 uranus -bash: HISTORY: PID=27511 UID=1000 burnK7
Jul 12 02:30:16 uranus -bash: HISTORY: PID=14639 UID=1000 burnK7
Jul 12 02:30:21 uranus bash: HISTORY: PID=11360 UID=0 emerge -va @enlightenment-layman ; Z
Jul 12 02:35:57 uranus bash: HISTORY: PID=11360 UID=0 rm -rf .cache/sessions/
Jul 12 02:36:07 uranus bash: HISTORY: PID=11360 UID=0 rm -rf .ccache
Jul 12 02:36:10 uranus bash: HISTORY: PID=11360 UID=0 vim /etc/make.conf
Jul 12 02:36:31 uranus bash: HISTORY: PID=11360 UID=0 cd /var/tmp/
Jul 12 02:36:31 uranus bash: HISTORY: PID=11360 UID=0 ls
Jul 12 02:36:35 uranus bash: HISTORY: PID=11360 UID=0 cd ccache/
Jul 12 02:36:36 uranus bash: HISTORY: PID=11360 UID=0 ls
Jul 12 02:36:45 uranus bash: HISTORY: PID=11360 UID=0 rm -rf *
Jul 12 02:36:47 uranus bash: HISTORY: PID=11360 UID=0 ls
Jul 12 02:36:49 uranus bash: HISTORY: PID=11360 UID=0 cd
Jul 12 02:36:56 uranus bash: HISTORY: PID=11360 UID=0 emerge -v @enlightenment-layman ; Z
Jul 12 03:00:57 uranus bash: HISTORY: PID=11360 UID=0 emerge -v @enlightenment-layman ; Z
Jul 12 03:01:15 uranus bash: HISTORY: PID=11360 UID=0 emerge -va1 x11-libs/ecore-9999
Jul 12 03:01:18 uranus bash: HISTORY: PID=11360 UID=0 emerge -va1 x11-libs/ecore
Jul 12 03:02:59 uranus bash: HISTORY: PID=11360 UID=0 emerge -v @enlightenment-layman ; Z
Jul 12 03:03:31 uranus bash: HISTORY: PID=11360 UID=0 emerge -va1 media-libs/edje x11-libs/e_dbus dev-libs/efreet x11-wm/enlightenment
Jul 12 03:17:29 uranus bash: HISTORY: PID=11360 UID=0 emerge @preserved-rebuild -va
Jul 12 03:21:50 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log'
Jul 12 03:21:55 uranus bash: HISTORY: PID=11360 UID=0 cat /var/log/portage/media-libs:imlib2-9999:20100712-002446.log
Jul 12 03:22:39 uranus bash: HISTORY: PID=11360 UID=0 cat '/var/log/portage/media-libs:imlib2-9999:20100712-002446.log'
Jul 12 03:22:45 uranus bash: HISTORY: PID=11360 UID=0 cat "/var/log/portage/media-libs:imlib2-9999:20100712-002446.log"

I had a crash few minutes before, but, the filesystem recovery was compleeted. And my portlogs are not in distfiles ! I had to clean my ccache because of bug 327871 .
Comment 2 Zac Medico gentoo-dev 2010-07-16 04:53:06 UTC
I think I've seen this before, when I ran emerge with a failed build in /var/tmp/portage. It seems that in this case the EbuildFetcher class will remove the log from the previous build. In this case, we need EbuildFetcher to clean up the log reference in /var/tmp/portage so that the previous log will be left as-is.
Comment 3 DEMAINE Benoît-Pierre, aka DoubleHP 2010-07-16 12:28:29 UTC
Yes, from emerge point of view, my kernel freese was a merge failure.

I protest against log removal: the log are required to track compile issues. In short, no log should ever been deleted, *ever*. And espcially ... log of errors !!!

ie: The default time for log deletion in logrotate is 4 or 8 weeks. In France, laws force all webmasters to keep connection logs for 5 to 10 years. So, I edited to change all logrotate conf files to switch them to 600 weeks :) I keep *all* logs.

I want more logs. Matter of principle.
Comment 5 Zac Medico gentoo-dev 2010-08-23 06:27:42 UTC
This is in 2.2_rc68, but I'll leave this bug open until it's in an unmasked version.
Comment 6 Zac Medico gentoo-dev 2010-09-04 08:39:54 UTC
This is fixed in 2.1.9.