Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 283628 - app-portage/genlop-0.30.8-r2: genlop -c output for parallel builds is wrong
Summary: app-portage/genlop-0.30.8-r2: genlop -c output for parallel builds is wrong
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: x86 Linux
: High normal with 1 vote (vote)
Assignee: Portage Tools Team
URL:
Whiteboard:
Keywords:
: 485726 (view as bug list)
Depends on:
Blocks:
 
Reported: 2009-09-04 04:24 UTC by peteru
Modified: 2023-07-18 22:09 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description peteru 2009-09-04 04:24:45 UTC
When running parallel builds such as:
# emerge --jobs 5 --load-average 8 --keep-going -uDN @world

genlop -c will report patently wrong ETA values.

# genlop -c

 Currently merging 8 out of 186

 * app-office/openoffice-3.1.1

       current merge time: 3 hours, 41 minutes and 10 seconds.
       ETA: 2 hours, 26 minutes and 17 seconds.

 Currently merging 181 out of 186

 * kde-base/kdeplasma-addons-4.3.1

       current merge time: 21 minutes and 18 seconds.
       ETA: 5 hours, 6 minutes and 51 seconds.


Reproducible: Always

Steps to Reproduce:
1. Start a big emerge session with parallel build option:

# emerge --jobs 5 --load-average 8 --keep-going -uDN @world

2. Wait for some time to get a few builds going

3. # genlop -c
Actual Results:  
Most packages that are currently building show very long ETA times.

Expected Results:  
The ETA times for some of the packages should be on the order of minutes, not hours.

# genlop -t kdeplasma-addons
 * kde-base/kdeplasma-addons

     Sat Dec  6 19:38:09 2008 >>> kde-base/kdeplasma-addons-4.1.3
       merge time: 1 minute and 19 seconds.

     Sun Jan 18 15:49:04 2009 >>> kde-base/kdeplasma-addons-4.1.4
       merge time: 1 minute and 27 seconds.

     Tue Feb  3 01:18:09 2009 >>> kde-base/kdeplasma-addons-4.2.0
       merge time: 3 minutes and 47 seconds.

     Thu Aug 13 14:07:49 2009 >>> kde-base/kdeplasma-addons-4.2.4
       merge time: 8 minutes and 17 seconds.

     Mon Aug 17 15:30:06 2009 >>> kde-base/kdeplasma-addons-4.3.0
       merge time: 14 minutes and 36 seconds.


#  emerge --info
Portage 2.2_rc40 (default/linux/x86/10.0/desktop, gcc-4.4.1, glibc-2.10.1-r0, 2.6.30-gentoo-r6 i686)
=================================================================
System uname: Linux-2.6.30-gentoo-r6-i686-Intel-R-_Xeon-TM-_CPU_3.20GHz-with-gentoo-2.0.1
Timestamp of tree: Thu, 03 Sep 2009 18:00:01 +0000
ccache version 2.4 [enabled]
app-shells/bash:     4.0_p28
dev-java/java-config: 2.1.9
dev-lang/python:     2.6.2-r1, 3.1.1
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.6.4-r2
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.4.3-r3
sys-apps/sandbox:    2.1
sys-devel/autoconf:  2.13, 2.63-r1
sys-devel/automake:  1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10.2, 1.11
sys-devel/binutils:  2.19.1-r1
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6a
virtual/os-headers:  2.6.30-r1
ACCEPT_KEYWORDS="x86 ~x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=pentium4 -msse2 -O2 -fomit-frame-pointer -funit-at-a-time -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d"
CXXFLAGS="-march=pentium4 -msse2 -O2 -fomit-frame-pointer -funit-at-a-time -pipe"
DISTDIR="/home/portage/distfiles"
EMERGE_DEFAULT_OPTS="--jobs 5 --keep-going --load-average 8"
FEATURES="assume-digests ccache confcache distlocks fixpackages parallel-fetch preserve-libs protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://mirror.exetel.com.au/pub/gentoo http://ftp.swin.edu.au/gentoo http://mirror.usu.edu/mirrors/gentoo/ http://gentoo.mirrors.easynews.com/linux/gentoo/ http://gentoo.osuosl.org/ http://gentoo.mirrors.pair.com/"
LANG="en_AU"
LDFLAGS="-Wl,-O1"
LINGUAS="en en_AU en_GB en_US"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/portage/local/layman/vmware /usr/local/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="7zip X X509 Xaw3d a52 aac accessibility acl acpi aften alias alsa amazon amrnb amrwb antlr apache2 ared aredmem asf audiofile automount autoreplace bash-completion bcel berkdb bonobo boost branding bzip2 cairo cdda cdparanoia cdr cgi chm chroot cli connectionstatus cracklib crypt cscope css ctype cups curl cvs dba dbus dell dga disk-partition divx divx4linux djvu doc dri dts dv dvb dvd dvdr dvdread dynagraph edl emboss encode esd evo examples exif expat faac faad fam fame fat fax fbcon ffmpeg fftw flac fontconfig ftp fusion gcj gd gdbm geoip ggi gif gimp gimpprint git glib glitz glut gnome gnutls gphoto2 graphviz gstreamer gtk gtk2 gtkhtml hal highlight history htmlhandbook iconv icq id3 id3tag idn ieee1394 imagemagick imap imlib inotify ipod irc isdnlog jack java java5 java6 javadoc javamail jce jdepend jmx jp2 jpeg jpeg2k jsch json junit jython kde kipi ladcca lame lcms libnotify libsamplerate live log4j lzo lzw lzw-tiff mad maildir matroska mbox md5sum mdnsresponder-compat messenger mhash mikmod mime mjpeg mmap mmx mng monkey mono motif mozcalendar mozdevelop mozdomi mozilla moznoirc mozp3p mozsvg mp2 mp3 mp4 mpeg mpeg4 mplayer mudflap multitarget musepack musicbrainz mysql ncurses network nfs nfsv4 nis nls nntp nptl nptlonly nsplugin ntfs ntlm nvidia odbc offensive ogg openexr opengl openmp optional-tasks oro oscar pam pcap pch pcre pdf pdo pear-db perl php pic pie plotutils png posix ppds pppd python qt3support qt4 quicktime quotas rar readline recode reflection regexp reiserfs rss rtc ruby samba sametime sdl session sharedmem shorten slang smp smtp sndfile snmp soap sockets source speex spell spl sql sqlite sqlite3 sse sse2 ssl startup-notification statistics stream struts subversion svg swat sysfs syslog sysvipc tcl tcpd teletext tga theora threads threadsafe thunar tidy tiff tk tokenizer transcode translator truetype unicode usb uudeview v4l v4l2 vcd vim-syntax vlm vnc vorbis wavpack webdav webkit win32codecs wmf wxwin wxwindows x264 x86 xalan xattr xchatdccserver xcomposite xerces xext xforms xft xine xinerama xml xml2 xmlreader xmlrpc xmlwriter xmp xorg xosd xprint xsl xulrunner xv xvid xvmc yahoo yv12 zip zlib zvbi" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias  auth_basic auth_digest  authn_anon authn_dbd authn_dbm authn_default authn_file  authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user  autoindex  cache  dav dav_fs dav_lock dbd deflate dir disk_cache  env expires ext_filter  file_cache filter headers  ident imagemap include info  log_config logio  mem_cache mime mime_magic  negotiation  proxy proxy_ajp proxy_balancer proxy_connect proxy_http  rewrite  setenvif so speling status  unique_id userdir usertrack  vhost_alias" APACHE2_MPMS="prefork" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en en_AU en_GB en_US" USERLAND="GNU" VIDEO_CARDS="nvidia vesa"
Unset:  CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, LC_ALL, MAKEOPTS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Till Schäfer 2013-11-14 10:00:09 UTC
this bug is still valid for genlop-0.30.8-r (and portage 2.2.7)

the ETA calculation is just random, but somewhat orientated to the highest merge time in all parallel builds.
Comment 2 Ogelpre 2015-02-05 22:27:27 UTC
still valid for genlop-0.30.10
Comment 3 Fredric Johansson 2015-05-14 11:22:39 UTC
There is a patch for this as a pull request at:
https://github.com/gentoo-perl/genlop/pull/7
Comment 4 Till Schäfer 2018-06-11 15:43:12 UTC
*** Bug 485726 has been marked as a duplicate of this bug. ***
Comment 5 Larry the Git Cow gentoo-dev 2023-07-18 22:09:29 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=784e0cddc47130412c37569deb120e542767f4ca

commit 784e0cddc47130412c37569deb120e542767f4ca
Author:     Sam James <sam@gentoo.org>
AuthorDate: 2023-07-18 22:06:20 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2023-07-18 22:09:16 +0000

    app-portage/genlop: add 0.30.11
    
    Closes: https://bugs.gentoo.org/283628
    Closes: https://bugs.gentoo.org/447436
    Closes: https://bugs.gentoo.org/540050
    Closes: https://bugs.gentoo.org/658940
    Closes: https://bugs.gentoo.org/677890
    Closes: https://bugs.gentoo.org/697504
    Signed-off-by: Sam James <sam@gentoo.org>

 app-portage/genlop/Manifest              |  1 +
 app-portage/genlop/genlop-0.30.11.ebuild | 28 ++++++++++++++++++++++++++++
 2 files changed, 29 insertions(+)