Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 89792 - using the -g option to emerge makes emerge crash
Summary: using the -g option to emerge makes emerge crash
Status: RESOLVED NEEDINFO
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Binary packages support (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2005-04-20 05:07 UTC by Frank Van Damme
Modified: 2007-02-17 08:57 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Frank Van Damme 2005-04-20 05:07:48 UTC
I have a slow laptop and a faster desktop computer. So I maintain a duplicate of my laptop installation on the desktop, and have the desktop build binary packages under a chroot jail. I put the packages on the web and download them on my laptop to install them. This works fine if I download the packages manually and put them in /usr/portage/packages/All. However, using the -g option to emerge to download the packages automatically does not work: the program crashes.

I tried running "fixpackages" on the duplicate gentoo installation on the desktop computer; this did not change a thing.

Reproducible: Always
Steps to Reproduce:
1. do an emerge with option -g. It does not seem to matter which options -g is combined: emerge -guD world or emerge -g <ebuild> or emerge -g <an ebuild that does not exist> all give the same results.
2. wait and see :)

Actual Results:  
emerge gave this output:

Fetching binary packages info...
Loaded metadata pickle.
Location has moved: http://vandamme.homeunix.net/~frank/gentoo-packages-laptop/All/
Traceback (most recent call last):
  File "/usr/bin/emerge", line 2953, in ?
    mydepgraph=depgraph(myaction,myopts)
  File "/usr/bin/emerge", line 864, in __init__
    portage.db["/"]["bintree"].populate(("--getbinpkg" in myopts),
("--getbinpkgonly" in myopts))
  File "/usr/lib/portage/pym/portage.py", line 5745, in populate
    self.remotepkgs = getbinpkg.dir_get_metadata(settings["PORTAGE_BINHOST"],
chunk_size=chunk_size)  File "/usr/lib/portage/pym/getbinpkg.py", line 440, in
dir_get_metadata
    filelist = dir_get_list(baseurl, conn)
  File "/usr/lib/portage/pym/getbinpkg.py", line 284, in dir_get_list
    parser.feed(page)
  File "/usr/lib/python2.3/HTMLParser.py", line 108, in feed
    self.goahead(0)
  File "/usr/lib/python2.3/HTMLParser.py", line 148, in goahead
    k = self.parse_starttag(i)
  File "/usr/lib/python2.3/HTMLParser.py", line 239, in parse_starttag
    endpos = self.check_for_whole_start_tag(i)
  File "/usr/lib/python2.3/HTMLParser.py", line 314, in check_for_whole_start_tag
    self.error("malformed start tag")
  File "/usr/lib/python2.3/HTMLParser.py", line 115, in error
    raise HTMLParseError(message, self.getpos())
HTMLParser.HTMLParseError: malformed start tag, at line 6, column 24



athena etc # emerge --info
Portage 2.0.51-r15 (default-linux/x86/2005.0, gcc-3.3.5,
glibc-2.3.4.20040808-r1, 2.6.10-gentoo-r6 i586)
=================================================================
System uname: 2.6.10-gentoo-r6 i586 Mobile Pentium MMX
Gentoo Base System version 1.4.16
Python:              dev-lang/python-2.3.4-r1 [2.3.4 (#1, Mar  1 2005, 16:57:28)]
dev-lang/python:     2.3.4-r1
sys-devel/autoconf:  2.13, 2.59-r6
sys-devel/automake:  1.9.4, 1.5, 1.8.5-r3, 1.4_p6, 1.7.9-r1, 1.6.3
sys-devel/binutils:  2.15.92.0.2-r1
sys-devel/libtool:   1.5.10-r4
virtual/os-headers:  2.4.22-r1
ACCEPT_KEYWORDS="x86"
ACCEPT_LICENSE=""
ARCH="x86"
AUTOCLEAN="yes"
BASH_ENV="/etc/spork/is/not/valid/profile.env"
CFLAGS="-mcpu=pentium-mmx -O2 -pipe -fomit-frame-pointer"
CHOST="i586-pc-linux-gnu"
CLEAN_DELAY="5"
CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3.3/env
/usr/kde/3.3/share/config /usr/kde/3.3/shutdown /usr/kde/3/share/config
/usr/lib/X11/xkb /usr/share/config /usr/share/texmf/dvipdfm/config/
/usr/share/texmf/dvips/config/ /usr/share/texmf/tex/generic/config/
/usr/share/texmf/tex/platex/config/ /usr/share/texmf/xdvi/ /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CVS_RSH="ssh"
CXXFLAGS="-mcpu=pentium-mmx -Os -pipe -fomit-frame-pointer"
DISPLAY=":0.0"
DISTDIR="/usr/portage/distfiles"
EDITOR="/bin/nano"
ENV="/root/.bashrc"
FEATURES="autoaddcvs autoconfig ccache distlocks sandbox sfperms strict"
FETCHCOMMAND="/usr/bin/wget -t 5 --passive-ftp -P ${DISTDIR} ${URI}"
GCC_SPECS=""
GDK_USE_XFT="1"
GENTOO_MIRRORS="http://distfiles.gentoo.org
http://distro.ibiblio.org/pub/Linux/distributions/gentoo"
GRP_STAGE23_USE="ipv6 pam tcpd readline nls ssl gpm perl python berkdb ncurses"
G_BROKEN_FILENAMES="1"
HOME="/root"
HOSTNAME="athena"
INFODIR="/usr/share/info"
INFOPATH="/usr/share/info:/usr/share/gcc-data/i586-pc-linux-gnu/3.3.5/info"
INPUTRC="/etc/inputrc"
KDEDIR="/usr/kde/3.3"
KDEDIRS="/usr"
KDE_MALLOC="1"
LESS="-R"
LESSOPEN="|lesspipe.sh %s"
LIBGL_DRIVERS_PATH="/usr/lib/modules/dri"
LOGNAME="root"
LS_COLORS="no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=01;32:*.cmd=01;32:*.exe=01;32:*.com=01;32:*.btm=01;32:*.bat=01;32:*.sh=01;32:*.csh=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.mng=01;35:*.xcf=01;35:*.pcx=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.avi=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.mov=01;35:*.qt=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.pdf=00;32:*.ps=00;32:*.txt=00;32:*.patch=00;32:*.diff=00;32:*.log=00;32:*.tex=00;32:*.doc=00;32:*.mp3=00;36:*.wav=00;36:*.mid=00;36:*.midi=00;36:*.au=00;36:*.ogg=00;36:*.flac=00;36:*.aac=00;36:"
MAIL="/var/mail/root"
MAKEOPTS="-j1"
MANPATH="/usr/share/man:/usr/local/share/man:/usr/share/gcc-data/i586-pc-linux-gnu/3.3.5/man:/usr/qt/3/doc/man"
NOCOLOR="false"
OLDPWD="/home/frank"
PAGER="/usr/bin/less"
PATH="/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/opt/bin:/usr/i586-pc-linux-gnu/gcc-bin/3.3.5:/usr/X11R6/bin:/usr/qt/3/bin:/usr/kde/3.3/sbin:/usr/kde/3.3/bin:/usr/kde/3.3/sbin:/usr/kde/3.3/bin"
PKGDIR="/usr/portage/packages"
PORTAGE_ARCHLIST="alpha amd64 arm hppa ia64 m68k mips ppc ppc64 ppc-macos ppc-od
s390 sh sparc x86 x86-fbsd x86-obsd x86-od"
PORTAGE_BINHOST="http://vandamme.homeunix.net/~frank/gentoo-packages-laptop/All"
PORTAGE_BINHOST_CHUNKSIZE="3000"
PORTAGE_CALLER="emerge"
PORTAGE_GID="250"
PORTAGE_MASTER_PID="10851"
PORTAGE_NICENESS="14"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PRELINK_PATH=""
PRELINK_PATH_MASK="/usr/lib/wine:/usr/lib/valgrind"
PS1="\[\033[01;31m\]\h \[\033[01;34m\]\W \$ \[\033[00m\]"
PWD="/etc"
QMAKESPEC="linux-g++"
QTDIR="/usr/qt/3"
RESUMECOMMAND="/usr/bin/wget -c -t 5 --passive-ftp -P ${DISTDIR} ${URI}"
RPMDIR="/usr/portage/rpm"
RSYNC_RETRIES="3"
RSYNC_TIMEOUT="180"
SGML_CATALOG_FILES="/etc/sgml/sgml-ent.cat:/etc/sgml/sgml-docbook.cat:/etc/sgml/sgml-docbook-3.1.cat:/etc/sgml/sgml-docbook-3.0.cat:/etc/sgml/openjade-1.3.2.cat:/etc/sgml/sgml-docbook-4.1.cat:/etc/sgml/dsssl-docbook-stylesheets.cat:/etc/sgml/sgml-docbook-4.0.cat:/etc/sgml/sgml-lite.cat"
SHELL="/bin/bash"
SHLVL="1"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
TERM="xterm"
USE="X apm audiofile avi bitmap-fonts bonobo bootsplash caps crypt cscope cups
curl dga dlloader emboss encode evo f77 fam foomaticdb fortran gif gphoto2 gpm
gstreamer gtk gtk2 gtkhtml imap imlib ipv6 jabber jpeg kde lesstif libg++ libwww
mad maildir mbox mikmod mmx mp3 mpeg ncurses nls odbc offensive ogg oggvorbis
oss pam pcmcia pdflib pic png pnp ppds qt readline samba sasl sdl slang slp snmp
speex ssl svga tcpd tetex theora tiff truetype truetype-fonts type1-fonts
unicode usb vhosts videos vorbis wmf wxwindows x86 xface xml xml2 xmms xosd xv
yahoo zlib"
USER="root"
USERLAND="GNU"
USERNAME="root"
USE_EXPAND="VIDEO_CARDS INPUT_DEVICES LINGUAS"
XARGS="xargs -r"
XAUTHORITY="/root/.xauthkWsmcD"
XINITRC="/etc/X11/xinit/xinitrc"
_="/usr/bin/emerge"

My laptop is an IBM thinkpad 560x, pentium 233 mmx-cpu, 96 MB of ram, half a GB
of free hard disc space.
Comment 1 Nicholas Jones (RETIRED) gentoo-dev 2005-04-23 22:20:03 UTC
Might wanna check your webserver. That error indicates that
it's doing something that isn't a standard starting response.
Comment 2 Neil McKenzie 2006-06-23 20:34:08 UTC
This problem occurs on apache2 and lighttpd but not on apache 1.3.
The parsing code doesn't seem to be designed for apache 1.3 only.

A workaround is to mask apache2 on the BINHOST server.

Another workaround may be to change PORTAGE_BINHOST_CHUNKSIZE on the client, but I havn't had any success with this.
Comment 3 Neil McKenzie 2006-06-23 20:35:16 UTC
(In reply to comment #2)
> This problem occurs on apache2 and lighttpd but not on apache 1.3.
> The parsing code doesn't seem to be designed for apache 1.3 only.
> 
> A workaround is to mask apache2 on the BINHOST server.
> 
> Another workaround may be to change PORTAGE_BINHOST_CHUNKSIZE on the client,
> but I havn't had any success with this.
> 

I meant 'The parsing code seems to be designed for apache 1.3 only.'
Comment 4 Marius Mauch (RETIRED) gentoo-dev 2007-01-28 10:21:30 UTC
Still an issue?
Comment 5 Neil McKenzie 2007-01-30 07:16:41 UTC
I don't have the resources to work on this bug anymore.

Sorry.
Comment 6 Marius Mauch (RETIRED) gentoo-dev 2007-02-17 08:57:26 UTC
Well, would need to see the actual traffic for debugging.