Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 518846 - app-portage/layman-2.1.0-r2 fails to add and delete overlays
Summary: app-portage/layman-2.1.0-r2 fails to add and delete overlays
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Third-Party Tools (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Brian Dolbec
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-08-02 17:16 UTC by Juergen Rose
Modified: 2014-12-05 03:36 UTC (History)
3 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Juergen Rose 2014-08-02 17:16:20 UTC
I would like to add the sage-on-gentoo overlay, but it fails. When I then try to list all installed overlays, sage-on-gentoo is listed, but I can't delete it afterwards.

root@lynx2:/etc/quickswitch(248)# layman -a sage-on-gentoo

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://github.com/cschwan/sage-on-gentoo.git /var/lib/layman/sage-on-gentoo )
Cloning into '/var/lib/layman/sage-on-gentoo'...
remote: Counting objects: 25391, done.
remote: Compressing objects: 100% (55/55), done.
remote: Total 25391 (delta 22), reused 0 (delta 0)
Receiving objects: 100% (25391/25391), 10.77 MiB | 176.00 KiB/s, done.
Resolving deltas: 100% (12144/12144), done.
Checking connectivity... done.
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git config user.name "layman" )
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git config user.email "layman@localhost" )

 * CLI: Errors occurred processing action add
 * Exception caught enabling repository 'sage-on-gentoo' : u'm'

root@lynx2:/etc/quickswitch(249)# layman -l
 * sage-on-gentoo[Git](git://github.com/cschwan/sage-on-gentoo.git            )
 * science       [Git](git://git.overlays.gentoo.org/proj/sci.git             )
 * sunrise       [Git](git://git.overlays.gentoo.org/proj/sunrise-reviewed.git)

root@lynx2:/etc/quickswitch(250)# layman -d sage-on-gentoo
 * Deleting selected overlays,...
 * Deleting directory "/var/lib/layman/sage-on-gentoo"

 * CLI: Errors occurred processing action delete
 * Exception caught disabling repository 'sage-on-gentoo':
 * u'm'

root@lynx2:/etc/quickswitch(251)# layman -l
 * sage-on-gentoo[Git](git://github.com/cschwan/sage-on-gentoo.git            )
 * science       [Git](git://git.overlays.gentoo.org/proj/sci.git             )
 * sunrise       [Git](git://git.overlays.gentoo.org/proj/sunrise-reviewed.git)

root@lynx2:/etc/quickswitch(253)# qlist -Iv layman
app-portage/layman-2.1.0-r2


Wath to do?



root@lynx2:/etc/quickswitch(256)# emerge --info layman
Portage 2.2.10 (default/linux/amd64/13.0/desktop, gcc-4.8.3, glibc-2.19-r1, 3.15.7-gentoo x86_64)
=================================================================
                        System Settings
=================================================================
System uname: Linux-3.15.7-gentoo-x86_64-Intel-R-_Core-TM-2_Duo_CPU_T7500_@_2.20GHz-with-gentoo-2.2
KiB Mem:     3972144 total,     41876 free
KiB Swap:   12582908 total,  12557340 free
Timestamp of tree: Sat, 02 Aug 2014 11:00:01 +0000
ld GNU ld (GNU Binutils) 2.24
app-shells/bash:          4.2_p47
dev-java/java-config:     2.2.0
dev-lang/python:          2.7.8, 3.3.5-r1, 3.4.1
dev-util/cmake:           2.8.12.2-r1
dev-util/pkgconfig:       0.28-r2
sys-apps/baselayout:      2.2
sys-apps/openrc:          0.12.4
sys-apps/sandbox:         2.6-r1
sys-devel/autoconf:       2.13, 2.69
sys-devel/automake:       1.9.6-r3, 1.10.3, 1.11.6, 1.12.6, 1.14.1
sys-devel/binutils:       2.24-r3
sys-devel/gcc:            4.8.3
sys-devel/gcc-config:     1.8
sys-devel/libtool:        2.4.2-r1
sys-devel/make:           4.0-r1
sys-kernel/linux-headers: 3.15 (virtual/os-headers)
sys-libs/glibc:           2.19-r1
Repositories: gentoo sunrise science x-portage g-cpan g-octave
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="* -@EULA PUEL Intel-SDP dlj-1.1 skype-eula skype-4.0.0.7-copyright googleearth AdobeFlash-11.x cadsoft Oracle-BCLA-JavaSE MakeMKV-EULA NVIDIA-CUDA Nero-AAC-EULA GIMPS"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/config /usr/share/gnupg/qualified.txt /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.5/ext-active/ /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5.5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5.5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /etc/udev/rules.d"
CXXFLAGS="-march=native -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage_lynx2"
PORTDIR_OVERLAY="/var/lib/layman/sunrise /var/lib/layman/science /usr/local/portage /var/lib/cpan /var/lib/g-octave"
USE="64bit R X Xaw3d a52 aac acl acpi admin afs alsa amd64 ao apache2 apng applet archive armadillo arpack asf aspell atlas audacious audiofile automap automount bash-completion berkdb blas blast bluetooth bluray boost branding bzip2 cairo cdda cddb cdf cdio cdparanoia cdr cgi chm cli cmake consolekit cracklib crypt css cups curl cxx daap db dbi dbm dbus declarative designer devhelp device-mapper dga dia dirac djvu doc dot dri ds2490 ds9097 ds9097u dts dv dvb dvd dvdr dvi dynamicplugin eds egl elf emacs emboss emf encode epiphany evo examples exif expat extensions extra extras faac faad fam ffmpeg fftw firefox fits flac fltk fontconfig foomaticdb fortran fortran95 fpm fpx fuse g3dvl garmin gcj gd gdal gdbm gdu gedit geoip geolocation geos gfortran gif gimp git glade glib glpk gml gmp gnome gnome-keyring gnome-print gnuplot gnutls gold gphoto2 gpm grammar graphics graphtft graphviz grass gsl gsm gstreamer gtk gtk3 gudev guile hddtemp hdf hdf5 hdri html http httpd hvm hwdb iconv icq icu id3tag ide imagemagick imap inotify introspection ipod ipv6 irda ithreads jabber jadetex java jbig jit john jpeg jpeg2k kate kde kdepim kdrive kerberos keymap kpathsea kvm ladspa lame lapack laptop latex lcms ldap lensfun libffi libkms libnotify libsamplerate lirc live lua lzma lzo mad mail maildir mapnik math matroska media-library mercurial mikmod mkl mmx mmxext mng mod modules mono motif mozilla mp3 mp4 mpeg mpi mplayer mtp multilib multimedia musepack musicbrainz mysql mysqli nautilus ncurses netcdf netpbm network networking nfs nls nntp nptl nsplugin ntfs ntp numpy obex objc ocaml ocr octave odbc ofa ogdi ogg openexr opengl openmp openvg pam pango pcre pda pdf pdl2 perl plasma plotutils plugins png podcast policykit portaudio posix postgres postscript ppds preview-latex proj projectm pstricks pulseaudio python python-bindings q32 qemu qhull qt3support qt4 quicktime raw readline reiserfs reports rle romio rpc rrdcgi rrdtool samba sasl schroedinger science sdk sdl secure-delete semantic-desktop server session shout sip slang slp smart smbclient smp sms sndfile snmp soap sockets sound soup sox speex spell sql sqlite sse sse2 ssl ssse3 startup-notification stlport subtitles subversion sudo suexec svg svm swig systemd szip t1lib tcl tcpd tex tex4ht texmacs theora thesaurus thinkpad threads thunderbird tidy tiff tk tools truetype udev udisks unicode upower usb utempter v4l vaapi vala valgrind vdpau video virt-network virtualbox visio vorbis vpx vtk wav webdav webdav-serf webkit wifi wmf wxwidgets x264 xa xattr xcb xetex xext xft xine xml xmlreader xmlrpc xpm xv xvid xvmc yaml youtube zlib zvbi" ABI_X86="64" ALSA_CARDS="intel8x0" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_core authn_dbm authn_default authn_file authz_core authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgid dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info lbmethod_byrequests log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif slotmem_shm so socache_shmcb speling status unique_id unixd userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="canon fuji ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CURL_SSL="nss" DVB_CARDS="usb-wt220u" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev synaptics void" KERNEL="linux" LCD_DEVICES="cfontz hd44780 mtxorb ncurses X lcd2usb lcdlinux png usblcd" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="de fr ru" NETBEANS_MODULES="apisupport cnd dlight enterprise ergonomics groovy gsf harness ide identity j2ee java mobility nb php profiler websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-3" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" QEMU_SOFTMMU_TARGETS="arm i386 x86_64" QEMU_USER_TARGETS="arm i386 x86_64" RUBY_TARGETS="ruby19 ruby20" USERLAND="GNU" VIDEO_CARDS="intel displaylink" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, SYNC, USE_PYTHON

=================================================================
                        Package Settings
=================================================================

app-portage/layman-2.1.0-r2 was built with the following:
USE="git mercurial subversion -bazaar -cvs -darcs -test" ABI_X86="64" PYTHON_TARGETS="python2_7 python3_3 -pypy -python3_4"
Comment 1 Juergen Rose 2014-08-02 17:22:03 UTC
If I try to add x11 overlay I get more or less the same error:


root@lynx2:/etc/quickswitch(267)# layman -a x11

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://git.overlays.gentoo.org/proj/x11 /var/lib/layman/x11 )
Cloning into '/var/lib/layman/x11'...
remote: Counting objects: 17608, done.
remote: Compressing objects: 100% (11865/11865), done.
remote: Total 17608 (delta 8772), reused 11476 (delta 5364)
Receiving objects: 100% (17608/17608), 3.17 MiB | 215.00 KiB/s, done.
Resolving deltas: 100% (8772/8772), done.
Checking connectivity... done.
 * Running Git... # ( cd /var/lib/layman/x11  && /usr/bin/git config user.name "layman" )
 * Running Git... # ( cd /var/lib/layman/x11  && /usr/bin/git config user.email "layman@localhost" )

 * CLI: Errors occurred processing action add
 * Exception caught enabling repository 'x11' : u'm'
Comment 2 Juergen Rose 2014-08-03 13:10:50 UTC
I just found the same error on the next system.

root@lynx:/root(7)# layman -l

 * ago           [Git](http://git.overlays.gentoo.org/gitroot/dev/ago.git     )
 * sage-on-gentoo[Git](http://github.com/cschwan/sage-on-gentoo.git           )
 * science       [Git](http://git.overlays.gentoo.org/gitroot/proj/sci.git    )
 * sunrise       [Git](http://git.overlays.gentoo.org/gitroot/proj/sunrise-reviewed.git)
 * x11           [Git](http://git.overlays.gentoo.org/gitroot/proj/x11.git    )

root@lynx:/root(8)# layman -d ago

 * Deleting selected overlays,...
 * Deleting directory "/var/lib/layman/ago"

 * CLI: Errors occurred processing action delete
 * Exception caught disabling repository 'ago':
 * u'm'
Comment 3 Juergen Rose 2014-08-03 13:14:28 UTC
After the attempt to delete an overlay now also the synchroniztion of overlays fails:

root@lynx:/root(11)# layman -S

 * Fetching remote list,...
 * Fetch Ok

 * Syncing selected overlays,...
 * Running Git... # ( cd /var/lib/layman/ago  && /usr/bin/git pull )
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git pull )
Already up-to-date.
 * Running Git... # ( cd /var/lib/layman/science  && /usr/bin/git pull )
Already up-to-date.
 * Running Git... # ( cd /var/lib/layman/sunrise  && /usr/bin/git pull )
Already up-to-date.
 * Running Git... # ( cd /var/lib/layman/x11  && /usr/bin/git pull )
Already up-to-date.
 * 
 * Succeeded:
 * ------
 * Successfully synchronized overlay "sage-on-gentoo".
 * Successfully synchronized overlay "science".
 * Successfully synchronized overlay "sunrise".
 * Successfully synchronized overlay "x11".
 * 
 * 
 * Errors:
 * ------
 * Failed to sync overlay "ago".
 * Error was: [Errno 2] No such file or directory: '/var/lib/layman/ago'
 * 
!!! Invalid PORTDIR_OVERLAY (not a dir): '/var/lib/layman/ago'

 * CLI: Errors occurred processing action sync_all
 * 
 * Errors:
 * ------
 * Failed to sync overlay "ago".
 * Error was: [Errno 2] No such file or directory: '/var/lib/layman/ago'
 *
Comment 4 Juergen Rose 2014-08-03 13:42:13 UTC
After masking >=layman-2.1.0 and downgrading to layman-2.0.0-r3 adding and deleting of overlays works again.
Comment 5 Devan Franchini (RETIRED) gentoo-dev 2014-08-05 16:52:07 UTC
What version of python are you using?
Comment 6 Devan Franchini (RETIRED) gentoo-dev 2014-08-05 16:56:59 UTC
I can't seem to reproduce the error on either py2.7 or py3.3.
Comment 7 James Geboski (jgeboski) 2014-08-07 07:33:57 UTC
I have also stumbled into this issue. Layman will work just fine without the python2_7 target. However, once the python2_7 target is introduced, layman will begin to throw the completely ambiguous exceptions described above. I have tried with both python-2.7.6 and python-2.7.8, both result in the exceptions being thrown.
Comment 8 Devan Franchini (RETIRED) gentoo-dev 2014-08-08 19:31:55 UTC
(In reply to James Geboski (jgeboski) from comment #7)
> I have also stumbled into this issue. Layman will work just fine without the
> python2_7 target. However, once the python2_7 target is introduced, layman
> will begin to throw the completely ambiguous exceptions described above. I
> have tried with both python-2.7.6 and python-2.7.8, both result in the
> exceptions being thrown.

So were you able to add and delete repos via python3_3 target?

Also, what locale are you set to?

To check:

eselect locale list

might be the easiest way.
Comment 9 James Geboski (jgeboski) 2014-08-08 19:59:07 UTC
(In reply to Devan Franchini from comment #8)
> So were you able to add and delete repos via python3_3 target?

Yes, just not the python2_7 target.

> Also, what locale are you set to?

$ eselect locale list
Available targets for the LANG variable:
  [1]   C
  [2]   en_US
  [3]   en_US.iso88591 *
  [4]   en_US.utf8
  [5]   POSIX
  [ ]   (free form)

$ echo $LANG
en_US.iso88591
Comment 10 Devan Franchini (RETIRED) gentoo-dev 2014-08-08 20:04:19 UTC
(In reply to James Geboski (jgeboski) from comment #9) 
> Yes, just not the python2_7 target.
>
> $ echo $LANG
> en_US.iso88591

Change you change the locale to UTF8 for me and try again with py2.7? If that doesn't work then do this and paste the trace for me if you can:

vi /usr/lib/python2.7/site-packages/layman/api.py

and comment out the try, except in add_repos()? Try again and that should give you the entire trace of what's breaking.
Comment 11 James Geboski (jgeboski) 2014-08-08 20:16:44 UTC
(In reply to Devan Franchini from comment #10)
> Change you change the locale to UTF8 for me and try again with py2.7?

Unfortunately, switching over to UTF8 had little effect.

$ eselect locale list
Available targets for the LANG variable:
  [1]   C
  [2]   en_US
  [3]   en_US.iso88591
  [4]   en_US.utf8 *
  [5]   POSIX
  [ ]   (free form)

$ echo $LANG
en_US.utf8

$ layman -d steam

 * Deleting selected overlays,...
 * Deleting directory "/usr/portage/layman/steam"
Traceback (most recent call last):
  File "/usr/lib/python-exec/python2.7/layman", line 45, in <module>
    main()
  File "/usr/lib64/python2.7/site-packages/layman/cli.py", line 195, in __call__
    result += getattr(self, action[1])()
  File "/usr/lib64/python2.7/site-packages/layman/cli.py", line 293, in Delete
    result = self.api.delete_repos(selection)
  File "/usr/lib64/python2.7/site-packages/layman/api.py", line 122, in delete_repos
    self._get_installed_db().select(ovl))
  File "/usr/lib64/python2.7/site-packages/layman/db.py", line 217, in delete
    self.repo_conf.delete(overlay)
  File "/usr/lib64/python2.7/site-packages/layman/repoconfmanager.py", line 70, in delete
    conf = getattr(self.modules[types][0],
KeyError: u'm'

$ layman -a gnome

 * Adding overlay,...
 * Running Git... # ( cd /usr/portage/layman  && /usr/bin/git clone git://git.overlays.gentoo.org/proj/gnome.git /usr/portage/layman/gnome )
Cloning into '/usr/portage/layman/gnome'...
remote: Counting objects: 47132, done.
remote: Compressing objects: 100% (26909/26909), done.
remote: Total 47132 (delta 20600), reused 45365 (delta 18969)
Receiving objects: 100% (47132/47132), 12.61 MiB | 4.04 MiB/s, done.
Resolving deltas: 100% (20600/20600), done.
Checking connectivity... done.
 * Running Git... # ( cd /usr/portage/layman/gnome  && /usr/bin/git config user.name "layman" )
 * Running Git... # ( cd /usr/portage/layman/gnome  && /usr/bin/git config user.email "layman@localhost" )
Traceback (most recent call last):
  File "/usr/lib/python-exec/python2.7/layman", line 45, in <module>
    main()
  File "/usr/lib64/python2.7/site-packages/layman/cli.py", line 195, in __call__
    result += getattr(self, action[1])()
  File "/usr/lib64/python2.7/site-packages/layman/cli.py", line 244, in Add
    result = self.api.add_repos(selection, update_news=True)
  File "/usr/lib64/python2.7/site-packages/layman/api.py", line 156, in add_repos
    self._get_remote_db().select(ovl))
  File "/usr/lib64/python2.7/site-packages/layman/db.py", line 136, in add
    repo_ok = self.repo_conf.add(overlay)
  File "/usr/lib64/python2.7/site-packages/layman/repoconfmanager.py", line 55, in add
    conf = getattr(self.modules[types][0],
KeyError: u'm'
Comment 12 Devan Franchini (RETIRED) gentoo-dev 2014-08-08 20:39:26 UTC
Can I have the output of this please?:

cat /etc/layman/layman.cfg | grep -i conf_type
Comment 13 Devan Franchini (RETIRED) gentoo-dev 2014-08-08 20:42:41 UTC
I know what the issue is here.

Run etc-update and your layman.cfg should have updates available to it. Please update it and you'll stop running into these issues. :)
Comment 14 James Geboski (jgeboski) 2014-08-08 20:48:02 UTC
(In reply to Devan Franchini from comment #12)
> Can I have the output of this please?:
> 
> cat /etc/layman/layman.cfg | grep -i conf_type

Well, that key is certainly not in my layman.cfg.


(In reply to Devan Franchini from comment #13)
> I know what the issue is here.
> 
> Run etc-update and your layman.cfg should have updates available to it.
> Please update it and you'll stop running into these issues. :)

Yes, this is definitely the issue.  I guess python-3.3 has better handling of missing dictionary values?  Anyways, my apologies for the run-around on that one.
Comment 15 Devan Franchini (RETIRED) gentoo-dev 2014-08-08 20:58:06 UTC
(In reply to James Geboski (jgeboski) from comment #14)
> (In reply to Devan Franchini from comment #12)
> > Can I have the output of this please?:
> > 
> > cat /etc/layman/layman.cfg | grep -i conf_type
> 
> Well, that key is certainly not in my layman.cfg.
> 
> 
> (In reply to Devan Franchini from comment #13)
> > I know what the issue is here.
> > 
> > Run etc-update and your layman.cfg should have updates available to it.
> > Please update it and you'll stop running into these issues. :)
> 
> Yes, this is definitely the issue.  I guess python-3.3 has better handling
> of missing dictionary values?  Anyways, my apologies for the run-around on
> that one.

The issue was that the code that was checking for the value was looking for str but py2.7 brought it in as unicode which is under basestring. So that check needs to be modified, and it has been :) The next release (which should be coming soon enough) will have that fix in it plus a ton of other changes.

I do highly recommend you update your config though, as that is needed. Even for the next release. So keep an eye out for that.
Comment 16 Juergen Rose 2014-08-09 13:43:07 UTC
I just found this problem on my next system:

root@wildcat:/root(13)# layman -l

 * ago      [Git ] (git://git.overlays.gentoo.org/dev/ago.git              )
 * lordvan  [Git ] (git://git.overlays.gentoo.org/dev/lordvan.git          )
 * science  [Git ] (git://git.overlays.gentoo.org/proj/sci.git             )
 * sunrise  [Git ] (git://git.overlays.gentoo.org/proj/sunrise-reviewed.git)

root@wildcat:/root(14)# layman -a sage-on-gentoo

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://github.com/cschwan/sage-on-gentoo.git /var/lib/layman/sage-on-gentoo )
Cloning into '/var/lib/layman/sage-on-gentoo'...
remote: Counting objects: 25398, done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 25398 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (25398/25398), 10.75 MiB | 156.00 KiB/s, done.
Resolving deltas: 100% (12163/12163), done.
Checking connectivity... done.
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git config user.name "layman" )
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git config user.email "layman@localhost" )

 * CLI: Errors occurred processing action add
 * Exception caught enabling repository 'sage-on-gentoo' : u'm'


And I have an UTF8 locale:
root@wildcat:/usr/src(24)#  eselect locale list
Available targets for the LANG variable:
  [1]   C
  [2]   de_DE
  [3]   de_DE@euro
  [4]   de_DE.iso88591
  [5]   de_DE.iso885915@euro
  [6]   de_DE.utf8
  [7]   deutsch
  [8]   en_US
  [9]   en_US.iso88591
  [10]  en_US.iso885915
  [11]  en_US.utf8
  [12]  fran�ais
  [13]  french
  [14]  fr_FR
  [15]  fr_FR@euro
  [16]  fr_FR.iso88591
  [17]  fr_FR.iso885915@euro
  [18]  german
  [19]  POSIX
  [20]  ru_RU.cp1251
  [21]  ru_RU.koi8r
  [22]  ru_RU.utf8
  [23]  en_US.UTF-8 *
  [ ]   (free form)
root@wildcat:/usr/src(25)# cat /etc/layman/layman.cfg | grep -i conf_type
root@wildcat:/usr/src(26)# cat /etc/layman/layman.cfg 
[MAIN]

#-----------------------------------------------------------
# Defines the directory where overlays should be installed

#storage   : /usr/local/portage/layman
storage   : /var/lib/layman

#-----------------------------------------------------------
# Remote overlay lists will be stored here
# layman will append _md5(url).xml to each filename

cache     : %(storage)s/cache

#-----------------------------------------------------------
# The list of locally installed overlays

local_list: %(storage)s/overlays.xml

#-----------------------------------------------------------
# Path to the make.conf file that should be modified by 
# layman

make_conf : %(storage)s/make.conf

#-----------------------------------------------------------
# URLs of the remote lists of overlays (one per line) or 
# local overlay definitions
#
#overlays  : http://www.gentoo.org/proj/en/overlays/layman-global.txt
#            http://dev.gentoo.org/~wrobel/layman/global-overlays.xml
#            http://mydomain.org/my-layman-list.xml
#            file:///usr/portage/local/layman/my-list.xml

#overlays  : http://www.gentoo.org/proj/en/overlays/layman-global.txt
overlays  : http://www.gentoo.org/proj/en/overlays/repositories.xml

#-----------------------------------------------------------
# Proxy support
#
#proxy  : http://[user:pass@]www.my-proxy.org:3128

#-----------------------------------------------------------
# Strict checking of overlay definitions
#
# Set either to "yes" or "no". If "no" layman will issue
# warnings if an overlay definition is missing either 
# description or contact information.
#
nocheck  : yes

#-----------------------------------------------------------
# Umask settings
#
# layman should usually work with a umask of 0022. You should
# only change this setting if you are absolutely certain that
# you know what you are doing.
#
#umask  : 0022



Simple reemerging layman does not chancge anything:


root@wildcat:/usr/src(27)# emerge -v1 layman
...

root@wildcat:/usr/src(28)# genlop -t layman | tail

     Mon Jul 28 04:56:17 2014 >>> app-portage/layman-2.1.0-r1
       merge time: 28 seconds.

     Tue Jul 29 06:47:12 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 30 seconds.

     Sat Aug  9 14:50:17 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 28 seconds.



root@wildcat:/usr/src(31)# layman -a sage-on-gentoo

 * Adding overlay,...
 * Repository 'sage-on-gentoo' was already installed

 * CLI: Errors occurred processing action add
 * Repository 'sage-on-gentoo' was already installed

root@wildcat:/usr/src(32)# layman -d sage-on-gentoo

 * Deleting selected overlays,...
 * Deleting directory "/var/lib/layman/sage-on-gentoo"

 * CLI: Errors occurred processing action delete
 * Exception caught disabling repository 'sage-on-gentoo':
 * u'm'

root@wildcat:/usr/src(33)# layman -l

 * ago                       [Git       ] (git://git.overlays.gentoo.org/dev/ago.git                  )
 * lordvan                   [Git       ] (git://git.overlays.gentoo.org/dev/lordvan.git              )
 * sage-on-gentoo            [Git       ] (git://github.com/cschwan/sage-on-gentoo.git                )
 * science                   [Git       ] (git://git.overlays.gentoo.org/proj/sci.git                 )
 * sunrise                   [Git       ] (git://git.overlays.gentoo.org/proj/sunrise-reviewed.git    )


Downgrading to layman-2.0.0-r3 helps:


root@wildcat:/usr/src(34)# echo ">app-portage/layman-2.0.0-r3" >> /etc/portage/package.mask 
root@wildcat:/usr/src(35)# emerge -v1 layman
...

 * IMPORTANT: config file '/etc/layman/layman.cfg' needs updating.
 * See the CONFIGURATION FILES section of the emerge
 * man page to learn how to update config files.


root@wildcat:/usr/src(36)# dispatch-conf 

root@wildcat:/usr/src(37)# genlop -t layman | tail

     Tue Jul 29 06:47:12 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 30 seconds.

     Sat Aug  9 14:50:17 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 28 seconds.

     Sat Aug  9 15:07:58 2014 >>> app-portage/layman-2.0.0-r3
       merge time: 21 seconds.


root@wildcat:/usr/src(38)# layman -l

 * ago                       [Git       ] (git://git.overlays.gentoo.org/dev/ago.git                  )
 * lordvan                   [Git       ] (git://git.overlays.gentoo.org/dev/lordvan.git              )
 * sage-on-gentoo            [Git       ] (git://github.com/cschwan/sage-on-gentoo.git                )
 * science                   [Git       ] (git://git.overlays.gentoo.org/proj/sci.git                 )
 * sunrise                   [Git       ] (git://git.overlays.gentoo.org/proj/sunrise-reviewed.git    )

root@wildcat:/usr/src(39)# layman -d sage-on-gentoo

 * Deleting selected overlays,...
 * Directory /var/lib/layman/sage-on-gentoo did not exist, no files deleted.

root@wildcat:/usr/src(40)# layman -a sage-on-gentoo

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://github.com/cschwan/sage-on-gentoo.git /var/lib/layman/sage-on-gentoo )
Cloning into '/var/lib/layman/sage-on-gentoo'...
remote: Counting objects: 25398, done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 25398 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (25398/25398), 10.75 MiB | 176.00 KiB/s, done.
Resolving deltas: 100% (12163/12163), done.
Checking connectivity... done.
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git config user.name "layman" )
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git config user.email "layman@localhost" )
 * Successfully added overlay(s) sage-on-gentoo.


Now I unmask layman-2.1 and try once more:

root@wildcat:/usr/src(42)# sed -i "s#>app-portage/layman-2.0.0-r3##"  /etc/portage/package.mask 
root@wildcat:/usr/src(43)# emerge -v1 layman
...
root@wildcat:/usr/src(44)# layman -l

 * ago                       [Git       ] (git://git.overlays.gentoo.org/dev/ago.git                  )
 * lordvan                   [Git       ] (git://git.overlays.gentoo.org/dev/lordvan.git              )
 * sage-on-gentoo            [Git       ] (git://github.com/cschwan/sage-on-gentoo.git                )
 * science                   [Git       ] (git://git.overlays.gentoo.org/proj/sci.git                 )
 * sunrise                   [Git       ] (git://git.overlays.gentoo.org/proj/sunrise-reviewed.git    )

root@wildcat:/usr/src(45)# layman -d ago

 * Deleting selected overlays,...
 * Deleting directory "/var/lib/layman/ago"
 * Successfully deleted overlay(s) ago.

root@wildcat:/usr/src(46)# layman -a ago

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://git.overlays.gentoo.org/dev/ago.git /var/lib/layman/ago )
Cloning into '/var/lib/layman/ago'...
remote: Counting objects: 425, done.
remote: Compressing objects: 100% (386/386), done.
remote: Total 425 (delta 159), reused 0 (delta 0)
Receiving objects: 100% (425/425), 103.01 KiB | 165.00 KiB/s, done.
Resolving deltas: 100% (159/159), done.
Checking connectivity... done.
 * Running Git... # ( cd /var/lib/layman/ago  && /usr/bin/git config user.name "layman" )
 * Running Git... # ( cd /var/lib/layman/ago  && /usr/bin/git config user.email "layman@localhost" )
 * Successfully added overlay(s) ago.


root@wildcat:/usr/src(47)# genlop -t layman | tail

     Sat Aug  9 14:50:17 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 28 seconds.

     Sat Aug  9 15:07:58 2014 >>> app-portage/layman-2.0.0-r3
       merge time: 21 seconds.

     Sat Aug  9 15:39:41 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 25 seconds.


I.e., now works adding and deleting also with layman-2.1.0-r2.
I had the whole time python-2.7:

root@wildcat:/usr/src(48)# qlist -Iv dev-lang/python
dev-lang/python-2.7.8
dev-lang/python-3.3.5-r1
dev-lang/python-3.4.1
dev-lang/python-exec-0.3.1-r1
dev-lang/python-exec-2.0.1-r1
root@wildcat:/usr/src(49)# eselect python list
Available Python interpreters:
  [1]   python2.7 *
  [2]   python3.3
  [3]   python3.4
Comment 17 Juergen Rose 2014-08-22 22:12:10 UTC
I think, I have the issue again. Adding of overlays does not work:

root@lynx:/root(10)# genlop -t layman | tail

     Sun Aug 10 10:54:00 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 25 seconds.

     Thu Aug 21 19:45:37 2014 >>> app-portage/layman-2.0.0-r3
       merge time: 23 seconds.

     Fri Aug 22 00:58:50 2014 >>> app-portage/layman-2.1.0-r2
       merge time: 44 seconds.

root@lynx:/root(11)# layman -a ago

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://git.overlays.gentoo.org/dev/ago.git /var/lib/layman/ago )
Cloning into '/var/lib/layman/ago'...
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/ago  && /usr/bin/git config user.name "layman" )
 * [Errno 2] No such file or directory: '/var/lib/layman/ago'
 * 
 * Trying next source of listed sources...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone http://git.overlays.gentoo.org/gitroot/dev/ago.git /var/lib/layman/ago )
Cloning into '/var/lib/layman/ago'...
fatal: unable to access 'http://git.overlays.gentoo.org/gitroot/dev/ago.git/': Failed to connect to git.overlays.gentoo.org port 80: Connection timed out
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/ago  && /usr/bin/git config user.name "layman" )
 * [Errno 2] No such file or directory: '/var/lib/layman/ago'
 * 
 * Trying next source of listed sources...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git+ssh://git@git.overlays.gentoo.org/dev/ago.git /var/lib/layman/ago )
Cloning into '/var/lib/layman/ago'...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/ago  && /usr/bin/git config user.name "layman" )
 * [Errno 2] No such file or directory: '/var/lib/layman/ago'
 * Adding repository "ago" failed!

 * CLI: Errors occurred processing action add
 * Adding repository "ago" failed!



And on the next system:

root@lynx2:/root(28)# layman -a science

 * Adding overlay,...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git://git.overlays.gentoo.org/proj/sci.git /var/lib/layman/science )
Cloning into '/var/lib/layman/science'...
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/science  && /usr/bin/git config user.name "layman" )
 * [Errno 2] No such file or directory: '/var/lib/layman/science'
 * 
 * Trying next source of listed sources...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone http://git.overlays.gentoo.org/gitroot/proj/sci.git /var/lib/layman/science )
Cloning into '/var/lib/layman/science'...
fatal: unable to access 'http://git.overlays.gentoo.org/gitroot/proj/sci.git/': Failed to connect to git.overlays.gentoo.org port 80: Connection timed out
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/science  && /usr/bin/git config user.name "layman" )
 * [Errno 2] No such file or directory: '/var/lib/layman/science'
 * 
 * Trying next source of listed sources...
 * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone git+ssh://git@git.overlays.gentoo.org/proj/sci.git /var/lib/layman/science )
Cloning into '/var/lib/layman/science'...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/science  && /usr/bin/git config user.name "layman" )
 * [Errno 2] No such file or directory: '/var/lib/layman/science'
 * Adding repository "science" failed!

 * CLI: Errors occurred processing action add
 * Adding repository "science" failed!



'layman -S' does not work either:

root@lynx:/root(13)# layman -S

 * Fetching remote list,...
 * Fetch Ok

 * Syncing selected overlays,...
 * Running Git... # ( cd /var/lib/layman/sage-on-gentoo  && /usr/bin/git pull )
Already up-to-date.
 * Running Git... # ( cd /var/lib/layman/science  && /usr/bin/git pull )
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/sunrise  && /usr/bin/git pull )
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * Running Git... # ( cd /var/lib/layman/x11  && /usr/bin/git pull )
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
 * Failure result returned from Git
 * 
 * Succeeded:
 * ------
 * Successfully synchronized overlay "sage-on-gentoo".
 * 
 * 
 * Errors:
 * ------
 * Failed to sync overlay "science".
 * Error was: Syncing overlay "science" returned status 1!
 * db.sync()
 * Failed to sync overlay "sunrise".
 * Error was: Syncing overlay "sunrise" returned status 1!
 * db.sync()
 * Failed to sync overlay "x11".
 * Error was: Syncing overlay "x11" returned status 1!
 * db.sync()
 * 

 * CLI: Errors occurred processing action sync_all
 * 
 * Errors:
 * ------
 * Failed to sync overlay "science".
 * Error was: Syncing overlay "science" returned status 1!
 * db.sync()
 * Failed to sync overlay "sunrise".
 * Error was: Syncing overlay "sunrise" returned status 1!
 * db.sync()
 * Failed to sync overlay "x11".
 * Error was: Syncing overlay "x11" returned status 1!
 * db.sync()
 *
Comment 18 Brian Dolbec (RETIRED) gentoo-dev 2014-08-22 22:54:01 UTC
(In reply to Juergen Rose from comment #17)
> I think, I have the issue again. Adding of overlays does not work:
> 
> root@lynx:/root(11)# layman -a ago
> 
>  * Adding overlay,...
>  * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone

> fatal: Could not read from remote repository.
> 
...

> Cloning into '/var/lib/layman/ago'...
> fatal: unable to access
> 'http://git.overlays.gentoo.org/gitroot/dev/ago.git/': Failed to connect to
> git.overlays.gentoo.org port 80: Connection timed out
...

>  * Trying next source of listed sources...
>  * Running Git... # ( cd /var/lib/layman  && /usr/bin/git clone
> git+ssh://git@git.overlays.gentoo.org/dev/ago.git /var/lib/layman/ago )
> Cloning into '/var/lib/layman/ago'...
> Permission denied (publickey).
> fatal: Could not read from remote repository.
> 

> 
> And on the next system:
> 
> root@lynx2:/root(28)# layman -a science
> 
>  * Adding overlay,...
...
> fatal: Could not read from remote repository.
> 
...
>  * Trying next source of listed sources...
...
> fatal: unable to access
> 'http://git.overlays.gentoo.org/gitroot/proj/sci.git/': Failed to connect to
> git.overlays.gentoo.org port 80: Connection timed out

...


All these are connection failures which are not the fault of layman.

Gentoo's overlays.gentoo.org server was down for a few days.  The server was being migrated to a new provider.  The old server provider pulled the plug on it earlier than expected.  You can also get intermittent connection failures if the server gets too many requests at the same time, etc..

It should be working for you again, the new server is in operation and all overlays have been updated.

Please re-close this bug when you confirm it is working.
Comment 19 Devan Franchini (RETIRED) gentoo-dev 2014-12-05 03:36:17 UTC
Since it's been about four months since the last comment and we confirmed that the previous issue has been fixed, I'm gonna say it's safe to say I can close this bug as resolved without any issue.