Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 698446 - emerge --sync leaves two files in current dir related to manifest verification
Summary: emerge --sync leaves two files in current dir related to manifest verification
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Unclassified (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: 240187
  Show dependency tree
 
Reported: 2019-10-24 09:20 UTC by A Blamey
Modified: 2019-10-28 06:48 UTC (History)
6 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description A Blamey 2019-10-24 09:20:23 UTC
After running emerge --sync I see two files have appeared in $PWD (/root):
-rw-r--r--  1 root root  337 Oct 24 09:58 dbgmd-00001.verify
-rw-r--r--  1 root root  137 Oct 24 09:58 dbgmd-00002.unknown

The first contains:
MANIFEST Manifest.files.gz 12431 BLAKE2B 01f85214679133e11f407d3d98aa7199014e62beb28441547ec80fbf152782842031346f8533b9d9dbab149da60f2faf8cc88276588df64076b57a424b536879 SHA512 46b9e6743aa054c2ca0f0a099c41383157eef0c6ca41b382f82afde381fedcfd5d2f0f05669d0c25db300bd3525ee0dcc8a7e3841488b1b176e1b611182af55a
TIMESTAMP 2019-10-24T08:08:49Z

The second is binary data: (via xxd -g 1)
00000000: 04 01 01 0a 00 7d 16 21 04 e1 d6 ab b6 3b fc fb  .....}.!.....;..
00000010: 4b a0 2f df 1c ec 59 0e ea c9 18 92 50 05 02 5d  K./...Y.....P..]
00000020: b1 5c 11 5f 14 80 00 00 00 00 2e 00 28 69 73 73  .\._........(iss
00000030: 75 65 72 2d 66 70 72 40 6e 6f 74 61 74 69 6f 6e  uer-fpr@notation
00000040: 73 2e 6f 70 65 6e 70 67 70 2e 66 69 66 74 68 68  s.openpgp.fifthh
00000050: 6f 72 73 65 6d 61 6e 2e 6e 65 74 45 31 44 36 41  orseman.netE1D6A
00000060: 42 42 36 33 42 46 43 46 42 34 42 41 30 32 46 44  BB63BFCFB4BA02FD
00000070: 46 31 43 45 43 35 39 30 45 45 41 43 39 31 38 39  F1CEC590EEAC9189
00000080: 32 35 30 04 ff 00 00 00 83                       250......



Reproducible: Always

Steps to Reproduce:
1. ls dbgmd-*
2. emerge --sync
3. ls dbgmd-*



This has been occuring for a few days now.  I'm not certain but I think it started after updating either portage (2.3.77-r1 or 2.3.78) or gemato (14.2).

I'm running ~amd64.

Portage 2.3.78 (python 3.7.5-final-0, default/linux/amd64/17.1/desktop, gcc-9.2.0, glibc-2.29-r6, 5.3.7-gentoo-alex1 x86_64)
=================================================================
System uname: Linux-5.3.7-gentoo-alex1-x86_64-Intel-R-_Core-TM-_i7-4790K_CPU_@_4.00GHz-with-gentoo-2.6
KiB Mem:    16082848 total,   1908108 free
KiB Swap:   10086396 total,  10011900 free
Timestamp of repository gentoo: Thu, 24 Oct 2019 08:30:01 +0000
Head commit of repository gentoo: 5ef361048f1006f4376ebe5805e76c5d41d64c19
sh bash 5.0_p11
ld GNU ld (Gentoo 2.32 p2) 2.32.0
ccache version 3.7.5 [enabled]
app-shells/bash:          5.0_p11::gentoo
dev-lang/perl:            5.30.0::gentoo
dev-lang/python:          2.7.16::gentoo, 3.6.9::gentoo, 3.7.5-r1::gentoo
dev-util/ccache:          3.7.5::gentoo
dev-util/cmake:           3.15.4::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/openrc:          0.42.1::gentoo
sys-apps/sandbox:         2.18::gentoo
sys-devel/autoconf:       2.69-r4::gentoo
sys-devel/automake:       1.16.1-r1::gentoo
sys-devel/binutils:       2.32-r1::gentoo
sys-devel/gcc:            9.2.0-r1::gentoo
sys-devel/gcc-config:     2.1::gentoo
sys-devel/libtool:        2.4.6-r5::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.3::gentoo (virtual/os-headers)
sys-libs/glibc:           2.29-r6::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: -i -O
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-jobs: 1

local
    location: /usr/local/portage
    masters: gentoo
    priority: 0

ikelos
    location: /var/db/repos/layman/ikelos
    masters: gentoo
    priority: 50

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.3/ext-active/ /etc/php/cgi-php7.3/ext-active/ /etc/php/cli-php7.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=native -O2 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-march=native -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs ccache config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O2 -pipe"
GENTOO_MIRRORS="	http://www.mirrorservice.org/sites/distfiles.gentoo.org/ 	http://mirror.bytemark.co.uk/gentoo/ 	http://distfiles.gentoo.org 	http://www.ibiblio.org/pub/Linux/distributions/gentoo"
INSTALL_MASK=" /usr/share/locale/* -/usr/share/locale/en -/usr/share/locale/en@IPA -/usr/share/locale/en@boldquot -/usr/share/locale/en@quot -/usr/share/locale/en@shaw -/usr/share/locale/en_GB -/usr/share/locale/en_GB.UTF-8 -/usr/share/locale/en_US -/usr/share/locale/en_US.UTF-8 -/usr/share/locale/locale.alias /usr/share/man/* -/usr/share/man/cat* -/usr/share/man/man* "
LANG="en_GB.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="en_GB en"
MAKEOPTS="-j9"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="-i -O"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acl acpi aes alsa amd64 apache2 avx avx2 bash-completion berkdb branding bzip2 cairo caps cdda clamav cli crypt cxx dbus dga dri dts dv dvd dvdr emboss encode exif f16c fam ffmpeg fftw filecaps flac fma fma3 fontconfig fortran g15 gdbm gif gimp glamor gmp gnutls gtk iconv icu idn imagemagick imap imlib innodb jbig jfs jpeg jpeg2k lcd lcms libnotify libtirpc lm-sensors lz4 lzma lzo mad maildir mime mmap mmx mmxext mng mp3 mp4 mpeg multilib mysql mysqli ncurses nls nptl ogg openal openexr opengl openmp pam pango pclmul pcntl pcre pdf perl php plotutils png popcnt posix ppds python quicktime readline samba sdl seccomp sharedmem sockets split-usr sqlite sqlite3 sse sse2 sse3 sse4 sse4_1 sse4_2 ssl ssse3 startup-notification svg sysvipc tcpd theora threads tiff truetype unicode usb vhosts vim-syntax vorbis webp wmf x264 xattr xcb xfs xml xmlrpc xpm xsl xv xvid zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="actions alias asis auth_basic auth_digest authn_core authn_file authz_core authz_host authz_user autoindex cgi deflate dir env expires filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id unixd userdir usertrack vhost_alias" APACHE2_MPMS="prefork" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en-GB en" LCD_DEVICES="g15" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-3" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6 python3_7" RUBY_TARGETS="ruby24 ruby25" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
Comment 1 Arve Barsnes 2019-10-25 04:56:31 UTC
Seeing a lot of debug output at sync as well. Might be the gemato version, on accord of this change: https://github.com/mgorny/gemato/commit/3f3f721f559e155e34f0e1a8858639c24a9b44ef
Comment 2 Zac Medico gentoo-dev 2019-10-25 05:52:38 UTC
(In reply to Arve Barsnes from comment #1)
> Seeing a lot of debug output at sync as well. Might be the gemato version,
> on accord of this change:
> https://github.com/mgorny/gemato/commit/
> 3f3f721f559e155e34f0e1a8858639c24a9b44ef

Yeah, gemato-14.2 enabled debug in config files unconditionally, as we can also see in the diff from gemato-14.1:

https://github.com/mgorny/gemato/compare/v14.1...v14.2
Comment 3 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2019-10-25 06:50:35 UTC
Ok, I see that debug-all was a very bad idea.
Comment 4 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2019-10-25 06:53:48 UTC
(In reply to Arve Barsnes from comment #1)
> Seeing a lot of debug output at sync as well. Might be the gemato version,
> on accord of this change:
> https://github.com/mgorny/gemato/commit/
> 3f3f721f559e155e34f0e1a8858639c24a9b44ef

What kind of debug output?  It should all go to log files.
Comment 5 Larry the Git Cow gentoo-dev 2019-10-25 07:56:38 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=12402dd25db307d068617471a7bcf76be58ceb71

commit 12402dd25db307d068617471a7bcf76be58ceb71
Author:     Michał Górny <mgorny@gentoo.org>
AuthorDate: 2019-10-25 07:49:48 +0000
Commit:     Michał Górny <mgorny@gentoo.org>
CommitDate: 2019-10-25 07:56:33 +0000

    app-portage/gemato: Bump to 14.3
    
    Closes: https://bugs.gentoo.org/698446
    Signed-off-by: Michał Górny <mgorny@gentoo.org>

 app-portage/gemato/Manifest           |  1 +
 app-portage/gemato/gemato-14.3.ebuild | 44 +++++++++++++++++++++++++++++++++++
 2 files changed, 45 insertions(+)
Comment 6 Arve Barsnes 2019-10-25 09:10:18 UTC
(In reply to Michał Górny from comment #4)
> (In reply to Arve Barsnes from comment #1)
> > Seeing a lot of debug output at sync as well. Might be the gemato version,
> > on accord of this change:
> > https://github.com/mgorny/gemato/commit/
> > 3f3f721f559e155e34f0e1a8858639c24a9b44ef
> 
> What kind of debug output?  It should all go to log files.

I do my sync through a cron job, might be something sending that file output to my mail report instead somewhere.
Comment 7 Michał Górny archtester Gentoo Infrastructure gentoo-dev Security 2019-10-25 09:13:44 UTC
(In reply to Arve Barsnes from comment #6)
> (In reply to Michał Górny from comment #4)
> > (In reply to Arve Barsnes from comment #1)
> > > Seeing a lot of debug output at sync as well. Might be the gemato version,
> > > on accord of this change:
> > > https://github.com/mgorny/gemato/commit/
> > > 3f3f721f559e155e34f0e1a8858639c24a9b44ef
> > 
> > What kind of debug output?  It should all go to log files.
> 
> I do my sync through a cron job, might be something sending that file output
> to my mail report instead somewhere.

Could you paste me some of that output somewhere?  Possibly file a separate bug for app-crypt/gemato.
Comment 8 Arve Barsnes 2019-10-25 09:38:08 UTC
I didn't get any output now, possibly since I use webrsync and I'm already on the latest daily snapshot. I'll try again after a new snapshot is available.
Comment 9 Arve Barsnes 2019-10-28 06:48:25 UTC
Updating to 14.3 now, but if it's of any interest still, I captured the sync output and put it here: https://pastebin.com/BXtHUXjh

It's all debug output from gpg, so I expect this to also be fixed by your update for my next sync.