Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 695462 - dev-libs/aws-sdk-cpp - euses reports format error in USE descriptions
Summary: dev-libs/aws-sdk-cpp - euses reports format error in USE descriptions
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal QA (vote)
Assignee: Sven Eden
URL:
Whiteboard:
Keywords: PullRequest
Depends on:
Blocks:
 
Reported: 2019-09-23 16:08 UTC by Bob Johnson
Modified: 2019-09-25 06:54 UTC (History)
3 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bob Johnson 2019-09-23 16:08:03 UTC
A portage sync a few days ago resulted in the euses utility reporting a format error in /usr/portage/profiles/use.local.desc.

For example:
$ euses gentoo
dev-java/openjdk:gentoo-vm - Allow this JDK to be recognised by Gentoo (package manager, eselect, java-config, EXPERIMENTAL!)
dev-java/openjdk-bin:gentoo-vm - Allow this JDK to be recognised by Gentoo (package manager, eselect, java-config, EXPERIMENTAL!)
dev-java/openjdk-jre-bin:gentoo-vm - Allow this JDK to be recognised by Gentoo (package manager, eselect, java-config, EXPERIMENTAL!)
dev-java/oracle-jdk-bin:gentoo-vm - Allow this JDK to be recognised by Gentoo (package manager, eselect, java-config, EXPERIMENTAL!)
 * There is a format error in file: use.local.desc
 * on this line:
 that microservice applications run in. AWS Service Quotas : Service for viewing and managing quotas AWS Simple DB (SDB) : A web service providing the core database functions of data indexing and querying in the cloud. AWS Code Signer : Use AWS Signer for FreeRTOS to sign code that you created for any of the IoT devices that Amazon Web Services supports. Server Migration Service: (SMS) Combines data collection tools with automated server replication to speed the migration of on-premises servers to AWS. AWS Snowball : A service to transport terabytes or petabytes of data to and from AWS AWS Systems Manager : (SSM) Organize, monitor, and automate management tasks on AWS resources. AWS Step Functions : (states) A service to coordinate the components of distributed applications and microservices using visual workflows. AWS Storage Gateway : Connect on-premises software with cloud-based storage. Amazon Support : Provides support for users of Amazon Web Services. Simple Workflow Service : (SWF) Build applications sys-apps/portage:gentoo-dev - Enable features required for Gentoo ebuild development.

Removing the dev-libs/aws-sdk-cpp:other USE flag description fixes the issue. Naturally, doing an 'emerge --sync' restores the USE flag description and the error.


Reproducible: Always




# emerge --info
fatal: not a git repository (or any parent up to mount point /usr)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
Portage 2.3.69 (python 2.7.15-final-0, default/linux/amd64/17.1/desktop/plasma, gcc-8.3.0, glibc-2.29-r2, 4.19.72-gentoo x86_64)
=================================================================
System uname: Linux-4.19.72-gentoo-x86_64-Intel-R-_Core-TM-_i5-3570_CPU_@_3.40GHz-with-gentoo-2.6
KiB Mem:    32928768 total,  24706012 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Mon, 23 Sep 2019 15:45:01 +0000
Head commit of repository gentoo: 31c2e69f11691f471e1ec3f52a7e737161b1709e
sh bash 4.4_p23-r1
ld GNU ld (Gentoo 2.32 p2) 2.32.0
app-shells/bash:          4.4_p23-r1::gentoo
dev-java/java-config:     2.2.0-r4::gentoo
dev-lang/perl:            5.28.2-r1::gentoo
dev-lang/python:          2.7.15::gentoo, 3.6.5::gentoo
dev-util/cmake:           3.14.6::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/openrc:          0.41.2::gentoo
sys-apps/sandbox:         2.13::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.11.6-r3::gentoo, 1.15.1-r2::gentoo, 1.16.1-r1::gentoo
sys-devel/binutils:       2.32-r1::gentoo
sys-devel/gcc:            8.3.0-r1::gentoo
sys-devel/gcc-config:     2.0::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 4.20::gentoo (virtual/os-headers)
sys-libs/glibc:           2.29-r2::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.namerica.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-metamanifest: yes
    sync-rsync-extra-opts: 
    sync-rsync-verify-max-age: 24

local
    location: /usr/local/portage
    sync-type: git
    sync-uri: git://localhost/my/repo.git
    masters: gentoo

stefantalpalaru
    location: /var/lib/layman/stefantalpalaru
    sync-type: laymansync
    sync-uri: https://github.com/stefantalpalaru/gentoo-overlay.git
    masters: gentoo
    priority: 50

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE vmware"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/easy-rsa /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.3/ext-active/ /etc/php/cgi-php7.3/ext-active/ /etc/php/cli-php7.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /etc/vmware-installer"
CXXFLAGS="-march=native -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-march=native -O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="en en_US"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acl acpi activities alsa amd64 apache2 berkdb bluetooth branding bzip2 cairo cdda cdr cli colord consolekit crypt cups curl cxx dbus declarative doc dri dts dvd dvdr emboss encode examples exif fam flac fontconfig fortran gcj gd gdbm gif glamor gtk gtk-doc handbook iconv icu ipv6 jack java jbig jpeg kde kipi kpathsea kwallet lcms ldap libnotify libtirpc lzma mad mbox mng mp3 mp4 mpeg multilib ncurses nls nptl odbc ogg openexr opengl openmp pam pango pcre pdf phonon plasma png policykit postgres ppds qml qt5 readline sdl seccomp semantic-desktop source spell split-usr ssl startup-notification svg t1lib tcpd threads tiff truetype udev udisks unicode upower usb vim-syntax vorbis webp widgets wxwidgets x264 xattr xcb xcomposite xinerama xml xpm xv xvid zlib" ABI_X86="64 32" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_core authn_dbd authn_dbm authn_default authn_file authz_core authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgid dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers http2 ident imagemap include info lbmethod_byrequests log_config log_forensic logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif slotmem_shm socache_shmcb speling status unique_id unixd userdir usertrack vhost_alias" APACHE2_MPMS="worker" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="canon" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="keyboard mouse evdev vmmouse wacom joystick" KERNEL="linux" L10N="en en-US" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="nlpsolver presenter-minimizer wiki-publisher" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-3" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" RUBY_TARGETS="ruby24 ruby25" SANE_BACKENDS="epson2" USERLAND="GNU" VIDEO_CARDS="amdgpu fbdev intel r600 radeon radeonsi vesa vmware" XFCE_PLUGINS="clock trash" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, MAKEOPTS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Jeroen Roovers (RETIRED) gentoo-dev 2019-09-24 07:10:21 UTC
https://projects.gentoo.org/pms/latest/pms.html#x1-350004.4.3 prescribes USE flag descriptions as line-based, and metadata.xml for the dev-libs/aws-sdk-cpp does not adhere to that requirement.
Comment 2 Joonas Niilola gentoo-dev 2019-09-24 14:00:17 UTC
Sven, see the PMS requirement about metadata USE length above before fixing it.
Comment 3 Sven Eden 2019-09-24 16:35:35 UTC
(In reply to Jeroen Roovers from comment #1)
> https://projects.gentoo.org/pms/latest/pms.html#x1-350004.4.3 prescribes USE
> flag descriptions as line-based, and metadata.xml for the
> dev-libs/aws-sdk-cpp does not adhere to that requirement.

Well, the part you linked to says:
"It is a line-based file with the standard rules for comments and blank lines."

There is no hint about the length, which is the problem here. app-portage/ufed hit the same problem: The line is too long. (Yes, that USE flag is a one-liner in use.local.desc, so it is legal according to the PMS.)

But apart from the programs having to simply cut overly long lines, there is nothing wrong with the metadata.xml. There is no rule about a maximum line length, and every content of any tag can have multiple lines.
The metadata.xml in question follows GLEP-68: https://www.gentoo.org/glep/glep-0068.html ; which explicitly allows multi-line text data.

"repoman full" is also absolutely happy with my metadata.xml file, and "equery u" renders all flags quite nicely.

Before you get mad at me: I will shorten it. I think for those modules it is completely in order to have only their names listed.
Comment 4 Larry the Git Cow gentoo-dev 2019-09-25 02:58:52 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=4a7621add86917245ae0e0e40ca7110894428a94

commit 4a7621add86917245ae0e0e40ca7110894428a94
Author:     Sven Eden <yamakuzure@gmx.net>
AuthorDate: 2019-09-24 18:15:54 +0000
Commit:     Joonas Niilola <juippis@gentoo.org>
CommitDate: 2019-09-25 02:58:30 +0000

    dev-libs/aws-sdk-cpp: Shorten the 'other' USE flag description
    
    Unfortunately that description is way too long. It has over 5k characters,
    which is too much, at least for app-portage/ufed and app-portage/euses.
    
    This commit throws away the lengthy description of each module and replaces
    them with a mere list of the modules. As these are supposed to be rarely used
    modules anyway, this shouldn't be a problem. If any of the modules is requested
    to get its own USE flag, we can re-add its proper description.
    
    Bug: https://bugs.gentoo.org/695262
    Bug: https://bugs.gentoo.org/695462
    Package-Manager: Portage-2.3.76, Repoman-2.3.17
    Signed-off-by: Sven Eden <yamakuzure@gmx.net>
    Closes: https://github.com/gentoo/gentoo/pull/13030
    Signed-off-by: Joonas Niilola <juippis@gentoo.org>

 dev-libs/aws-sdk-cpp/metadata.xml | 76 ++++-----------------------------------
 1 file changed, 6 insertions(+), 70 deletions(-)
Comment 5 Sven Eden 2019-09-25 06:54:10 UTC
So, the offending USE flag was shortened and the problem should go away.

Please note: This is a workaround. The real bug here is euses not checking its input correctly. It is the same problem that app-portage/ufed had, which I fixed.

While this bug is now RESOLVED/FIXED, euses should be fixed, too.

(But that's, of course, just my opinion. ;-) )