As a rough measure of comparison: # equery depends virtual/pypy3 | wc -l 111 # q depends -vQ virtual/pypy3 | wc -l 71 One example: # equery depends virtual/pypy3 | grep werkzeug dev-python/werkzeug-0.14.1 # q depends -vQ virtual/pypy3 | grep werkzeug <no output> Complete lists attached. Reproducible: Always Portage 2.3.62 (python 3.6.8-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-8.3.0, glibc-2.28-r5, 5.0.5-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-5.0.5-gentoo-x86_64-AMD_Ryzen_5_2400G_with_Radeon_Vega_Graphics-with-gentoo-2.6 KiB Mem: 14159324 total, 938468 free KiB Swap: 16777212 total, 16343548 free Timestamp of repository gentoo: Sat, 30 Mar 2019 08:45:01 +0000 Head commit of repository gentoo: 4140879fe20ea363b54c14d5c87d2d11719adb0d Head commit of repository flatpak-overlay: 9b10ab851b5ab660deca16595438d751c4419880 Head commit of repository local: 34efa53c895cc3a7a6107eb762f5ad2abbcd7a21 sh bash 5.0_p3-r1 ld GNU gold (Gentoo 2.32 p1 2.32.0) 1.16 ccache version 3.6 [disabled] app-shells/bash: 5.0_p3-r1::gentoo dev-java/java-config: 2.2.0-r4::gentoo dev-lang/perl: 5.28.0::gentoo dev-lang/python: 2.7.16::gentoo, 3.6.8::gentoo, 3.7.2::gentoo dev-util/ccache: 3.6::gentoo dev-util/cmake: 3.14.0::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.6-r1::gentoo sys-apps/sandbox: 2.17::gentoo sys-devel/autoconf: 2.13-r1::gentoo, 2.69-r4::gentoo sys-devel/automake: 1.11.6-r3::gentoo, 1.13.4-r2::gentoo, 1.16.1-r1::gentoo sys-devel/binutils: 2.32::gentoo sys-devel/gcc: 8.3.0::gentoo sys-devel/gcc-config: 2.0::gentoo sys-devel/libtool: 2.4.6-r5::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 5.0-r1::gentoo (virtual/os-headers) sys-libs/glibc: 2.28-r5::gentoo Repositories: gentoo location: /var/cache/portage/gentoo sync-type: rsync sync-uri: rsync://rsync.de.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-jobs: 1 sync-rsync-extra-opts: sync-rsync-verify-max-age: 24 sync-rsync-verify-metamanifest: yes flatpak-overlay location: /var/db/repos/flatpak-overlay sync-type: git sync-uri: https://github.com/fosero/flatpak-overlay.git masters: gentoo local location: /var/cache/portage/local sync-type: git sync-uri: https://github.com/devurandom/gentoo-overlay.git masters: gentoo priority: 1000 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-pipe -O2 -march=znver1" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /etc/grs/systems.conf /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/maven-bin-3.6/conf" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.3/ext-active/ /etc/php/cgi-php7.3/ext-active/ /etc/php/cli-php7.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-pipe -O2 -march=znver1" DISTDIR="/var/cache/portage/distfiles" EMERGE_DEFAULT_OPTS="--keep-going --nospinner --verbose-conflicts" ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildsyspkg cgroup compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="en_GB.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu" MAKEOPTS="-j6 -l4" PKGDIR="/var/cache/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/tmp" USE="7z 7zip X a52 aac aacplus aacs acl acpi activities aio alsa amd64 appindicator appstream archive audit avahi ayatana bash-completion bdplus berkdb bluetooth bluray branding brotli bs2b btrfs bzip2 cairo caps cdda cddb cdio cdr celt chromaprint cjk clang cli clipboard colord colorio conntrack crypt cups cxx d3d9 dbus declarative device-mapper dirac djvu dri drm dts dvb dvd dvdr editorconfig egl elf emboss encode epub exif fam faudio fax fbcon ffmpeg fftw filecaps firefox firewalld fish-completion fits flac fontconfig fontforge fortran fribidi gbm gdbm geoclue geolocation gif git glamor gles gmp gnupg google googledrive gpg gps graphicsmagick gstreamer gtk gtk3 gzip harfbuzz hdf5 heif http2 ibus iconv icu idn imlib inotify introspection ipv6 jemalloc jpeg jpeg2k json kde kipi kms kwallet ladspa latex lcms ldap libatomic libglvnd libidn2 libinput libnotify libproxy libsecret libsoxr libtirpc libvirt lm_sensors lrz lv2 lvm lz4 lzma lzo mad markdown mbim mercurial mjpeg mng mobi modemmanager modplug mp3 mp4 mpeg mplayer mpris mtp multilib mysql ncurses netlink networkmanager nls nptl office ofx ogg openal opencl opencv openexr opengl openh264 openmax openmp opus pam pango pcap pch pcre pcre2 pdf pgo phonon pixman plasma png policykit postscript ppds prison pulseaudio python qml qt5 rar raw readline redfish samba sasl scanner schroedinger sctp sdl sdl2 seccomp semantic-desktop share snappy sparse speech speex spell ssl startup-notification steamruntime stemmer svg systemd systemtap tbb tcpd teamd telepathy tga theora threads tiff timezone truetype tslib udev udisks unicode unwind upnp upnp-av upower usb utempter v4l v4l2 vaapi vdpau vkd3d vorbis vpx vulkan wasm wavpack wayland webchannel webengine webkit webp widgets wmf wps x264 x265 xattr xcb xcomposite xinerama xkb xml xmp xrandr xscreensaver xv xvid xwayland xz yaml zeroconf zeromq zlib zstd" ABI_X86="64" ALSA_CARDS="hda-intel" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" ENLIGHTENMENT_MODULES="*" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="joystick libinput" KERNEL="linux" L10N="de de-DE en en-GB ar fa tr ja ko zh zh-CN zh-TW" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LIRC_DEVICES="devinput" LLVM_TARGETS="AMDGPU BPF RISCV WebAssembly" LUA_TARGET="lua5-2" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-1" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6 pypy pypy3" QEMU_SOFTMMU_TARGETS="riscv32 riscv64 x86_64" QEMU_USER_TARGETS="riscv32 riscv64" RUBY_TARGETS="ruby24" STEAMGAMES="dirt_rally dont_starve portal source_engine te120 trine2 witcher2" USERLAND="GNU" VIDEO_CARDS="amdgpu virgl" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= app-portage/portage-utils-0.74::gentoo was built with the following: USE="nls -static" ABI_X86="(64)"
Created attachment 571236 [details] equery depends virtual/pypy3
Created attachment 571238 [details] q depends -vQ virtual/pypy3
`emerge --update --deep --changed-use --newuse @world` also has problems rebuilding the tree, complaining about installed packages depending on virtual/pypy3-7.0.0:0/71 (instead of virtual/pypy3-7.1.0:0/71-py36), conflicting with installed (in a previous emerge run) or to-be-installed packages depending on virtual/pypy3-7.1.0:0/71-py36. Maybe the two issues are related?
would you happen to have another example package? I don't have pypy installed at the moment
I suspect this is a dupe of https://bugs.gentoo.org/668418 Could you check if the example there works for you?
I can reproduce using virtual/perl-Data-Dumper, digging now
(In reply to Fabian Groffen from comment #5) > I suspect this is a dupe of https://bugs.gentoo.org/668418 > > Could you check if the example there works for you? bug #668418 is supposed to be fixed in app-portage/portage-utils-0.74, which I have installed. In the comments, -a was recommended to search not only build-time dependencies, but that still does not explain the discrepancy between equery depends and q depends: $ equery depends virtual/pypy3 | wc -l 111 $ q depends -vaQ virtual/pypy3 | wc -l 183 But at least werkzeug appears in the output when using -a: $ q depends -vaQ virtual/pypy3 | rg werkzeug dev-python/werkzeug-0.14.1: >=virtual/pypy3-5:0/71-py36=
equery and qdepends behave differently regarding *DEPEND. It seems that equery queries all *DEPEND, whereas qdepends makes a difference between DEPEND, RDEPEND, PDEPEND and BDEPEND. Now if you use -a you get "double" output, e.g.: % ./q depends -avQ virtual/perl-Data-Dumper * DEPEND dev-perl/Module-Build-0.422.400: virtual/perl-Data-Dumper * RDEPEND dev-perl/Module-Build-0.422.400: virtual/perl-Data-Dumper * PDEPEND dev-lang/perl-5.28.0: >=virtual/perl-Data-Dumper-2.154.0 * BDEPEND % That explains why you see more matches with -a than equery. Perhaps I can add an option that prints the unique matches per package which would match more or less equery's output.
(In reply to Fabian Groffen from comment #8) > equery and qdepends behave differently regarding *DEPEND. > > It seems that equery queries all *DEPEND, whereas qdepends makes a > difference between DEPEND, RDEPEND, PDEPEND and BDEPEND. > > Now if you use -a you get "double" output, e.g.: > > % ./q depends -avQ virtual/perl-Data-Dumper > * DEPEND > dev-perl/Module-Build-0.422.400: virtual/perl-Data-Dumper > * RDEPEND > dev-perl/Module-Build-0.422.400: virtual/perl-Data-Dumper > * PDEPEND > dev-lang/perl-5.28.0: >=virtual/perl-Data-Dumper-2.154.0 > * BDEPEND > % > > That explains why you see more matches with -a than equery. Perhaps I can > add an option that prints the unique matches per package which would match > more or less equery's output. Thanks. I did not notice. With that knowledge I get: $ equery depends virtual/pypy3 | tail -n+2 | cut -d' ' -f1 | wc -l 109 $ q depends -vaQ virtual/pypy3 | rg -v '^ \*' | cut -d: -f1 | sort -u | wc -l 108 The diff is: --- equery-depends.log 2019-03-30 21:23:48.434152292 +0100 +++ qdepends.log 2019-03-30 21:23:55.717481404 +0100 @@ -1,6 +1,7 @@ dev-python/appdirs-1.4.3 dev-python/asn1crypto-0.24.0 dev-python/attrs-18.2.0 +dev-python/Babel-2.6.0 dev-python/backports-1.0 dev-python/backports-abc-0.5 dev-python/bleach-3.1.0 @@ -98,8 +99,6 @@ dev-python/werkzeug-0.14.1 dev-python/xmltodict-0.11.0 dev-python/zope-interface-4.6.0 -net-im/profanity-0.5.1 -sys-process/systemd-cron-1.5.12-r1 virtual/python-cffi-0 virtual/python-enum34-2 virtual/python-futures-1
Babel seems to have genuine pypy3 support, so it appears to me as a valid match for your query (by qdepends). Out of curiosity, does equery depgraph list pypy3 as dep for dev-python/Babel-2.6.0? Do you have - net-im/profanity-0.5.1 - sys-process/systemd-cron-1.5.12-r1 installed? If so, could paste the contents of /var/pkg/db/<cat>/<p>/*DEPEND for either?
$ equery depgraph -AMU dev-python/Babel-2.6.0 * Searching for Babel2.6.0 in dev-python ... * dependency graph for dev-python/Babel-2.6.0 `-- dev-python/Babel-2.6.0 `-- dev-python/sphinx-1.7.5-r1 `-- dev-python/freezegun-0.3.11 `-- dev-python/pytest-4.3.1 `-- dev-python/pytz-2018.4 `-- dev-python/setuptools-40.8.0 `-- virtual/pypy-7.1.0 `-- virtual/pypy3-7.1.0 `-- dev-lang/python-2.7.16 `-- dev-lang/python-3.5.7 `-- dev-lang/python-3.6.8 `-- dev-lang/python-3.7.3 `-- dev-lang/python-exec-2.4.6 [ dev-python/Babel-2.6.0 stats: packages (13), max depth (1) ] /var/db/pkg/net-im/profanity-0.5.1/DEPEND: net-libs/libstrophe:0/0.8= net-misc/curl >=dev-libs/glib-2.26:2 sys-libs/ncurses:0/6=[unicode] dev-libs/openssl:0/1.1= sys-apps/util-linux sys-libs/readline:0/8= >=x11-libs/gtk+-2.24.10:2 x11-libs/libnotify net-libs/libotr app-crypt/gpgme:1/11= x11-libs/libXScrnSaver x11-libs/libX11 dev-lang/python:3.6 >=dev-lang/python-exec-2:2/2=[python_targets_pypy(-),python_targets_pypy3(-),python_targets_python2_7(-),python_targets_python3_6(-),-python_single_target_jython2_7(-),python_single_target_python3_6(+)] /var/db/pkg/net-im/profanity-0.5.1/RDEPEND: net-libs/libstrophe:0/0.8= net-misc/curl >=dev-libs/glib-2.26:2 sys-libs/ncurses:0/6=[unicode] dev-libs/openssl:0/1.1= sys-apps/util-linux sys-libs/readline:0/8= >=x11-libs/gtk+-2.24.10:2 x11-libs/libnotify net-libs/libotr app-crypt/gpgme:1/11= x11-libs/libXScrnSaver x11-libs/libX11 dev-lang/python:3.6 >=dev-lang/python-exec-2:2/2=[python_targets_pypy(-),python_targets_pypy3(-),python_targets_python2_7(-),python_targets_python3_6(-),-python_single_target_jython2_7(-),python_single_target_python3_6(+)] /var/db/pkg/sys-process/systemd-cron-1.5.12-r1/DEPEND: sys-process/cronbase virtual/pkgconfig /var/db/pkg/sys-process/systemd-cron-1.5.12-r1/RDEPEND: >=sys-apps/systemd-217 sys-apps/debianutils !sys-process/dcron dev-lang/python:3.6 >=dev-lang/python-exec-2:2/2=[python_targets_pypy3(-),python_targets_python3_6(-),-python_single_target_jython2_7(-),-python_single_target_pypy(-),-python_single_target_python2_7(-),-python_single_target_python3_7(-),python_single_target_python3_6(+)] sys-process/cronbase
(In reply to Dennis Schridde from comment #11) > $ equery depgraph -AMU dev-python/Babel-2.6.0 > * Searching for Babel2.6.0 in dev-python ... > > * dependency graph for dev-python/Babel-2.6.0 > `-- dev-python/Babel-2.6.0 > `-- dev-python/sphinx-1.7.5-r1 > `-- dev-python/freezegun-0.3.11 > `-- dev-python/pytest-4.3.1 > `-- dev-python/pytz-2018.4 > `-- dev-python/setuptools-40.8.0 > `-- virtual/pypy-7.1.0 > `-- virtual/pypy3-7.1.0 > `-- dev-lang/python-2.7.16 > `-- dev-lang/python-3.5.7 > `-- dev-lang/python-3.6.8 > `-- dev-lang/python-3.7.3 > `-- dev-lang/python-exec-2.4.6 > [ dev-python/Babel-2.6.0 stats: packages (13), max depth (1) ] This suggests qdepends is right here, IMO. > /var/db/pkg/net-im/profanity-0.5.1/DEPEND: > net-libs/libstrophe:0/0.8= net-misc/curl >=dev-libs/glib-2.26:2 > sys-libs/ncurses:0/6=[unicode] dev-libs/openssl:0/1.1= sys-apps/util-linux > sys-libs/readline:0/8= >=x11-libs/gtk+-2.24.10:2 x11-libs/libnotify > net-libs/libotr app-crypt/gpgme:1/11= x11-libs/libXScrnSaver x11-libs/libX11 > dev-lang/python:3.6 > >=dev-lang/python-exec-2:2/2=[python_targets_pypy(-),python_targets_pypy3(-), > python_targets_python2_7(-),python_targets_python3_6(-),- > python_single_target_jython2_7(-),python_single_target_python3_6(+)] > /var/db/pkg/net-im/profanity-0.5.1/RDEPEND: > net-libs/libstrophe:0/0.8= net-misc/curl >=dev-libs/glib-2.26:2 > sys-libs/ncurses:0/6=[unicode] dev-libs/openssl:0/1.1= sys-apps/util-linux > sys-libs/readline:0/8= >=x11-libs/gtk+-2.24.10:2 x11-libs/libnotify > net-libs/libotr app-crypt/gpgme:1/11= x11-libs/libXScrnSaver x11-libs/libX11 > dev-lang/python:3.6 > >=dev-lang/python-exec-2:2/2=[python_targets_pypy(-),python_targets_pypy3(-), > python_targets_python2_7(-),python_targets_python3_6(-),- > python_single_target_jython2_7(-),python_single_target_python3_6(+)] I don't see a mention of virtual/pypy3 in here. It may have not existed when you originally merged the package? In any case, this is the reason why qdepends doesn't list it, it only looks at var/db/pkg, not the ebuild tree. > /var/db/pkg/sys-process/systemd-cron-1.5.12-r1/DEPEND: > sys-process/cronbase virtual/pkgconfig > /var/db/pkg/sys-process/systemd-cron-1.5.12-r1/RDEPEND: > >=sys-apps/systemd-217 sys-apps/debianutils !sys-process/dcron dev-lang/python:3.6 >=dev-lang/python-exec-2:2/2=[python_targets_pypy3(-),python_targets_python3_6(-),-python_single_target_jython2_7(-),-python_single_target_pypy(-),-python_single_target_python2_7(-),-python_single_target_python3_7(-),python_single_target_python3_6(+)] sys-process/cronbase Same here, no mention of virtual/pypy3.
(In reply to Fabian Groffen from comment #6) > I can reproduce using virtual/perl-Data-Dumper, digging now (In reply to Fabian Groffen from comment #12) > [...] So is there an actual bug, or shall we close this report and just note that people should use `q depends -aQ` and a combination of `grep` / `cut` / `sort` / `uniq` to create their list of dependencies?
(In reply to Dennis Schridde from comment #13) > (In reply to Fabian Groffen from comment #6) > > I can reproduce using virtual/perl-Data-Dumper, digging now > > (In reply to Fabian Groffen from comment #12) > > [...] > > So is there an actual bug, or shall we close this report and just note that > people should use `q depends -aQ` and a combination of `grep` / `cut` / > `sort` / `uniq` to create their list of dependencies? I don't see an actual bug. But I'll take this bug as feature request to have qdepends print all dependencies in one go in some way, so the sorting and cutting is no longer necessary.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/proj/portage-utils.git/commit/?id=f74766218c33e762e272f9f0129128a9f8ffd4a9 commit f74766218c33e762e272f9f0129128a9f8ffd4a9 Author: Fabian Groffen <grobian@gentoo.org> AuthorDate: 2019-04-07 20:15:31 +0000 Commit: Fabian Groffen <grobian@gentoo.org> CommitDate: 2019-04-07 20:15:31 +0000 qdepends: rewrite to better match forward/backward dependencies - dep: extract dependency functions into separate files for later reuse - by default, report all deps for all *DEPEND combined (duplicates removed) - allow listing per *DEPEND using -v, pretty-print and highlight the atoms seleted or queried for (-Q) - support reverse querying multiple atoms - make -Q output match forward output, highlight the match, to just print the match, use -q Bug: https://bugs.gentoo.org/682056 Signed-off-by: Fabian Groffen <grobian@gentoo.org> TODO.md | 3 + libq/Makefile.am | 1 + libq/Makefile.in | 11 +- libq/dep.c | 334 +++++++++++++++++++ libq/dep.h | 54 ++++ libq/set.c | 22 +- libq/set.h | 1 + qdepends.c | 776 +++++++++++---------------------------------- tests/qdepends/dotest | 11 + tests/qdepends/list02.good | 2 +- tests/qdepends/list03.good | 6 +- tests/qdepends/list04.good | 6 +- tests/qdepends/list05.good | 16 +- tests/qdepends/list06.good | 2 +- tests/qdepends/list07.good | 2 +- tests/qdepends/list08.good | 2 +- 16 files changed, 639 insertions(+), 610 deletions(-)
this is available onwards from 0.80_pre*
