Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 618334 - dev-ros/std_srvs-1.11.2 build failure
Summary: dev-ros/std_srvs-1.11.2 build failure
Status: RESOLVED TEST-REQUEST
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Robot Operating System team
URL:
Whiteboard:
Keywords:
: 618336 (view as bug list)
Depends on:
Blocks:
 
Reported: 2017-05-13 06:22 UTC by Alessandro Barbieri
Modified: 2020-07-29 12:45 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
info genpy (file_618334.txt,14.32 KB, text/plain)
2017-05-15 13:43 UTC, Alessandro Barbieri
Details
dev-ros:genpy-0.6.5:20170511-170009.log (dev-ros:genpy-0.6.5:20170511-170009.log,58.34 KB, text/plain)
2017-05-15 13:49 UTC, Alessandro Barbieri
Details
dev-ros:genpy-0.6.5:20170515-140545.log (dev-ros:genpy-0.6.5:20170515-140545.log,59.94 KB, text/plain)
2017-05-15 14:16 UTC, Alessandro Barbieri
Details
dev-ros:std_srvs-1.11.2:20170515-141750.log (dev-ros:std_srvs-1.11.2:20170515-141750.log,49.71 KB, text/plain)
2017-05-15 14:27 UTC, Alessandro Barbieri
Details
dev-ros:std_srvs-1.11.2:20170515-171243.log (dev-ros:std_srvs-1.11.2:20170515-171243.log,42.98 KB, text/plain)
2017-05-15 17:48 UTC, Alessandro Barbieri
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Alessandro Barbieri 2017-05-13 06:22:34 UTC
info and buildlog here
https://gist.github.com/188a544b961c93fc88b9945ee446b368

build fails with:

[ 23%] Generating Python code from SRV std_srvs/Empty
catkin_generated/env_cached.sh /usr/bin/pypy /usr/share/genpy/cmake/../../../libexec/genpy/gensrv_py.py /var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs/srv/Empty.srv -p std_srvs -o /var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy/devel/lib64/pypy/site-packages/std_srvs/srv
Traceback (most recent call last):
  File "/usr/share/genpy/cmake/../../../libexec/genpy/gensrv_py.py", line 43, in <module>
    import genpy.generator
ImportError: No module named genpy
make[2]: *** [CMakeFiles/std_srvs_generate_messages_py.dir/build.make:65: devel/lib64/pypy/site-packages/std_srvs/srv/_Empty.py] Error 1
make[2]: Leaving directory '/var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy'
make[1]: *** [CMakeFiles/Makefile2:535: CMakeFiles/std_srvs_generate_messages_py.dir/all] Error 2
make[1]: Leaving directory '/var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy'
make: *** [Makefile:128: all] Error 2
 * ERROR: dev-ros/std_srvs-1.11.2::gentoo failed (compile phase):
 *   emake failed
Comment 1 Jonas Stein gentoo-dev 2017-05-13 10:40:44 UTC
Alessandro, the gists are useful, but you can improve your tickets by attaching this information to the ticket.

* many developers use sripts and tools, which can access attachments directly
* it is good to have all information archived in the ticket system. The gists are not permanent. We do not want to loose information, when github changes its service as other repositories did recently [1]
* perhaps you are interested in www-client/pybugz

[1] https://wiki.gentoo.org/wiki/Upstream_repository_shutdowns
Comment 2 Alessandro Barbieri 2017-05-13 21:31:42 UTC
Thank you, pybugz is the tool I was searching for
Comment 3 Alexis Ballier gentoo-dev 2017-05-14 17:08:22 UTC
dont you have dev-ros/genpy[python_targets_pypy] installed ? it should depend on it
Comment 4 Alessandro Barbieri 2017-05-14 17:48:51 UTC
Yes I have it.
Comment 5 Alexis Ballier gentoo-dev 2017-05-15 07:21:09 UTC
what pypy files does genpy install ?

( equery files genpy | grep pypy )
Comment 6 Alessandro Barbieri 2017-05-15 13:15:10 UTC
no files ...

/usr
/usr/etc
/usr/etc/ros
/usr/etc/ros/genmsg
/usr/etc/ros/genmsg/genpy
/usr/lib64
/usr/lib64/pkgconfig
/usr/lib64/pkgconfig/genpy.pc
/usr/lib64/python2.7
/usr/lib64/python2.7/site-packages
/usr/lib64/python2.7/site-packages/genpy
/usr/lib64/python2.7/site-packages/genpy-0.6.5-py2.7.egg-info
/usr/lib64/python2.7/site-packages/genpy/__init__.py
/usr/lib64/python2.7/site-packages/genpy/base.py
/usr/lib64/python2.7/site-packages/genpy/dynamic.py
/usr/lib64/python2.7/site-packages/genpy/generate_initpy.py
/usr/lib64/python2.7/site-packages/genpy/generate_numpy.py
/usr/lib64/python2.7/site-packages/genpy/generate_struct.py
/usr/lib64/python2.7/site-packages/genpy/generator.py
/usr/lib64/python2.7/site-packages/genpy/genpy_main.py
/usr/lib64/python2.7/site-packages/genpy/message.py
/usr/lib64/python2.7/site-packages/genpy/rostime.py
/usr/lib64/python3.3
/usr/lib64/python3.3/site-packages
/usr/lib64/python3.3/site-packages/genpy
/usr/lib64/python3.3/site-packages/genpy-0.6.5-py3.3.egg-info
/usr/lib64/python3.3/site-packages/genpy/__init__.py
/usr/lib64/python3.3/site-packages/genpy/base.py
/usr/lib64/python3.3/site-packages/genpy/dynamic.py
/usr/lib64/python3.3/site-packages/genpy/generate_initpy.py
/usr/lib64/python3.3/site-packages/genpy/generate_numpy.py
/usr/lib64/python3.3/site-packages/genpy/generate_struct.py
/usr/lib64/python3.3/site-packages/genpy/generator.py
/usr/lib64/python3.3/site-packages/genpy/genpy_main.py
/usr/lib64/python3.3/site-packages/genpy/message.py
/usr/lib64/python3.3/site-packages/genpy/rostime.py
/usr/lib64/python3.4
/usr/lib64/python3.4/site-packages
/usr/lib64/python3.4/site-packages/genpy
/usr/lib64/python3.4/site-packages/genpy-0.6.5-py3.4.egg-info
/usr/lib64/python3.4/site-packages/genpy/__init__.py
/usr/lib64/python3.4/site-packages/genpy/base.py
/usr/lib64/python3.4/site-packages/genpy/dynamic.py
/usr/lib64/python3.4/site-packages/genpy/generate_initpy.py
/usr/lib64/python3.4/site-packages/genpy/generate_numpy.py
/usr/lib64/python3.4/site-packages/genpy/generate_struct.py
/usr/lib64/python3.4/site-packages/genpy/generator.py
/usr/lib64/python3.4/site-packages/genpy/genpy_main.py
/usr/lib64/python3.4/site-packages/genpy/message.py
/usr/lib64/python3.4/site-packages/genpy/rostime.py
/usr/lib64/python3.5
/usr/lib64/python3.5/site-packages
/usr/lib64/python3.5/site-packages/genpy
/usr/lib64/python3.5/site-packages/genpy-0.6.5-py3.5.egg-info
/usr/lib64/python3.5/site-packages/genpy/__init__.py
/usr/lib64/python3.5/site-packages/genpy/base.py
/usr/lib64/python3.5/site-packages/genpy/dynamic.py
/usr/lib64/python3.5/site-packages/genpy/generate_initpy.py
/usr/lib64/python3.5/site-packages/genpy/generate_numpy.py
/usr/lib64/python3.5/site-packages/genpy/generate_struct.py
/usr/lib64/python3.5/site-packages/genpy/generator.py
/usr/lib64/python3.5/site-packages/genpy/genpy_main.py
/usr/lib64/python3.5/site-packages/genpy/message.py
/usr/lib64/python3.5/site-packages/genpy/rostime.py
/usr/libexec
/usr/libexec/genpy
/usr/libexec/genpy/genmsg_py.py
/usr/libexec/genpy/gensrv_py.py
/usr/share
/usr/share/doc
/usr/share/doc/genpy-0.6.5
/usr/share/doc/genpy-0.6.5/README.md
/usr/share/genpy
/usr/share/genpy/cmake
/usr/share/genpy/cmake/genpy-extras.cmake
/usr/share/genpy/cmake/genpyConfig-version.cmake
/usr/share/genpy/cmake/genpyConfig.cmake
/usr/share/genpy/package.xml
/usr/share/ros_packages
/usr/share/ros_packages/genpy
/usr/share/ros_packages/genpy/package.xml
Comment 7 Alexis Ballier gentoo-dev 2017-05-15 13:24:39 UTC
(In reply to Alexis Ballier from comment #3)
> dont you have dev-ros/genpy[python_targets_pypy] installed ? it should
> depend on it

(In reply to Alessandro Barbieri from comment #4)
> Yes I have it.

(In reply to Alessandro Barbieri from comment #6)
> no files ...

then no, you don't have pypy in genpy; please post 'emerge -pvO genpy' output and if that contains pypy python target then attach its build log as there seems to be something wrong there
Comment 8 Alessandro Barbieri 2017-05-15 13:43:44 UTC
Created attachment 472650 [details]
info genpy

dev-ros/genpy-0.6.5::gentoo was built with the following:
USE="-test" PYTHON_TARGETS="pypy pypy3 python2_7 python3_4 python3_5 -python3_6"
Comment 9 Alessandro Barbieri 2017-05-15 13:49:27 UTC
Created attachment 472652 [details]
dev-ros:genpy-0.6.5:20170511-170009.log

build log
Comment 10 Alexis Ballier gentoo-dev 2017-05-15 13:53:41 UTC
(In reply to Alessandro Barbieri from comment #9)
> Created attachment 472652 [details]
> dev-ros:genpy-0.6.5:20170511-170009.log
> 
> build log

compile phase contains this and it should not:


Re-run cmake file: Makefile older than: /usr/share/geneus/cmake/geneus-extras.cmake



please fix your clock or re-install geneus with proper mtime and repost a fixed build log
Comment 11 Alessandro Barbieri 2017-05-15 14:16:01 UTC
Created attachment 472654 [details]
dev-ros:genpy-0.6.5:20170515-140545.log

build log fixed
Comment 12 Alessandro Barbieri 2017-05-15 14:27:07 UTC
Rebuilding dev-ros/std_srvs gave me this

[ 76%] Built target std_srvs_generate_messages_cpp
Traceback (most recent call last):
  File "//usr/lib64/pypy/site-packages/geneus/geneus_main.py", line 137, in genmain
    pkg_map = get_pkg_map()
  File "//usr/lib64/pypy/site-packages/geneus/geneus_main.py", line 56, in get_pkg_map
    pkgs = packages.find_packages(ws)
  File "//usr/lib64/pypy/site-packages/catkin_pkg/packages.py", line 94, in find_packages
    raise RuntimeError('\n'.join(duplicates))
RuntimeError: Multiple packages found with the same name "rosgraph_msgs":
- local/gentoo/usr/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/rosgraph_msgs
- tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/rosgraph_msgs
Multiple packages found with the same name "std_srvs":
- local/gentoo/usr/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs
- tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs
ERROR:  Multiple packages found with the same name "rosgraph_msgs":
- local/gentoo/usr/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/rosgraph_msgs
- tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/rosgraph_msgs
Multiple packages found with the same name "std_srvs":
- local/gentoo/usr/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs
- tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs
make[2]: *** [CMakeFiles/std_srvs_generate_messages_eus.dir/build.make:79: devel/share/roseus/ros/std_srvs/manifest.l] Error 3
make[2]: Leaving directory '/var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy'
make[1]: *** [CMakeFiles/Makefile2:230: CMakeFiles/std_srvs_generate_messages_eus.dir/all] Error 2
make[1]: Leaving directory '/var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy'
make: *** [Makefile:128: all] Error 2
Comment 13 Alessandro Barbieri 2017-05-15 14:27:50 UTC
Created attachment 472656 [details]
dev-ros:std_srvs-1.11.2:20170515-141750.log

build log std_srv new
Comment 14 Alexis Ballier gentoo-dev 2017-05-15 14:32:17 UTC
  File "/usr/share/genlisp/cmake/../../../libexec/genlisp/gen_lisp.py", line 39, in <module>
    import genlisp
ImportError: No module named genlisp



I guess you'll have to rebuild at the very least dev-ros/gen* since those got installed improperly due to your mtime issue; this time genlisp is failing the same way
Comment 15 Alessandro Barbieri 2017-05-15 16:11:57 UTC
Rebuilt n times genpy, all of ros, gen*, and std_msgs and the problem(s) is(are) still here.

Meanwhile I found a funny thing

locate python3.3
/usr/lib64/python3.3
/usr/lib64/python3.3/site-packages
/usr/lib64/python3.3/site-packages/genlisp
/usr/lib64/python3.3/site-packages/genlisp-0.4.16-py3.3.egg-info
/usr/lib64/python3.3/site-packages/gennodejs
/usr/lib64/python3.3/site-packages/gennodejs-2.0.1-py3.3.egg-info
/usr/lib64/python3.3/site-packages/genpy
/usr/lib64/python3.3/site-packages/genpy-0.6.5-py3.3.egg-info
/usr/lib64/python3.3/site-packages/genpy/__init__.py
/usr/lib64/python3.3/site-packages/genpy/base.py
/usr/lib64/python3.3/site-packages/genpy/dynamic.py
/usr/lib64/python3.3/site-packages/genpy/generate_initpy.py
/usr/lib64/python3.3/site-packages/genpy/generate_numpy.py
/usr/lib64/python3.3/site-packages/genpy/generate_struct.py
/usr/lib64/python3.3/site-packages/genpy/generator.py
/usr/lib64/python3.3/site-packages/genpy/genpy_main.py
/usr/lib64/python3.3/site-packages/genpy/message.py
/usr/lib64/python3.3/site-packages/genpy/rostime.py
/usr/portage/dev-python/docutils/files/docutils-0.11-python3.3-odt-writer.patch
/usr/portage/dev-python/progressbar/files/progressbar-2.3-python3.3.patch
/usr/portage/dev-python/pycallgraph/files/python3.3-tests.patch

but in genpy-0.6.5.ebuild

PYTHON_COMPAT=( python{2_7,3_4,3_5,3_6} pypy{,3} )

genpy go home you are drunk

I don't want python3.3 things when I don't set python3.3 targets
Comment 16 Alexis Ballier gentoo-dev 2017-05-15 16:32:10 UTC
(In reply to Alessandro Barbieri from comment #15)
> Rebuilt n times genpy, all of ros, gen*, and std_msgs and the problem(s)
> is(are) still here.
> 
> Meanwhile I found a funny thing
> 
> locate python3.3
> /usr/lib64/python3.3
> /usr/lib64/python3.3/site-packages
> /usr/lib64/python3.3/site-packages/genlisp
> /usr/lib64/python3.3/site-packages/genlisp-0.4.16-py3.3.egg-info
> /usr/lib64/python3.3/site-packages/gennodejs
> /usr/lib64/python3.3/site-packages/gennodejs-2.0.1-py3.3.egg-info
> /usr/lib64/python3.3/site-packages/genpy
> /usr/lib64/python3.3/site-packages/genpy-0.6.5-py3.3.egg-info
> /usr/lib64/python3.3/site-packages/genpy/__init__.py
> /usr/lib64/python3.3/site-packages/genpy/base.py
> /usr/lib64/python3.3/site-packages/genpy/dynamic.py
> /usr/lib64/python3.3/site-packages/genpy/generate_initpy.py
> /usr/lib64/python3.3/site-packages/genpy/generate_numpy.py
> /usr/lib64/python3.3/site-packages/genpy/generate_struct.py
> /usr/lib64/python3.3/site-packages/genpy/generator.py
> /usr/lib64/python3.3/site-packages/genpy/genpy_main.py
> /usr/lib64/python3.3/site-packages/genpy/message.py
> /usr/lib64/python3.3/site-packages/genpy/rostime.py
> /usr/portage/dev-python/docutils/files/docutils-0.11-python3.3-odt-writer.
> patch
> /usr/portage/dev-python/progressbar/files/progressbar-2.3-python3.3.patch
> /usr/portage/dev-python/pycallgraph/files/python3.3-tests.patch
> 
> but in genpy-0.6.5.ebuild
> 
> PYTHON_COMPAT=( python{2_7,3_4,3_5,3_6} pypy{,3} )
> 
> genpy go home you are drunk
> 
> I don't want python3.3 things when I don't set python3.3 targets

in the genpy build log you posted above you can notice it *removes* python3.3 stuff

I guess that's because cmake is re-ran without proper invocation because of the mtime mismatch and it thus fallsback to auto detection where cmake uses what python tells it, and in pypy3's case it is:

$ pypy3 -c "import sys; sys.stdout.write('.'.join([str(x) for x in sys.version_info[:2]]))"
3.3


while for pypy:

$ pypy -c "import sys; sys.stdout.write('.'.join([str(x) for x in sys.version_info[:2]]))"
2.7


and it then installs its libraries to /usr/lib/python${version}
Comment 17 Alessandro Barbieri 2017-05-15 16:40:47 UTC
Removing all dev/ros* packages and then reinstalling could help?
I'll give a try
Parallel install can create problems?
Comment 18 Alexis Ballier gentoo-dev 2017-05-15 16:44:31 UTC
(In reply to Alessandro Barbieri from comment #17)
> Removing all dev/ros* packages and then reinstalling could help?

you can try but I doubt it; check for python3.3 files for packages where pypy3 is available and enabled, this should give you a good list of wrongly installed packages

> I'll give a try
> Parallel install can create problems?

I seriously hope not
Comment 19 Alessandro Barbieri 2017-05-15 17:48:03 UTC
Created attachment 472676 [details]
dev-ros:std_srvs-1.11.2:20170515-171243.log

build log std_srv after rebuild
Comment 20 Alessandro Barbieri 2017-05-15 17:53:06 UTC
Build log when reinstalling ros-meta/desktop after an emerge -C dev-ros/*
Comment 21 Alessandro Barbieri 2017-05-15 17:56:48 UTC
All the python3.3 stuff is now gone :)
Comment 22 Alessandro Barbieri 2017-05-15 22:42:22 UTC
last build failure

[ 52%] Generating EusLisp manifest code for std_srvs
catkin_generated/env_cached.sh /usr/bin/pypy /usr/share/geneus/cmake/../../../libexec/geneus/gen_eus.py -m -o /var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy/devel/share/roseus/ros/std_srvs std_srvs
Traceback (most recent call last):
  File "//usr/lib64/pypy/site-packages/geneus/geneus_main.py", line 137, in genmain
    pkg_map = get_pkg_map()
  File "//usr/lib64/pypy/site-packages/geneus/geneus_main.py", line 56, in get_pkg_map
    pkgs = packages.find_packages(ws)
  File "//usr/lib64/pypy/site-packages/catkin_pkg/packages.py", line 85, in find_packages
    packages = find_packages_allowing_duplicates(basepath, exclude_paths=exclude_paths, exclude_subspaces=exclude_subspaces, warnings=warnings)
  File "//usr/lib64/pypy/site-packages/catkin_pkg/packages.py", line 112, in find_packages_allowing_duplicates
    packages[path] = parse_package(os.path.join(basepath, path), warnings=warnings)
  File "//usr/lib64/pypy/site-packages/catkin_pkg/package.py", line 369, in parse_package
    raise IOError('Path "%s" is neither a directory containing a "%s" file nor a file' % (path, PACKAGE_MANIFEST_FILENAME))
IOError: Path "//usr/local/gentoo/usr/tmp/portage/dev-ros/rqt_gui-0.5.0/work/rqt-0.5.0/rqt_py_common" is neither a directory containing a "package.xml" file nor a file
ERROR:  Path "//usr/local/gentoo/usr/tmp/portage/dev-ros/rqt_gui-0.5.0/work/rqt-0.5.0/rqt_py_common" is neither a directory containing a "package.xml" file nor a file
make[2]: *** [CMakeFiles/std_srvs_generate_messages_eus.dir/build.make:79: devel/share/roseus/ros/std_srvs/manifest.l] Error 3
make[2]: Leaving directory '/var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy'
make[1]: *** [CMakeFiles/Makefile2:230: CMakeFiles/std_srvs_generate_messages_eus.dir/all] Error 2
make[1]: Leaving directory '/var/tmp/portage/dev-ros/std_srvs-1.11.2/work/ros_comm_msgs-1.11.2/std_srvs-pypy'
make: *** [Makefile:128: all] Error 2
 * ERROR: dev-ros/std_srvs-1.11.2::gentoo failed (compile phase):
 *   emake failed
Comment 23 Alessandro Barbieri 2017-05-21 06:00:48 UTC
Made a chroot in /usr/local/gentoo for testing and got this:

Multiple packages found with the same name "genlisp":
- local/gentoo/usr/share/genlisp
- share/genlisp
Multiple packages found with the same name "genmsg":
- local/gentoo/usr/share/genmsg
- share/genmsg
Multiple packages found with the same name "gennodejs":
- local/gentoo/usr/share/gennodejs
- share/gennodejs
Multiple packages found with the same name "genpy":
- local/gentoo/usr/share/genpy
- share/genpy
Multiple packages found with the same name "message_generation":
- local/gentoo/usr/share/message_generation
- share/message_generation
Multiple packages found with the same name "message_runtime":
- local/gentoo/usr/share/message_runtime
- share/message_runtime
Multiple packages found with the same name "roscpp_serialization":
- local/gentoo/usr/share/roscpp_serialization
- share/roscpp_serialization
Multiple packages found with the same name "roscpp_traits":
- local/gentoo/usr/share/roscpp_traits
- share/roscpp_traits

can these packages be less intrusive????
Comment 24 Alessandro Barbieri 2017-05-21 06:49:54 UTC
Built after removing /usr/local/gentoo folder ...
Comment 25 Alessandro Barbieri 2017-05-21 08:45:47 UTC
Found the problem: it searches in strange paths like /usr/local/gentoo and /tmp
The latter results in build failures when --jobs is used
Comment 26 Alexis Ballier gentoo-dev 2020-07-29 12:43:08 UTC
we now only support a single python version -- this should be more reliable

please reopen if this still fails after the python-single-r1 big update
Comment 27 Alexis Ballier gentoo-dev 2020-07-29 12:45:45 UTC
*** Bug 618336 has been marked as a duplicate of this bug. ***