I killed that process after 3h of runtime here at this particular tuinderbix image. Usualliy 3 minutes are needed to complete the build. A lot of "beam"-processes were spawned but no progress was made. make[3]: *** [/var/tmp/portage/net-misc/rabbitmq-server-3.7.3-r1/work/rabbitmq-server-3.7.3/deps/rabbit_common/erlang.mk:5092: goldrush.d] Error 137 ------------------------------------------------------------------- This is an unstable amd64 chroot image at a tinderbox (==build bot) name: 17.0_20180704-231251 ------------------------------------------------------------------- gcc-config -l: [1] x86_64-pc-linux-gnu-7.3.0 * Available Python interpreters, in order of preference: [1] python3.5 [2] python3.6 (fallback) [3] python2.7 (fallback) Available Ruby profiles: [1] ruby23 (with Rubygems) * emerge -qpv net-misc/rabbitmq-server [ebuild N ] net-misc/rabbitmq-server-3.7.3-r1
Created attachment 538798 [details] emerge-info.txt
Created attachment 538800 [details] emerge-history.txt
Created attachment 538802 [details] environment
Created attachment 538804 [details] etc.portage.tbz2
Created attachment 538806 [details] logs.tbz2
Created attachment 538808 [details] net-misc:rabbitmq-server-3.7.3-r1:20180708-102733.log
Created attachment 538810 [details] temp.tbz2
Hi! A RabbitMQ user reported a similar issue on the #rabbitmq IRC channel today. I'm from the RabbitMQ core team and worked on the build system, so I'm particularily interested in fixing this hang :) I started an Amazon EC2 instance using the "Pygoscelis-Papua_Gentoo_HVM-2018-07-04-01-58-40" AMI. I updated the distribution, installed Erlang 21.0.2 and Elixir 1.6.6 and tried to reproduce the hang. However, I couldn't: RabbitMQ builds successfully for me. I used the 3.7.8-rc.1 source archive because that user on IRC also had the same issue with both 3.7.3 and 3.7.8-rc.1. To build RabbitMQ, I extracted the archive in /tmp and ran "make -j1 all docs dist" in the extracted directory. Could you please tell me how you are compiling RabbitMQ? Disclaimer: this is my first time using Gentoo, but I'm willing to learn :)
(In reply to Jean-Sébastien Pédron from comment #8) >>Could you please tell me how you are compiling RabbitMQ? erm, what info/files do you missed in the atatched ones?
I mean, what tool/command line do you use to build RabbitMQ? In other words, are you using make(1) directly in the extracted source? Or do you use a package building tool?
(In reply to Jean-Sébastien Pédron from comment #10) This is a bug catched at my tinderbox [1]. It is fully and only the Gentoo build system. [1] https://zwiebeltoralf.de/tinderbox.html
Same problem here on 2 machines
root 7769 1931 0 Jul30 pts/0 00:00:00 | \_ sudo emerge -e @world @system -k --keep-going root 7770 7769 6 Jul30 pts/0 00:31:52 | \_ /usr/bin/python3.6 -b /usr/lib/python-exec/python3.6/emerge -e @world @system -k --keep-going portage 32139 7770 0 04:33 pts/0 00:00:00 | \_ [net-misc/rabbitmq-server-3.7.3-r1] sandbox /mnt/oldhome/tmp-portage/portage/._portage_reinstall_.y9t portage 32140 32139 0 04:33 pts/0 00:00:00 | \_ /bin/bash /mnt/oldhome/tmp-portage/portage/._portage_reinstall_.y9tskhhp/bin/ebuild.sh compile portage 32157 32140 0 04:33 pts/0 00:00:00 | \_ /bin/bash /mnt/oldhome/tmp-portage/portage/._portage_reinstall_.y9tskhhp/bin/ebuild.sh compil portage 32160 32157 0 04:33 pts/0 00:00:00 | \_ /bin/bash /mnt/oldhome/tmp-portage/portage/._portage_reinstall_.y9tskhhp/bin/ebuild-helpe portage 32162 32160 0 04:33 pts/0 00:00:00 | \_ make -j8 all docs dist portage 32238 32162 0 04:33 pts/0 00:00:00 | \_ /bin/sh -c set -e; for dep in /mnt/oldhome/tmp-portage/portage/net-misc/rabbitmq- portage 32413 32238 0 04:33 pts/0 00:00:00 | \_ make -C /mnt/oldhome/tmp-portage/portage/net-misc/rabbitmq-server-3.7.3-r1/wo portage 32565 32413 0 04:33 pts/0 00:00:00 | \_ /bin/sh -c set -e; for dep in /mnt/oldhome/tmp-portage/portage/net-misc/r portage 32568 32565 0 04:33 pts/0 00:00:00 | \_ make -C /mnt/oldhome/tmp-portage/portage/net-misc/rabbitmq-server-3.7 portage 32569 32568 99 04:33 pts/0 02:35:52 | \_ /usr/lib64/erlang/erts-10.0.2/bin/beam.smp -- -root /usr/lib64/er portage 32590 32569 0 04:33 ? 00:00:00 | \_ erl_child_setup 1024
$ genlop -c Currently merging 1595 out of 2387 * net-misc/rabbitmq-server-3.7.3-r1 current merge time: 2 hours, 37 minutes and 11 seconds. ETA: any time now.
Thank you for your responses. I'll setup a Tinderbox tomorrow. Hopefully I can reproduce with an environment closer to yours.
Hi! I could finally reproduce the issue even without any Tinderbox. The problem is that rabbitmq-server-3.7.3-r1.ebuild depends on Elixir < 1.6.0. This is fine except when using Erlang 21.0: only Elixir 1.6.6+ supports Erlang 21.0. The "RabbitMQ requires Elixir 1.4.4+ usually, but 1.6.6+ when using Erlang 21.0" is difficult to express on our side (i.e. in RabbitMQ build system itself). I will discuss with the team if we should just bump the requirement to 1.6.6 and be done with it. Meanwhile, in the Gentoo ebuild file, you should require Elixir 1.6.6. I see Elixir 1.7.x is also available in Portage, however, we didn't start to test RabbitMQ with Elixir 1.7.x so I would recommend that you pin the dependency to Elixir 1.6.6 exactly. Unrelated comment: there is a bug in our Makefiles which can lead to this error: Generated escript escript/rabbitmqctl with MIX_ENV=dev GEN escript/rabbitmq-plugins ln: failed to create hard link 'escript/rabbitmq-plugins': File exists make[3]: *** [Makefile:88: escript/rabbitmq-plugins] Error 1 make[2]: *** [Makefile:223: copy-escripts] Error 2 make[1]: *** [erlang.mk:4913: app] Error 2 make[1]: Leaving directory '/var/tmp/portage/net-misc/rabbitmq-server-3.7.3-r2/work/rabbitmq-server-3.7.3/deps/rabbit' make: *** [erlang.mk:4223: deps] Error 2 I would just skip 3.7.3 and go straight to the latest 3.7.x release.
Created attachment 542088 [details] Ebuild for RabbitMQ 3.7.7 with Elixir requirement set to 1.6.6 Here is the ebuild file I used for testing. RabbitMQ builds and starts fine. Erlang 21.0.2 and Elixir 1.6.6 were used. I also added the following two lines to net-misc/rabbitmq-server/Manifest: DIST rabbitmq-server-3.7.7.tar.xz 2517952 BLAKE2B 72b84d4459974b6cf4f8215bb3a6e74aa99950c28f8120c7ac3d4981fa84e7e73c9b8b83679e4fe3ca0150baec6ddd791d39df70802b7bff8db062103b86e299 SHA512 b8ae8a71ab59f5e2e95286a782ed503eaf7371eb3fcf300723f2e581b9471f98bafdee6e6cf9a750c4beada956b80d289fb1cca0f62a9daca95aa3b2ddd954a2 EBUILD rabbitmq-server-3.7.7.ebuild 3003 BLAKE2B 0f83e46533243ea6144434c14cccdc37bdc501443c7c5539624de9a028525829fa30ea9c27e0f73665d979ee5698d364c639ba01cf6391343ac65030dcc4f252 SHA512 c618d90d4f89617088418f472bedf4081c290ca1b269cfc8b9b3645f4d3d562fa0c25d0781adc164a675013571458783e8daf57384cce759c38f957d1230ec8f
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=b8de633d60b9898e3edaf35f27a94169f1afaba4 commit b8de633d60b9898e3edaf35f27a94169f1afaba4 Author: Thomas Deutschmann <whissi@gentoo.org> AuthorDate: 2018-12-19 14:03:47 +0000 Commit: Thomas Deutschmann <whissi@gentoo.org> CommitDate: 2018-12-19 14:10:28 +0000 net-misc/rabbitmq-server: bump to v3.7.9 Pin to >=dev-lang/elixir-1.6.6 <dev-lang/elixir-1.7.0. Thanks to Jean-Sébastien Pédron (upstream) for the help! Closes: https://bugs.gentoo.org/660708 Package-Manager: Portage-2.3.52, Repoman-2.3.12 Signed-off-by: Thomas Deutschmann <whissi@gentoo.org> net-misc/rabbitmq-server/Manifest | 1 + .../rabbitmq-server/rabbitmq-server-3.7.9.ebuild | 105 +++++++++++++++++++++ 2 files changed, 106 insertions(+)
