I find the manpage incomplete while searching for variables related to "proxy" settings. I assume http_proxy, https_proxy, ftp_proxy should be used. Does rsync_proxy exist? Or how can I make portage use rsync through a tunnelled port local port? Or can I avoid the rsync altogether and use syncing over http (firewall denies all rsync://)? I know about emerge-websync, a pointer to it from the manpage would be also helpful but it fetches some tarball, so is less often updated.
The make.conf man page already mentions http_proxy, ftp_proxy, and RSYNC_PROXY. These variables are not actually known by portage, but by programs that portage calls. I see in the wget man page that it also support https_proxy. (In reply to Martin Mokrejš from comment #0) > Does rsync_proxy exist? See RSYNC_PROXY in the rsync man page. > Or how can I make portage use rsync through a > tunnelled port local port? Hmm, better refer to the rsync documentation. > Or can I avoid the rsync altogether and use > syncing over http (firewall denies all rsync://)? I know about > emerge-websync, a pointer to it from the manpage would be also helpful but > it fetches some tarball, so is less often updated. There's also emerge-delta-webrsync. The snapshots are daily.
(In reply to Zac Medico from comment #1) > The make.conf man page already mentions http_proxy, ftp_proxy, and Doh, I went through 'man emerge' of course to look for command line arguments and env variables. :( Having the possibility to define defaults in make.conf is fine, but command line options should exist as well. > RSYNC_PROXY. These variables are not actually known by portage, but by OK, I see. > programs that portage calls. I see in the wget man page that it also support > https_proxy. > > (In reply to Martin Mokrejš from comment #0) > > Does rsync_proxy exist? > > See RSYNC_PROXY in the rsync man page. > > > Or how can I make portage use rsync through a > > tunnelled port local port? > > Hmm, better refer to the rsync documentation. fully_networked$ ssh -v -R:1654:127.0.0.1:22 clusternode clusternode$ export RSYNC_CONNECT_PROG='ssh -p 1654 127.0.0.1 nc %H 873' clusternode$ emerge --sync $ emerge --sync >>> Syncing repository 'gentoo' into '/scratch/mmokrejs/gentoo_rap/usr/portage'... >>> Starting rsync with rsync://176.28.50.119/gentoo-portage... >>> Checking server timestamp ... ssh: connect to host 127.0.0.1 port 1654: Connection refused rsync: safe_read failed to read 1 bytes [Receiver]: Connection reset by peer (104) rsync error: error in rsync protocol data stream (code 12) at io.c(276) [Receiver=3.1.2] >>> Retrying... Something is wrong. And yes, I did realize I had not installed netcat on the fully networked node. The error had a hardly chance to be propagated back to emerge to report, true. But installing netcat still did not help, weird. > > > Or can I avoid the rsync altogether and use > > syncing over http (firewall denies all rsync://)? I know about > > emerge-websync, a pointer to it from the manpage would be also helpful but > > it fetches some tarball, so is less often updated. > > There's also emerge-delta-webrsync. The snapshots are daily. Thanks, I at least can sync using the emerge-delta-webrsync, perfect!
OK, this works: fully_networked$ ssh -R:1654:127.0.0.1:22 clusternode clusternode$ export RSYNC_CONNECT_PROG='ssh -p 1654 127.0.0.1 nc %H 873' clusternode$ emerge --sync
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/proj/portage.git/commit/?id=45341379cdcdfb74ab44ffb0297564f12fb9beb5 commit 45341379cdcdfb74ab44ffb0297564f12fb9beb5 Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-19 14:58:24 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-19 14:59:00 +0000 make.conf.5: mention https_proxy We support it as of recent (from today) commits. Bug: https://bugs.gentoo.org/587484 Signed-off-by: Sam James <sam@gentoo.org> NEWS | 2 ++ man/make.conf.5 | 2 +- 2 files changed, 3 insertions(+), 1 deletion(-)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=a6a68c0255b6d3132dd555b1519a035204bffde2 commit a6a68c0255b6d3132dd555b1519a035204bffde2 Author: Sam James <sam@gentoo.org> AuthorDate: 2023-08-20 07:57:47 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-20 07:58:22 +0000 sys-apps/portage: add 3.0.51 Bug: https://bugs.gentoo.org/587484 Closes: https://bugs.gentoo.org/673624 Closes: https://bugs.gentoo.org/691434 Closes: https://bugs.gentoo.org/835927 Closes: https://bugs.gentoo.org/909009 Closes: https://bugs.gentoo.org/911335 Closes: https://bugs.gentoo.org/911629 Closes: https://bugs.gentoo.org/911938 Signed-off-by: Sam James <sam@gentoo.org> sys-apps/portage/Manifest | 1 + sys-apps/portage/portage-3.0.51.ebuild | 234 +++++++++++++++++++++++++++++++++ 2 files changed, 235 insertions(+)