Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 644372 - Bootstrap script fails in stage2 due to lack of https support
Summary: Bootstrap script fails in stage2 due to lack of https support
Status: RESOLVED FIXED
Alias: None
Product: Gentoo/Alt
Classification: Unclassified
Component: Prefix Support (show other bugs)
Hardware: AMD64 OS X
: Normal normal (vote)
Assignee: Gentoo Prefix
URL:
Whiteboard:
Keywords:
: 659684 (view as bug list)
Depends on:
Blocks:
 
Reported: 2018-01-12 21:01 UTC by hintsss
Modified: 2021-01-08 08:58 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description hintsss 2018-01-12 21:01:06 UTC
While trying to install prefix on OSX 10.13.2, the bootstrap script fails during stage2:



These are the packages that would be merged, in order:

[ebuild  N     ] sys-devel/binutils-config-5-r03.3::gentoo_prefix  14 KiB

Total: 1 package (1 new), Size of downloads: 14 KiB


>>> Verifying ebuild manifests

>>> Emerging (1 of 1) sys-devel/binutils-config-5-r03.3::gentoo_prefix
>>> Downloading 'http://distfiles.gentoo.org/distfiles/binutils-config-ldwrapper-5.3.3.c'
--2018-01-11 23:25:42--  http://distfiles.gentoo.org/distfiles/binutils-config-ldwrapper-5.3.3.c
Resolving distfiles.gentoo.org... 216.165.129.135, 156.56.247.195, 64.50.233.100, ...
Connecting to distfiles.gentoo.org|216.165.129.135|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2018-01-11 23:25:42 ERROR 404: Not Found.

>>> Downloading 'https://gitweb.gentoo.org/repo/proj/prefix.git/plain/sys-devel/binutils-config/files/ldwrapper.c?id=b93602ba2a0f76a9a85cb36a1740a4522e45ce36'
https://gitweb.gentoo.org/repo/proj/prefix.git/plain/sys-devel/binutils-config/files/ldwrapper.c?id=b93602ba2a0f76a9a85cb36a1740a4522e45ce36: HTTPS support not compiled in.
!!! Couldn't download 'binutils-config-ldwrapper-5.3.3.c'. Aborting.



I asked for help in irc, and was told to file a bug report, since "The early stage of bootstrap should not use https urls"
Comment 1 Fabian Groffen gentoo-dev 2018-01-13 07:20:28 UTC
I totally agree this is getting very annoying.  wget is the second package installed (after make), so the state of affairs is very brittle at this stage.  Adding ssl support could be possible if the host supports it.  Not all hosts will have it though.  It also adds problems, see fex bug #400831.

I've uploaded the file to the mirrors now.  I'll leave this bug open for a little to try and see if we can compile wget with ssl support, it's installed in stage3 again, when proper ssl should be around.
Comment 2 hintsss 2018-01-13 19:45:53 UTC
It successfully finished stage2, however now it fails during stage3 with a similar error:



 * python-gentoo-patches-2.7.14-0.tar.xz BLAKE2B SHA512 size ;-) ...     [ ok ]
>>> Downloading 'http://distfiles.gentoo.org/distfiles/python-prefix-2.7.14-gentoo-patches-r0.tar.xz'
--2018-01-13 05:49:21--  http://distfiles.gentoo.org/distfiles/python-prefix-2.7.14-gentoo-patches-r0.tar.xz
Resolving distfiles.gentoo.org... 64.50.233.100, 156.56.247.195, 140.211.166.134, ...
Connecting to distfiles.gentoo.org|64.50.233.100|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2018-01-13 05:49:21 ERROR 404: Not Found.

>>> Downloading 'https://dev.gentoo.org/~grobian/distfiles/python-prefix-2.7.14-gentoo-patches-r0.tar.xz'
https://dev.gentoo.org/~grobian/distfiles/python-prefix-2.7.14-gentoo-patches-r0.tar.xz: HTTPS support not compiled in.
!!! Couldn't download 'python-prefix-2.7.14-gentoo-patches-r0.tar.xz'. Aborting.
 * Fetch failed for 'dev-lang/python-2.7.14', Log file:
 *  '/Users/hintss/Gentoo/var/tmp/portage/dev-lang/python-2.7.14/temp/build.log'

>>> Failed to emerge dev-lang/python-2.7.14, Log file:

>>>  '/Users/hintss/Gentoo/var/tmp/portage/dev-lang/python-2.7.14/temp/build.log'

 * Messages for package dev-lang/python-3.5.4:

 * Failed to set XATTR_PAX markings -m python.
 * Failed to set XATTR_PAX markings -m /Users/hintss/Gentoo/var/tmp/portage/dev-lang/python-3.5.4/image/Users/hintss/Gentoo/usr/bin/python3.5.

 * Messages for package app-misc/ca-certificates-20170717.3.34.1:

 * You should run update-ca-certificates manually after etc-update
 * To prevent applications relying on system's trusted root certificate store
 * from using CAs where at least one major browser vendor Gentoo is following
 * has decided to apply trust level restrictions, the following
 * certificate(s) were removed:
 *

 * Messages for package dev-lang/python-2.7.14:

 * Fetch failed for 'dev-lang/python-2.7.14', Log file:
 *  '/Users/hintss/Gentoo/var/tmp/portage/dev-lang/python-2.7.14/temp/build.log'
Comment 3 Fabian Groffen gentoo-dev 2018-01-14 08:22:10 UTC
added that one too
Comment 4 Fabian Groffen gentoo-dev 2018-06-30 18:25:54 UTC
*** Bug 659684 has been marked as a duplicate of this bug. ***
Comment 5 Camille Huot 2018-08-03 09:02:23 UTC
Hi Fabian

I just got the same issue with prefix-portage-2.3.40.3.tar.bz2

I found several bug reports about this issue and the resolution was always to push the file to the mirrors.

May I suggest that you automate the push to the mirror instead on working on a SSL wget?

Cheers
Camille
Comment 6 Fabian Groffen gentoo-dev 2018-08-03 09:15:50 UTC
Yeah, something like that, it seems the distfile was just removed, so for that case I'll have to re-upload.
Comment 7 Larry the Git Cow gentoo-dev 2019-03-20 14:54:19 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/proj/prefix.git/commit/?id=5107368437df6964ba4c2567de9e13bb988912c6

commit 5107368437df6964ba4c2567de9e13bb988912c6
Author:     Fabian Groffen <grobian@gentoo.org>
AuthorDate: 2019-03-20 14:52:06 +0000
Commit:     Fabian Groffen <grobian@gentoo.org>
CommitDate: 2019-03-20 14:52:06 +0000

    scripts/bootstrap-prefix: bootstrap libressl for wget to use
    
    Somewhat experimental, but optional (e.g. if it fails should not abort
    the bootstrap) bootstrap of libressl so wget can link against it to
    enable https:// support.  Tested on powerpc-apple-darwin9.
    
    Bug: https://bugs.gentoo.org/644372
    Signed-off-by: Fabian Groffen <grobian@gentoo.org>

 scripts/bootstrap-prefix.sh | 57 +++++++++++++++++++++++++++++++++++----------
 1 file changed, 45 insertions(+), 12 deletions(-)
Comment 8 Fabian Groffen gentoo-dev 2021-01-08 08:58:50 UTC
we bootstrap libressl and compile wget against it to be able to use https as soon as possible in the bootstrap