Bug 730444 – sys-auth/ykpers-1.20.0 with app-text/asciidoc-8.6.10_p20181016-r1 and python:3.7 : UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 2183: ordinal not in range(128)

• Status: RESOLVED OBSOLETE
• Product: Gentoo Linux

[Description Tamer Higazi 2020-07-02 12:18:25 UTC]

I have on my gentoo system "make.conf" following targets:

PYTHON_TARGETS="python3_7 python2_7"
PYTHON_SINGLE_TARGET="python3_7"

and building fails at the end.
Here the "info" and "build"

The info:
https://pastebin.com/raw/zRF5dk5r

and build output:
https://pastebin.com/raw/uS75yajC

Thanks, Tamer

[Comment 1 Lars Wendler (Polynomial-C) (RETIRED) 2020-07-02 12:42:46 UTC]

sys-auth/ykpers does not contain any python ebuild code. Please attach the build.log file and/or the error message you receive.

[Comment 2 Tamer Higazi 2020-07-02 12:49:19 UTC]

Created attachment 647352 [details]
build log

Build log that leads to compilation failure

[Comment 3 Lars Wendler (Polynomial-C) (RETIRED) 2020-07-02 13:00:37 UTC]

This is the error message:

Traceback (most recent call last):
  File "/usr/bin/a2x", line 931, in <module>
    source_options = get_source_options(sys.argv[-1])
  File "/usr/bin/a2x", line 337, in get_source_options
    for line in f:
  File "/usr/lib/python3.7/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 2183: ordinal not in range(128)
make[1]: *** [Makefile:1417: ykpersonalize.1] Error 1
make[1]: *** Waiting for unfinished jobs....
make[1]: Leaving directory '/var/tmp/portage/sys-auth/ykpers-1.20.0/work/yubikey-personalization-1.20.0'
make: *** [Makefile:947: all-recursive] Error 1


And this is the package where the failing command comes from:

  # qfile -Cq /usr/bin/a2x
  app-text/asciidoc


Please post the output of the following command to this bug:

  emerge --info asciidoc

[Comment 4 Tamer Higazi 2020-07-02 13:08:20 UTC]

Created attachment 647356 [details]
asciidoc info

[Comment 5 Lars Wendler (Polynomial-C) (RETIRED) 2020-07-03 14:37:41 UTC]

Can you please try the unstable version of app-text/asciidoc?

[Comment 6 Tamer Higazi 2020-07-03 14:48:27 UTC]

Created attachment 647492 [details]
ykpers build failure result with asciidoc 9.0.0-rc2

[Comment 7 Tamer Higazi 2020-07-03 14:54:07 UTC]

(In reply to Lars Wendler (Polynomial-C) from comment #5)
> Can you please try the unstable version of app-text/asciidoc?

I just uploaded the build failure log.

As I am convinced that this is not asciidoc related.
when you look at this line:

return codecs.ascii_decode(input, self.errors)[0]

the developer of the package sys-auth/ykpers tries to return something that is not converting. 

Now the big question is ?
Is it a programming error or does asciidoc perhaps need to be built with a different PYTHON_SINGLE_TARGET

Before we stick further. 
Can I change for the package "app-text/asciidoc" the PYTHON_SINGLE_TARGET to python3_6 ?

[ebuild   R   ~] app-text/asciidoc-9.0.0_rc2::gentoo  USE="-examples -test" PYTHON_SINGLE_TARGET="python3_7 -pypy3 -python3_6 -python3_8" 0 KiB

to see if the result is the same ?
I have the feeling that the python engine behaves different from the versions above and under it....


best, Tamer

[Comment 8 Tamer Higazi 2020-07-03 15:24:16 UTC]

(In reply to Tamer Higazi from comment #0)
> I have on my gentoo system "make.conf" following targets:
> 
> PYTHON_TARGETS="python3_7 python2_7"
> PYTHON_SINGLE_TARGET="python3_7"
> 
> and building fails at the end.
> Here the "info" and "build"
> 
> The info:
> https://pastebin.com/raw/zRF5dk5r
> 
> and build output:
> https://pastebin.com/raw/uS75yajC
> 
> Thanks, Tamer

I have tried all versions with python 3.6, 3.7 and 3.8 and the result compiling sys-auth/ykpers remains the same.

I just cloned the master branch of the maintainer, and the result is the same one. I will inform the maintainer, and see to get is solved.

Otherwise I will write a patch and perform a pull request to solve this issue.

[Comment 9 Tamer Higazi 2020-07-03 15:29:49 UTC]

sorry.... Lars you were right.
It is "asciidoc". I will contact the maintainer. 

I see the code.....

[Comment 10 Tamer Higazi 2020-07-03 15:33:03 UTC]

asciidoc 9.0.1 fixes this crash:
https://github.com/asciidoc/asciidoc-py3/releases/tag/9.0.1

ebuild needed.

[Comment 11 Tamer Higazi 2020-07-03 15:46:41 UTC]

Dear Marc, 

As the app-text/asciidoc package maintainer for gentoo I wrote you previoudsly a Mail. 

Thank you if you find the time to gernerate an ebuild for the just released version 9.0.1 of asciidoc that handles the crash. 


best, Tamer

[Comment 12 Tamer Higazi 2020-07-03 16:16:52 UTC]

Hi people, 

I downloaded the tar.gz of 9.0.1 file and compiled by manually:

configure --prefix=/usr
make && make install

afterwards I could merge ykpers without any problems that leaded to the result to merge the application keepassxc with the "*yubikey" use flag.

[Comment 13 Tamer Higazi 2020-07-05 16:55:38 UTC]

Created attachment 647838 [details]
asciidoc-9.0.1 ebuild

generated asciidoc 9.0.1 ebuild and tested in overlay.
seems to work.

[Comment 14 Tamer Higazi 2020-07-05 16:55:59 UTC]

asccidoc ebuild for 9.0.1 provided.

[Comment 15 Marc Joliet 2020-07-06 16:36:54 UTC]

I will do my best to get a version bump done this week, unless somebody else wants it done *now* and can take over.  Asciidoc changed their build system and I need to change some things (no "examples" directory anymore, for instance), so I can't just trivially copy the ebuild and bump the version number.

[Comment 16 Marek Szuba 2022-09-01 15:28:52 UTC]

*** Bug 688330 has been marked as a duplicate of this bug. ***