Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 464930 - sys-apps/portage-2.1.11.60: repoman fails with some characters in commit message
Summary: sys-apps/portage-2.1.11.60: repoman fails with some characters in commit message
Status: RESOLVED OBSOLETE
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Repoman (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-04-07 09:37 UTC by Pacho Ramos
Modified: 2017-03-16 05:35 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Pacho Ramos gentoo-dev 2013-04-07 09:37:30 UTC
For example:
$ repoman commit -m "Fix gnome2_src_configure invocation (#464722#c1 by Rafał Mużyło)"

RepoMan scours the neighborhood...
>>> Creating Manifest for /home/pacho/gentoo-x86/net-libs/libsoup
  ebuild.minorsyn               1
   net-libs/libsoup/libsoup-2.42.0.ebuild: Unquoted Variable on line: 56
  upstream.workaround           3
   net-libs/libsoup/libsoup-2.38.1.ebuild: Ebuild calls addpredict on line: 59
   net-libs/libsoup/libsoup-2.40.3.ebuild: Ebuild calls addpredict on line: 51
   net-libs/libsoup/libsoup-2.42.0.ebuild: Ebuild calls addpredict on line: 53

Note: use --without-mask to check KEYWORDS on dependencies of masked packages
Note: use --include-dev (-d) to check dependencies for 'dev' profiles

Traceback (most recent call last):
  File "/usr/bin/repoman", line 2685, in <module>
    commitmessage += commit_footer
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 55: ordinal not in range(128)


Reproducible: Always




Portage 2.1.11.60 (default/linux/amd64/13.0/desktop/gnome, gcc-4.6.3, glibc-2.15-r3, 3.8.4-gentoo x86_64)
=================================================================
System uname: Linux-3.8.4-gentoo-x86_64-Intel-R-_Core-TM-_i5-2410M_CPU_@_2.30GHz-with-gentoo-2.1
KiB Mem:     6008208 total,    335080 free
KiB Swap:    5140476 total,   5132956 free
Timestamp of tree: Sat, 06 Apr 2013 08:30:01 +0000
ld GNU ld (GNU Binutils) 2.22
ccache version 3.1.9 [enabled]
app-shells/bash:          4.2_p37
dev-java/java-config:     2.1.12-r1
dev-lang/python:          2.7.3-r3, 3.2.3-r2
dev-util/ccache:          3.1.9
dev-util/cmake:           2.8.9
dev-util/pkgconfig:       0.28
sys-apps/baselayout:      2.1-r1
sys-apps/openrc:          0.11.8
sys-apps/sandbox:         2.5
sys-devel/autoconf:       2.13, 2.69
sys-devel/automake:       1.10.3, 1.11.6
sys-devel/binutils:       2.22-r1
sys-devel/gcc:            4.6.3, 4.7.2-r1
sys-devel/gcc-config:     1.7.3
sys-devel/libtool:        2.4-r1
sys-devel/make:           3.82-r4
sys-kernel/linux-headers: 3.7 (virtual/os-headers)
sys-libs/glibc:           2.15-r3
Repositories: gentoo local
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=native"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -march=native"
DISTDIR="/usr/distfiles"
EMERGE_DEFAULT_OPTS="--quiet-build=n --autounmask-write"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs ccache config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync multilib-strict news parallel-fetch preserve-libs protect-owned sandbox sfperms sign split-log strict test test-fail-continue unknown-features-warn unmerge-logs unmerge-orphans userfetch"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://mirror.ovh.net/gentoo-distfiles/ http://ftp.heanet.ie/pub/gentoo/"
LANG="es_ES.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu"
MAKEOPTS="-j5"
PKGDIR="/usr/local/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="X a52 aac acl acpi alsa amd64 applet bash-completion berkdb bluetooth branding bzip2 cairo cdda cddb cdr cli colord consolekit cracklib crypt cups cvs cxx dbus djvu dri dts dvd dvdr dvi eds emboss enchant encode evo exif fam fat ffmpeg firefox flac fortran fuse gdbm gif gnome gnome-keyring gnome-online-accounts gpm gstreamer gtk gtk3 gtkstyle http iconv infinality irc jabber jpeg kpathsea latex lcms ldap libnotify libsecret libvisual lyx mad mms mmx mmxext mng modules mono monolithic-build mp3 mp4 mpeg mudflap multilib musicbrainz nautilus ncurses network-cron networkmanager nls nptl ntfs ntp numa nvidia ogg opengl openmp optimized-qmake pam pango pch pdf png policykit ppds pulseaudio qt3support readline reiserfs scanner sdl session smp sna socialweb spell sse sse2 sse3 ssl ssse3 startup-notification svg t1lib tcpd test theora threads tiff truetype udev udisks unicode upnp-av upower usb v4l vaapi vala vcd vdpau vorbis wifi wxwidgets x264 xcb xfs xml xv xvid youtube zlib" ABI_X86="64" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="es es_ES en_US" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-3" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_2" RUBY_TARGETS="ruby18 ruby19" USERLAND="GNU" VIDEO_CARDS="fbdev nvidia vesa intel i915 i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
Comment 1 Zac Medico gentoo-dev 2013-04-07 17:51:39 UTC
(In reply to comment #0)
> Traceback (most recent call last):
>   File "/usr/bin/repoman", line 2685, in <module>
>     commitmessage += commit_footer
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 55:
> ordinal not in range(128)

This is confusing, because both of those strings are supposed to be unicode, so there should not be any unicode decode operations happening there.

Which python interpreter is repoman using? Check `head -n1 /usr/bin/repoman` to find out. Also, please post the output of `locale`.
Comment 2 Pacho Ramos gentoo-dev 2013-04-07 17:53:24 UTC
(In reply to comment #1)
> (In reply to comment #0)
> > Traceback (most recent call last):
> >   File "/usr/bin/repoman", line 2685, in <module>
> >     commitmessage += commit_footer
> > UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 55:
> > ordinal not in range(128)
> 
> This is confusing, because both of those strings are supposed to be unicode,
> so there should not be any unicode decode operations happening there.
> 
> Which python interpreter is repoman using? Check `head -n1 /usr/bin/repoman`
> to find out. Also, please post the output of `locale`.

$ head -n1 /usr/bin/repoman
#!/usr/bin/python -O

(??!)

$ emerge -Opv portage

These are the packages that would be merged, in order:

[ebuild   R   ~] sys-apps/portage-2.1.11.60  USE="doc (ipc) -build -epydoc (-pypy2_0) -python2 -python3 (-selinux) -xattr" LINGUAS="-pl -ru" PYTHON_TARGETS="python2_7 python3_2 -pypy1_9 -pypy2_0 -python2_6 -python3_1 (-python3_3) (-python3_4)" 0 kB


$ locale
LANG=es_ES.UTF-8
LC_CTYPE="es_ES.UTF-8"
LC_NUMERIC="es_ES.UTF-8"
LC_TIME="es_ES.UTF-8"
LC_COLLATE=C
LC_MONETARY="es_ES.UTF-8"
LC_MESSAGES="es_ES.UTF-8"
LC_PAPER="es_ES.UTF-8"
LC_NAME="es_ES.UTF-8"
LC_ADDRESS="es_ES.UTF-8"
LC_TELEPHONE="es_ES.UTF-8"
LC_MEASUREMENT="es_ES.UTF-8"
LC_IDENTIFICATION="es_ES.UTF-8"
LC_ALL=
Comment 3 Zac Medico gentoo-dev 2013-04-07 18:10:04 UTC
(In reply to comment #2)
> $ head -n1 /usr/bin/repoman
> #!/usr/bin/python -O

Which version does `/usr/bin/python -V` report?
Comment 4 Pacho Ramos gentoo-dev 2013-04-07 18:18:04 UTC
(In reply to comment #3)
> (In reply to comment #2)
> > $ head -n1 /usr/bin/repoman
> > #!/usr/bin/python -O
> 
> Which version does `/usr/bin/python -V` report?

$ /usr/bin/python -V
Python 2.7.3
Comment 5 Zac Medico gentoo-dev 2013-04-07 18:28:47 UTC
Does it work with the same commit message if you don't use the -m argument and do it through $EDITOR instead?
Comment 6 Pacho Ramos gentoo-dev 2013-04-07 18:31:49 UTC
(In reply to comment #5)
> Does it work with the same commit message if you don't use the -m argument
> and do it through $EDITOR instead?

How can I go to that $EDITOR way? (I only know to use "-m" or use echangelog)

Thanks
Comment 7 Zac Medico gentoo-dev 2013-04-07 18:38:22 UTC
If you don't use -m then it will automatically call $EDITOR.
Comment 8 Pacho Ramos gentoo-dev 2013-04-07 19:06:06 UTC
It works with editor but not with "-m"
Comment 9 Brian Dolbec (RETIRED) gentoo-dev 2017-03-16 00:03:31 UTC
I'm going to close  this one as obsolete.  There have been so many unicode handling improvements.  Plus you have a newer bug 562108 for this same problem.
Comment 10 Zac Medico gentoo-dev 2017-03-16 05:35:13 UTC
For the -m option, we could use surrogateescape shenanigans like we do in bin/install.py.