<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "http://bugs.gentoo.org/bugzilla.dtd">

<bugzilla version="2.22.7"
          urlbase="http://bugs.gentoo.org/"
          maintainer="bugzilla@gentoo.org"
>

    <bug>
          <bug_id>125288</bug_id>
          
          <creation_ts>2006-03-06 12:49 0000</creation_ts>
          <short_desc>Broken encoding in ChangeLog</short_desc>
          <delta_ts>2008-01-18 02:05:55 0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>Gentoo Linux</product>
          <component>Ebuilds</component>
          <version>unspecified</version>
          <rep_platform>All</rep_platform>
          <op_sys>Linux</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>INVALID</resolution>
          
          
          
          <priority>P1</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          
          <everconfirmed>1</everconfirmed>
          <reporter>tove@gentoo.org</reporter>
          <assigned_to>tgall@gentoo.org</assigned_to>
          <cc>dev-portage@gentoo.org</cc>
    
    <cc>fuzzyray@gentoo.org</cc>
    
    <cc>jakub@gentoo.org</cc>
    
    <cc>ppc64@gentoo.org</cc>
    
    <cc>qa@gentoo.org</cc>

      

      
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2006-03-06 12:49:27 0000</bug_when>
            <thetext>Your commit broke the encoding of these documents:
http://www.gentoo.org/cgi-bin/viewcvs.cgi/app-admin/skey/ChangeLog?r1=1.36&amp;r2=1.37
http://www.gentoo.org/cgi-bin/viewcvs.cgi/sys-fs/cryptsetup/ChangeLog?r1=1.30&amp;r2=1.31
http://www.gentoo.org/cgi-bin/viewcvs.cgi/sys-fs/e2fsprogs/ChangeLog?r1=1.79&amp;r2=1.80

If you want i can fix it.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2006-03-07 13:03:34 0000</bug_when>
            <thetext>I&apos;ve fixed it in the tree.

If you need help with your system, someone to test,..., don&apos;t hesitate and ask. Thanks.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2006-06-25 12:25:23 0000</bug_when>
            <thetext>Again:
http://sources.gentoo.org/viewcvs.py/gentoo-x86/sci-geosciences/gpsd/ChangeLog?r1=1.14&amp;r2=1.15</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>zzam@gentoo.org</who>
            <bug_when>2006-08-31 04:04:51 0000</bug_when>
            <thetext>fixed changelog of sci-geosciences/gpsd</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2006-09-12 11:59:33 0000</bug_when>
            <thetext>Tom, your commits are constantly breaking the encoding of the ChangeLog, if you need help to fix this problem please ask.
I think it&apos;s unacceptable to deface other contributor&apos;s names.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2006-12-03 06:49:02 0000</bug_when>
            <thetext>No idea why is this still open.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2007-01-01 15:58:37 0000</bug_when>
            <thetext>(In reply to comment #5)
&gt; No idea why is this still open.

It is not fixed:
http://sources.gentoo.org/viewcvs.py/gentoo-x86/mail-client/mozilla-thunderbird/ChangeLog?r1=1.153&amp;r2=1.154
http://sources.gentoo.org/viewcvs.py/gentoo-x86/x11-plugins/enigmail/ChangeLog?r1=1.42&amp;r2=1.43

Tom, i know it only happens sometimes. Maybe it helps you to find the reason for it.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2007-01-02 07:29:49 0000</bug_when>
            <thetext>(In reply to comment #6)
&gt; It is not fixed:

So make repoman detect those garbled logs?</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2007-01-03 02:58:36 0000</bug_when>
            <thetext>A new one:
http://sources.gentoo.org/viewcvs.py/gentoo-x86/www-client/mozilla-firefox/ChangeLog?r1=1.232&amp;r2=1.233

Tom Gall, you don&apos;t care, do you?



(In reply to comment #7)
&gt; So make repoman detect those garbled logs?

Have an idea how to do it?</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tove@gentoo.org</who>
            <bug_when>2007-01-06 19:30:43 0000</bug_when>
            <thetext>http://sources.gentoo.org/viewcvs.py/gentoo-x86/www-client/mozilla-firefox/ChangeLog?r1=1.237&amp;r2=1.238
http://sources.gentoo.org/viewcvs.py/gentoo-x86/app-portage/ufed/ChangeLog?r1=1.54&amp;r2=1.55</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2007-01-21 19:43:42 0000</bug_when>
            <thetext>CCing portage folks, repoman really should check for this...

@tgall - could you damn post some response on this bug finally?
</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>genone@gentoo.org</who>
            <bug_when>2007-01-22 11:50:52 0000</bug_when>
            <thetext>(In reply to comment #10)
&gt; CCing portage folks, repoman really should check for this...

Sure, let us know how.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2007-03-09 21:40:48 0000</bug_when>
            <thetext>tgall - are you breaking this on purpose or WTH? Could you kindly respond here finally?! This is getting absurd...

&lt;snip&gt;
21:29:28 &lt;+CIA-1&gt; tgall * gentoo-x86/dev-ruby/fusefs/ (ChangeLog fusefs-0.6.0.ebuild): 
21:29:28 &lt;+CIA-1&gt; added ~ppc64                                                                                                       
21:29:28 &lt;+CIA-1&gt; (Portage version: 2.1.2-r9)                                                                                        
21:35:10 &lt;+CIA-1&gt; tove * gentoo-x86/dev-ruby/fusefs/ChangeLog:                                                                       
21:35:10 &lt;+CIA-1&gt; fixed broken encoding in ChangeLog                     
&lt;/snip&gt;
</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2007-03-10 23:04:02 0000</bug_when>
            <thetext>http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/facets/ChangeLog?r1=1.12&amp;r2=1.13
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/facets/ChangeLog?r1=1.12&amp;r2=1.13
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/dpklib/ChangeLog?r1=1.5&amp;r2=1.6
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/devel-logger/ChangeLog?r1=1.10&amp;r2=1.11

etc. etc. etc.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2007-03-15 10:32:27 0000</bug_when>
            <thetext>http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/sqlite-ruby/ChangeLog?r1=1.29&amp;r2=1.30
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/misen/ChangeLog?r1=1.4&amp;r2=1.5
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/ncurses-ruby/ChangeLog?r1=1.21&amp;r2=1.22
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/nora/ChangeLog?r1=1.8&amp;r2=1.9
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/ruby-fcgi/ChangeLog?r1=1.18&amp;r2=1.19
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/ruby-xslt/ChangeLog?r1=1.7&amp;r2=1.8
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/narray/ChangeLog?r1=1.27&amp;r2=1.28
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/needle/ChangeLog?r1=1.14&amp;r2=1.15
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/mysql-ruby/ChangeLog?r1=1.32&amp;r2=1.33
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/nano-methods/ChangeLog?r1=1.3&amp;r2=1.4
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/og/ChangeLog?r1=1.10&amp;r2=1.11
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/libxml/ChangeLog?r1=1.10&amp;r2=1.11
http://sources.gentoo.org/viewcvs.py/gentoo-x86/dev-ruby/nimage/ChangeLog?r1=1.2&amp;r2=1.3
</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tgall@gentoo.org</who>
            <bug_when>2007-03-15 13:50:05 0000</bug_when>
            <thetext>then as now, the system I&apos;m using is a ppc64 box, vim 7.0.174. There&apos;s really nothing magical about the system at all. 

I&apos;m not breaking anything on purpose. 

&gt; vim foo-whatever.ebuild

usual vim commands here ending with :w, :x

&gt; repoman scan
&gt; repoman commit

Has anything thought about putting together a test data file with DB data in it and testing it with vim on ppc64?

pop into #gentoo-ppc64 if you&apos;d like to check out that route.

adding ppc64@gentoo.org on the CC as should be the case for all ppc64 related bugs. </thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>wolf31o2@gentoo.org</who>
            <bug_when>2007-03-15 14:27:28 0000</bug_when>
            <thetext>Are you using &quot;echangelog&quot; for your ChangeLog entries?  If not, why not?  That might solve the issue for you, as echangelog is UTF8-aware.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tgall@gentoo.org</who>
            <bug_when>2007-03-15 16:44:35 0000</bug_when>
            <thetext>No never have. 

Shouldn&apos;t matter. vim *SHOULD* be utf-8 aware. Did a UTF8 bug get missed in vim?</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ciaran.mccreesh@googlemail.com</who>
            <bug_when>2007-03-15 17:18:22 0000</bug_when>
            <thetext>Vim is only utf-8 aware if you tell it to be. Vim&apos;s documentation goes into this in great depth.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tgall@gentoo.org</who>
            <bug_when>2007-03-15 21:00:00 0000</bug_when>
            <thetext>given that bit of info, shouldn&apos;t http://devmanual.gentoo.org/appendices/editor-configuration/vim/index.html be updated to include the gory details like has been done for emacs at : 

http://devmanual.gentoo.org/appendices/editor-configuration/emacs/index.html ?

Have a deeper link into the vim documentation Ciaran?

Thanks

</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ciaran.mccreesh@googlemail.com</who>
            <bug_when>2007-03-15 21:12:33 0000</bug_when>
            <thetext>Probably, if anyone&apos;s maintaining the devmanual these days. Having said that, you&apos;re supposed to use echangelog, not vim.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ranger@gentoo.org</who>
            <bug_when>2007-03-15 21:25:18 0000</bug_when>
            <thetext>Tom, good point here to use echangelog.  echangelog seems to use nano but for what it is worth, if the variable EDITOR is set to /usr/bin/vim then echangelog will invoke vim.  And we&apos;re back to Tom&apos;s problem. 

Tom do you know what to fix now?</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>wolf31o2@gentoo.org</who>
            <bug_when>2007-03-16 17:02:08 0000</bug_when>
            <thetext>I was thinking more like:

echangelog &quot;This is my ChangeLog message.  There are many like it, but this one is mine.&quot;

;]</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>fuzzyray@gentoo.org</who>
            <bug_when>2007-03-26 22:16:47 0000</bug_when>
            <thetext>I just hit this myself. When editing a Changelog, vim shows:
fileencoding=utf-8

Any changes I make will cause the UTF-8 encoding to be broken.  However, if I manually set &quot;fileencoding=latin1&quot; then it doesn&apos;t break. This doesn&apos;t seem to be inline with vim&apos;s documentation and I find it to be confusing.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ciaran.mccreesh@googlemail.com</who>
            <bug_when>2007-03-26 22:21:00 0000</bug_when>
            <thetext>fileencoding in vim contains what the file is *now*, not what it was when it was opened. If vim can&apos;t figure out the file encoding on its own, you need to open a file using the ++enc option.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tgall@gentoo.org</who>
            <bug_when>2007-04-01 02:58:31 0000</bug_when>
            <thetext>Getting back to the original bug (as I&apos;m back from a business trip and plenty of real life crap)

so are you saying Ciaran that perhaps vim&apos;s ability to detect the encoding of the file might be buggy or the files are mislabeled? 

Guess I&apos;d like to understand a bit more how vim does this encoding detection magic. 

</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ciaran.mccreesh@googlemail.com</who>
            <bug_when>2007-04-01 13:51:41 0000</bug_when>
            <thetext>Vim&apos;s detection isn&apos;t buggy. It&apos;s just that it&apos;s impossible to determine encoding automatically in many situations because most documents are valid in most encodings. Like I said, Vim&apos;s documentation explains all.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tgall@gentoo.org</who>
            <bug_when>2007-04-01 21:54:53 0000</bug_when>
            <thetext>adding the vim team onto the cc. 

The little bit about GLEP31 and gentoo-syntax changes to utf-8 being the default seems to be the interesting bit of trivia.

In review: 

1) vim and ppc64 and amd64 seems to have issues when the ebuild/changelog have utf8 data in them. 

2) Comment 23 from Paul seems to suggest that fileencoding=latin1 avoid the problem. (And I&apos;ve confirmed on ppc64)

I&apos;m going to rebuild vim on my box with the ignore-glep31 USE flag and see if that has any effect. 

Given that this is affecting two gentoo architectures, seems like the ownership of this bug probably need to fall into the hands of those that implemented glep31 or the vim team.
</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>tgall@gentoo.org</who>
            <bug_when>2007-04-01 21:59:53 0000</bug_when>
            <thetext>rebuilding gentoo-synxtax with ignore-glep31 fixes this bug.

</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ciaran.mccreesh@googlemail.com</who>
            <bug_when>2007-04-01 22:02:09 0000</bug_when>
            <thetext>This has nothing to do with architecture, and using latin1 will lead to broken display and broken files. This is user error and nothing more.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>fuzzyray@gentoo.org</who>
            <bug_when>2007-05-22 21:17:11 0000</bug_when>
            <thetext>How do we get this fixed? In order for me to not break the ChangeLog, I have to do a set fileencoding=latin1. I have read through the documentation and I can not find how I have vim misconfigured that doing the above causes it to work correctly.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>ciaran.mccreesh@googlemail.com</who>
            <bug_when>2007-05-22 21:22:18 0000</bug_when>
            <thetext>You need to make sure that fileencoding is set to utf-8 *before* you open up the ChangeLog file. The easiest way to do this is using one of the ++enc options, which are described at length in the documentation.</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>jakub@gentoo.org</who>
            <bug_when>2007-07-12 13:37:53 0000</bug_when>
            <thetext>Uh. Seriously, a developer unable to set up $EDITOR properly is not a bug; closing this, as in &quot;read the fine manual&quot;. :P
</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>halcy0n@gentoo.org</who>
            <bug_when>2008-01-18 02:04:43 0000</bug_when>
            <thetext>Ignore me...</thetext>
          </long_desc>
          <long_desc isprivate="0">
            <who>halcy0n@gentoo.org</who>
            <bug_when>2008-01-18 02:05:55 0000</bug_when>
            <thetext>Nothing to see here...just fixing the resolution (if invalid could be called a fix...its definitely not a &quot;remind&quot; though :) )</thetext>
          </long_desc>
      
    </bug>

</bugzilla>