Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 210945

Summary: transitioning to lzma snapshots for emerge-webrsync
Product: Portage Development Reporter: SpanKY <vapier>
Component: UnclassifiedAssignee: Portage team <dev-portage>
Severity: enhancement CC: esigra, infra-bugs
Priority: High Keywords: InVCS
Version: unspecified   
Hardware: All   
OS: All   
Package list:
Runtime testing required: ---
Bug Depends on:    
Bug Blocks: 216231    

Description SpanKY gentoo-dev 2008-02-21 07:53:59 UTC
the .lzma snapshot tends to be ~90% of the .bz2 (so a savings of ~3meg):
27395597  portage-20080219.tar.lzma
30761597  portage-20080219.tar.bz2
239564800 portage-20080219.tar

and it takes about ~30% of the time (this is a ~2gigz amd64 system):
12.5s     time bzcat portage-20080219.tar.bz2 > /dev/null
4.0s      time lzcat portage-20080219.tar.lzma > /dev/null

lzma-utils is keyworded on all arches
Comment 1 Mike Doty (RETIRED) gentoo-dev 2008-02-21 17:06:31 UTC
won't this require long term support in portage before we can drop tbz2?  This would imply that we would have to generate and ship both for some time(probably a year)

portage peeps:  please advise.
Comment 2 Zac Medico gentoo-dev 2008-02-21 23:53:43 UTC
It will be smoothest for users if we provide both types of snapshots for a period of time (maybe a year or so). That way they can use an older version of emerge-webrsync to fetch a bzip2 snapshot containing a newer version that supports lzma snapshots.
Comment 3 SpanKY gentoo-dev 2008-02-22 04:46:57 UTC
"tbz2" is the short name for Gentoo binary packages.  however, we're talking about snapshots, not binary packages here (for now!).

yes, we need emerge-webrsync first to be updated, that's why the bugs assigned to portage.  i dont know anything about the snapshot process though to say what all needs to be updated.

a transition period is ideal.
Comment 4 SpanKY gentoo-dev 2008-02-23 01:18:16 UTC
emerge-webrsync should support lzma files now if someone wants to give it a try
Comment 5 SpanKY gentoo-dev 2008-03-17 03:46:04 UTC
so what's the next step ?
Comment 6 Zac Medico gentoo-dev 2008-03-17 07:20:00 UTC
I've adjusted the scripts on osprey/redtail to create the lzma snapshots. Now there is a portage-20080316.tar.lzma snapshot that can be used to test emerge-webrsync as soon as it propagates to the mirrors.
Comment 7 Marius Mauch (RETIRED) gentoo-dev 2008-03-20 18:15:00 UTC
This is supposed to be fixed in portage-2.2_pre5 or earlier.
Comment 8 Marius Mauch (RETIRED) gentoo-dev 2008-03-20 18:15:46 UTC
This is supposed to be fixed in portage-2.2_pre5 or earlier.
Comment 9 SpanKY gentoo-dev 2008-03-20 19:10:26 UTC
i just tested said version and it seems to be working for me

[   ] portage-20080319.tar.bz2                           20-Mar-2008 01:55   30M
[   ] portage-20080319.tar.lzma                          20-Mar-2008 01:55   26M

every meg counts ;)