Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 218901 - app-portage/deltup need support of lzma compression
Summary: app-portage/deltup need support of lzma compression
Status: RESOLVED UPSTREAM
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal enhancement with 2 votes (vote)
Assignee: No maintainer - Look at https://wiki.gentoo.org/wiki/Project:Proxy_Maintainers if you want to take care of it
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-04-22 15:26 UTC by Yaroslav Isakov
Modified: 2013-02-27 05:11 UTC (History)
3 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Yaroslav Isakov 2008-04-22 15:26:35 UTC
Hello, after last weekly update I found that some distfiles was packed with lzma (such as coreutils-6.10.tar.lzma, m4-1.4.11.tar.lzma and others). So I ask developers to add support of .lzma in deltup/getdelta.
Comment 1 Bodo Thiesen 2011-08-24 07:51:16 UTC
There are very many lzma encoders out there which produce different lzma files for the same input file.

Example: libpng-1.2.26.tar compressed with the lzma command line tool from the 7zip distribution using the command line lzma-$v e -si -so < tars/libpng-1.2.26.tar > libpng-1.2.26.tar.lzma-$v (where $v is the version) creates this files:

-rw-r--r-- 1 root    root    500691 23. Aug 14:32 libpng-1.2.26.tar.lzma-4.27
-rw-r--r-- 1 root    root    500819 23. Aug 14:32 libpng-1.2.26.tar.lzma-4.43
-rw-r--r-- 1 root    root    500819 23. Aug 14:32 libpng-1.2.26.tar.lzma-4.57
-rw-r--r-- 1 root    root    500872 23. Aug 14:32 libpng-1.2.26.tar.lzma-4.63
-rw-r--r-- 1 root    root    500872 23. Aug 14:32 libpng-1.2.26.tar.lzma-4.65
-rw-r--r-- 1 root    root    500872 23. Aug 14:32 libpng-1.2.26.tar.lzma-9.20

So we have at least three different encoders with this one package.

Trying lzma from lzma-utils-4.32.0_beta5 (with default settings) I even get another output file:

-rw-r--r-- 1 root    root    500404 23. Aug 23:18 libpng-1.2.26.tar.lzma-utils-4.32.0_beta5

So the problem of adding support for lzma is, that the server would have to test very encoders maybe with different settings and the clients would also need to have every encoder installed in order to be able to decompress all files.

The bottom line is: It's very unlikely to get lzma support in deltup as long as we need the compressed checksums to match. I just filed a feature request on portage #380443 which addresses this problem. I'd say, as soon as that got implemented, the deltup server can just decompress the tar files in question, create the dtu file from them and let it up to the receiver to recompress the target file with it's compressor ignoring the compressed checksum alltogether.
Comment 2 eroen 2012-08-13 17:05:36 UTC
Not attempting to obtain a diff at all for files ending with .xz or .lzma (and possibly their tarisms) would also be better than the current state.
Comment 3 Paul Varner (RETIRED) gentoo-dev 2012-12-26 20:38:16 UTC
Reassigning to maintainer-needed since package was not being maintained by anyone in tools-portage herd.
Comment 4 Michael Palimaka (kensington) gentoo-dev 2013-02-27 05:11:31 UTC
Apart from the problems mentioned in previous comments, this really is more of an upstream issue.