Bug 473668

Summary:	app-portage/emerge-delta-webrsync: snapshot-20130615-20130616.patch.bz2 and earlier deltas disappeared
Product:	Portage Development	Reporter:	Ivan Yarych <vanya>
Component:	Tools	Assignee:	Gentoo Infrastructure <infra-bugs>
Status:	RESOLVED OBSOLETE
Severity:	normal	CC:	burcheri.massimo+bugs-gentoo, jnrowe, wbrana, zmedico
Priority:	Normal
Version:	unspecified
Hardware:	All
OS:	Linux
URL:	http://gentoo.osuosl.org/snapshots/deltas/
Whiteboard:
Package list:		Runtime testing required:	---

Description Ivan Yarych 2013-06-18 07:34:06 UTC

When I try to sync portage using emerge-delta-webrsync it always fails now with messages like these:

Looking for available base versions for a delta
fetching patches
--2013-06-18 10:17:58--  http://gentoo.lagis.at/snapshots/deltas/snapshot-20130615-20130616.patch.bz2.md5sum
Resolving gentoo.lagis.at... 83.164.133.198, 2a00:1860:1:2::103
Connecting to gentoo.lagis.at|83.164.133.198|:80... connected.
HTTP request sent, awaiting response... 404 Not Found                                                                                           
2013-06-18 10:17:58 ERROR 404: Not Found.                                                                                                       
                                                                                                                                                
--2013-06-18 10:17:58--  http://ftp.romnet.org/gentoo/snapshots/deltas/snapshot-20130615-20130616.patch.bz2.md5sum                              
Resolving ftp.romnet.org... 194.42.102.4, 2001:67c:1e0::4                                                                                       
Connecting to ftp.romnet.org|194.42.102.4|:80... connected.                                                                                     
HTTP request sent, awaiting response... 404 Not Found                                                                                           
2013-06-18 10:17:59 ERROR 404: Not Found.                                                                                                       
                                                                                                                                                
--2013-06-18 10:17:59--  http://distfiles.gentoo.bg/snapshots/deltas/snapshot-20130615-20130616.patch.bz2.md5sum                                
Resolving distfiles.gentoo.bg... 195.238.84.14                                                                                                  
Connecting to distfiles.gentoo.bg|195.238.84.14|:80... connected.                                                                               
HTTP request sent, awaiting response... 404 Not Found                                                                                           
2013-06-18 10:17:59 ERROR 404: Not Found.                                                                                                       
                                                                                                                                                
failed fetching snapshot-20130615-20130616.patch.bz2.md5sum                                                                                     
no patches found? up to date?                                                                                                                   
                                                                                                                                                

Reproducible: Always

Steps to Reproduce:
1. sudo emerge-delta-webrsync -u
2.
3.
Actual Results:  
Fetching deltas fails.

Expected Results:  
Deltas should be fetched ok.

It appears that servers don't have deltas older than one day anymore. Was this done with purpose? Or is that just a mistake?
At least a week of deltas would be highly appreciated.

Will add any other info if needed, but doubt there is a need for that.

Comment 1 Zac Medico gentoo-dev

2013-06-18 13:59:30 UTC

It looks like the older deltas got lost somehow, because right now I only see snapshot-20130616-20130617.patch.bz2 available on the primary mirror:

  http://gentoo.osuosl.org/snapshots/deltas/

The script that maintains the deltas is supposed to remove older deltas when the combined size of the required deltas exceeds the size of the latest snapshot. Either the older deltas were simply lost somehow, or something went wrong in the script's calculation.

Comment 2 Ivan Yarych 2013-06-23 11:17:11 UTC

Looks like deltas now started to appear. Only older ones are not there.

Comment 3 Zac Medico gentoo-dev

2013-06-23 20:31:47 UTC

(In reply to Ivan Yarych from comment #2)
> Looks like deltas now started to appear. Only older ones are not there.

Yeah, I guess the older deltas got lost somehow. It could have been some kind of bug in the server-side script that removes old deltas, as mentioned in comment #1.

Comment 4 Massimo Burcheri 2013-07-01 09:35:36 UTC

Beside that gap of missing deltas, are new deltas being produced now? Watching this bug I still can't get new deltas. Even after a complete update of the tree and removing /var/tmp/portage/delta-webrsync-* emerge-delta-webrsync -u still tries to fetch some old missing delta:

failed fetching snapshot-20130613-20130614.patch.bz2.md5sum
no patches found? up to date?

Comment 5 Ivan Yarych 2013-07-01 09:41:24 UTC

rm /usr/portage/distfiles/portage-*.tar.bz2
helps.

New deltas seem to generate properly so far.

Comment 6 Alex Legler (RETIRED) archtester

2014-09-01 09:11:18 UTC

Delta availability seems to be gapless until late 2013. I'll assume this bug is obsolete.