Bug 391857 – snapshots/portage-20111124* and delta file are missing

• Status: RESOLVED WONTFIX
• Product: Gentoo Infrastructure

[Description Torsten Veller (RETIRED) 2011-11-25 11:40:00 UTC]

No tree snapshot was created today.

[Comment 1 Nick Bowler 2011-11-25 18:28:39 UTC]

This is probably because the snapshot signing key was allowed to expire yesterday:

  pub   1024D/239C75C4 2007-11-25 Gentoo Portage Snapshot Signing Key (Automated Signing Key)
   Primary key fingerprint: AE54 54F9 67B5 6AB0 9AE1  6064 0838 C26E 239C 75C4
  
  pub  1024D/239C75C4  created: 2007-11-25  expired: 2011-11-24  usage: SC

[Comment 2 Robin Johnson 2011-11-25 20:04:09 UTC]

There will be a new snapshot tmrw, there's a new key already per the other bug, and announced on the lists and relevant pages already.

[Comment 3 Torsten Veller (RETIRED) 2011-11-25 20:19:24 UTC]

And a working delta file will be created? Are you sure the emerge-delta-webrsync script will work?

[Comment 4 Jeremy Olexa (darkside) (RETIRED) 2011-11-26 03:21:58 UTC]

(In reply to comment #3)
> And a working delta file will be created? Are you sure the
> emerge-delta-webrsync script will work?

If it emerge-delta-webrsync doesn't work with missing delta files then it is a bug with the script that zmedico maintains. Infra doesn't have the time to keep monitoring it or rebuilding deltas by hand, as such CC'ing Zac to fix/reopen this bug as he sees fit.

[Comment 5 Zac Medico 2011-11-26 03:42:15 UTC]

In the past, I've handled missing snapshots by copying the snapshot from the day before, and then generated a delta between the identical snapshots.

The snapshot script was migrated off of osprey.g.o months ago, and I don't even know which box it's hosted on now.

[Comment 6 Jeremy Olexa (darkside) (RETIRED) 2011-11-26 03:44:03 UTC]

(In reply to comment #5)
> In the past, I've handled missing snapshots by copying the snapshot from the
> day before, and then generated a delta between the identical snapshots.

Infra doesn't want to do that. Please make the emerge-delta-webrsync more robust.

[Comment 7 Zac Medico 2011-11-26 03:49:00 UTC]

(In reply to comment #6)
> (In reply to comment #5)
> > In the past, I've handled missing snapshots by copying the snapshot from the
> > day before, and then generated a delta between the identical snapshots.
> 
> Infra doesn't want to do that. Please make the emerge-delta-webrsync more
> robust.

Hmm, not sure how to handle that case offhand. I inherited the snapshot/emerge-delta-webrsync maintenance from ferringb a long time ago. I'll CC him in case he has any ideas.

[Comment 8 Jeremy Olexa (darkside) (RETIRED) 2011-11-26 04:00:33 UTC]

Likewise, I/infra has inherited the snapshot stuff, but it should be ran by infra anyway.

Regardless, I've just looked at the mirrors* and the files are there via what I assume is a manual run of the script based on timestamps but it still isn't ideal IMO.

* http://distfiles.gentoo.org/snapshots/deltas/

PS. Maybe you should make emerge-delta-webrsync use xz, but that is OT.

[Comment 9 Robin Johnson 2011-11-26 05:46:25 UTC]

The actual snapshots were generated fine. Just the first day when the key was expired, the signature failed, so the rest of the script bailed out, and while I did fix the script after that, I had another typo that only got caught on the second run.

Anyway, all of the snapshots and deltas DO exist, stop complaining.

[Comment 10 Torsten Veller (RETIRED) 2011-11-26 06:24:23 UTC]

Thanks.

Anyway, I have an additional question:
What should I do if it happens again? Does infra accept another bug to rerun the scripts? Or who should be bugged instead?

[Comment 11 Robin Johnson 2011-11-26 06:40:37 UTC]

file a new bug and CC portage.