On osprey is currently only about 7.5 gig of free space on /mnt/distfiles (out of 200 gig). We could probably free some space from /mnt/distfiles/releases-purgatory by removing at least the 2008.0_beta1 and 2008.0_beta2 stages.
I'll move them to my archival later, just on my way out the door now.
It's down to about 5 gig now.
I've tweaked the variables inside /home/gmirror/scripts/update_distfiles.sh in order to free some space: PURGATORY_DEATH_WATCH_INTERVAL=$((7 * 24 * 60 * 60)) DEATH_WATCH_INTERVAL=$((3 * 24 * 60 * 60)) So, files are moved from /mnt/distfiles/distfiles to /mnt/distfiles/distfiles-purgatory after 3 days and then 7 days later they are removed from the purgatory. After making that change we've got almost 8 gig free.
releases-purgatory backed up and cleaned out. 50G now available. I still need to either transfer the backup to my home box, or find somewhere else with LTO3 that can dump it to tape for me.
Space is really low again.
Side note: If we want to save space by making the distfiles mirroring script hardlink files from distfiles-local, the files in distfiles-local will have to be owned by the distfiles user. They are currently have root:root ownership and hardlink creation fails with EPERM (seemingly due to some kernel security feature).
zmedico: 1. all the files in distfiles-local that are copied from woodpecker are now chowned to distfiles:distilfes. 2. I've got a hardlink in place for local -> main. 3. now we just need hardlink for main/purgatory. ferringb: This is the hardlink stuff I wanted to discuss with you, put any comments in this bug.
It's 100% full right now...
Right, I was going to rewrite mirror-dist with hardlinking... We solve this now how?
Created attachment 242741 [details] gentoo-x86 distfiles breakdown Attached is a breakdown of which packages are referencing what percentile of the unique total of distfiles needs. The interesting thing here is that the total here for distfiles is around 93GB, with 6GB shared (shared between unique pkgs, rather than shared between pkg versions). Mirror is at 117GB as the current needs, yet the raw distfiles should be around 93GB- something is whacked there. Assuming mirror-dist isn't screwing up, that puts around 24GB of whitelists...
Back at 88% now. ferringb, zmedico: can either of you generate me a list of files that are ONLY still present because they are whitelisted (and not pulled in by anything in the current tree), and which whitelist they are in.
Created attachment 242905 [details] script that lists distfiles not referenced by SRC_URI for all whitelists
Created attachment 242909 [details] output from distfiles-whitelist-analysis.py run on osprey (In reply to comment #11) > ferringb, zmedico: can either of you generate me a list of files that are ONLY > still present because they are whitelisted (and not pulled in by anything in > the current tree), and which whitelist they are in. There's one row for each whitelist and the first column is the whitelist name.
It's up to 95% right now.
It filled all the way to 100%. I removed /mnt/distfiles/distfiles-purgatory to free some space. It's got about 1.5G free now, and it's trying to catch up with stuff that failed due to lack of space: http://dev.gentoo.org/distfile-mirroring/
100% full again, I'll bug the arch teams to get moving on /experimental mirroring to offload that service.
(In reply to comment #16) > 100% full again, I'll bug the arch teams to get moving on /experimental > mirroring to offload that service. 0 space free. Robin, please advise on turning off the experimental/releases services. Those have been migrated off osprey. Thanks.
/dev/md/5 201G 171G 31G 85% /mnt/distfiles looks alright for the moment
