Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 263255 - A change in portage to lower bandwidth usage needed(some ideals on how two do so)
Summary: A change in portage to lower bandwidth usage needed(some ideals on how two d...
Status: CONFIRMED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Enhancement/Feature Requests (show other bugs)
Hardware: All Linux
: High enhancement (vote)
Assignee: Portage team
URL: http://www.gentoo.org/proj/en/glep/gl...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-03-21 14:00 UTC by Joe Stein
Modified: 2023-09-21 12:34 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Joe Stein 2009-03-21 14:00:36 UTC
I have a problem that i got to try and keep the amount i download so i don't git disconnect from the net my isp. My Isp ask me to keep in under so many gigabyte and I like keep up-to-date with programs like java, gcc, qt, netbeans.
I'm a person work like to work with development tools.  

The problem is buy try to keep these tool up-to-date I quickly go over my limit.

I have some idea how to lower the bandwidth portage is using and
 
-------------- would like your input -------------------------

on if my idea are doable and if you are able and are will to develop such tools.

----If you are not-----
1)
-Could you please give me links to info that would help me try do it myself and
2)
-Could you tell me how you would do it if you done it your self. 
******************************      
______Ideal 1_____________
*******************************
I think much of the bandwidth that portage use can be  greatly reduce buy download just the difference instead of the whole file each time emerge needs to fetch a file. 

i think I have a couple ways of doing this and have been doing a lot of research on the net about this.

----Method 1 ----
I think this can be accomplish buy have portage download it from svn or another repertory server use what i believe are called tages and download that specific branch that portage would download from scratch other wise. I can't seemed to find if svn compress the diff before sending them or not so may not help alot if the diff are not compressed but in some case i think still be shorter.          
---Method 2------
down load the patch that most people provide and apply that two the original source instead

*******************************************
---idea 2-------------------------------
******************************************
I would like a portage feature to save all ebuild in an overlay dir that i used so there not lost in the sync operation that way when i emerge world it won't have two down load a new version of a file because it lost the ebuild do to a sync operation.
****************************************
-------------idea 3---------------------------
*************************************** 
I would like a feature in portage to keep sync  /usr/portage/ on two or more different computer during the emerge cycle.  

----------I'm using nfs to share portage right know,----------
but some time it dose not mount it at boot for an unknown reason 
and dose not make a backup this way.
---- I know I can add a script to portage to do this ------------
but i'm not really good at wright scripts for Linux just yet but am working on it.  I think a user should not have to write a script to do this.  It help save band with on emerge --sync as well as some mirror buy not download duplicate files.   



Note:
Be a developer myself I would like to help but i think such a thing is far from my reach since i'm a c++ developer and don't know any python.  I'm not really a good c++ developer to be honest dis-spite my best effort and many year of research i did on my own for about 10 year now. I never went to collage because i didn't want to take any more english class or other bull crap class to learn c++ development.


Reproducible: Always

Steps to Reproduce:

example on band with saving idea  

from idea #1------------------------------
emerge  -av wine
or other large file 
wait a coulple of mouth till a new version realse  
emerge  -av wine

from ideal 2-------------------------------

emerge  -av world 
wait a couple of months   
emerge  -av world

from ideal #3 ----------------------
get two computer emerge --sync on both
Actual Results:  
from ideal 1
need to down whole file instead of diffs
from ideal 2 
need to re-download a new ebuild because ebuild no longer there (to old) 
from ideal 3
dose not share band with you other computer wasting gentoo mirror bandwith and other problems 

Expected Results:  
from ideal #1
Dowload only the diff(a patch or git it diff from svn) 
from ideal #2
old ebuild should still be there just a recompile is needed(not expect suport for it thou) 
from ideal #3
keep sync of /usr/portage on more than one computer. This sould not require a complicate setup even thou there are work arounds.


In conclusion I would like to see portage be a little more bandwidth friendly.  I live in the contrary in the usa.  Here it seem to me getting a good isp is difficult and  I am limit two how much i can download.
Comment 1 Peter Alfredsen (RETIRED) gentoo-dev 2009-03-21 22:46:42 UTC
Hm.. dev-portage, do you want this bug (which proposes glep-25 like behavior)?
Comment 2 Joe Stein 2009-03-22 12:23:30 UTC
I not sure what you are asking or trying to tell me but do a little research with Google tell me I found that 

glep  stand for 

Gentoo Linux Enhancement Proposals

found here 
http://www.gentoo.org/proj/en/glep/glep-0001.html

and there this page
 
http://www.gentoo.org/proj/en/glep/glep-0025.html

which look to me that glep-25 is a proposal for one way to do most of what i want.

So are you Try to tell me it being work on? (the strange thing here the site say it been in the work since 2004)

Is it dead or been rejected?

Is this what going into a development version of portage? 
 
Comment 3 Alec Warner (RETIRED) archtester gentoo-dev Security 2009-03-22 21:29:54 UTC
GLEP 25 is marked deferred, which means no one finished it, basically.