Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 111306

Summary: Portage speed increases with psyco
Product: Portage Development Reporter: Joshua Schmidlkofer <menion>
Component: Enhancement/Feature RequestsAssignee: Portage team <dev-portage>
Status: RESOLVED WONTFIX    
Severity: enhancement    
Priority: High    
Version: unspecified   
Hardware: All   
OS: Linux   
Whiteboard:
Package list:
Runtime testing required: ---

Description Joshua Schmidlkofer 2005-11-02 16:31:05 UTC
Having been forced from the nice safe world of the old qpkg to the heinously
slow equery, I began wondering about how to speed things up.   On my P3550
Xeons, I took 'equery h ssl' from 58 seconds to 19 seconds. [I did several test,
and it was very consistent'.  All I had to do was install psyco, and add 5 lines
to portage.py

Reproducible: Always
Steps to Reproduce:
1.emerge psyco
2.edit /usr/lib/portage/pym/portage.py
3.run any portage-dependant utility.

Actual Results:  
On a P3-550 a 66% performance improvement on lookup for packages and details. 
Areas that I found be to affected:

 - emerge -g -- cuts my metapickle load time down DRAMATICALLY
 - equery l
 - equery h (+/-66% speed improvement)
 - fixpackages (no timeing date)


sys-apps/portage-2.0.51.22-r3 
dev-lang/python-2.4.2

--- old-portage.py~     2005-11-02 16:30:38.669903318 -0800
+++ portage.py  2005-11-02 14:46:28.031019341 -0800
@@ -9,6 +9,11 @@
 # ===========================================================================
 # START OF IMPORTS -- START OF IMPORTS -- START OF IMPORTS -- START OF IMPORT
 # ===========================================================================
+try:
+    import psyco
+    psyco.full()
+except:
+    pass

 try:
        import sys
Comment 1 Brian Harring (RETIRED) gentoo-dev 2005-11-02 16:42:09 UTC
We're not using psyco...
A) it's x86 centric
B) It bloats the hell out of memory when used in full mode
C) it's helping to cover up crap code for portage

Better notion is tracking down, and fixing the slow code..
Comment 2 SpanKY gentoo-dev 2005-11-02 17:43:11 UTC
you forgot (4) it sometimes crashes randomly like a pos