Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 431158 - sys-kernel/gentoo-sources-3.3.8 - OSError: [Errno 12] Cannot allocate memory
Summary: sys-kernel/gentoo-sources-3.3.8 - OSError: [Errno 12] Cannot allocate memory
Status: RESOLVED INVALID
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: [OLD] Core system (show other bugs)
Hardware: AMD64 OS X
: Normal normal (vote)
Assignee: Gentoo Linux bug wranglers
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-08-12 23:32 UTC by Jeffrey Walton
Modified: 2012-08-13 13:54 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments
Build log from failed install (build.log,5.15 KB, text/plain)
2012-08-12 23:44 UTC, Jeffrey Walton
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jeffrey Walton 2012-08-12 23:32:57 UTC
Tail of the problem is below. Full log is attached.

>>> Installing (4 of 4) sys-kernel/gentoo-sources-3.3.8
Traceback (most recent call last):
  File "/usr/lib64/portage/pym/portage/dbapi/_MergeProcess.py", line 216, in _spawn
    prev_mtimes=self.prev_mtimes, counter=counter)
  File "/usr/lib64/portage/pym/portage/dbapi/vartree.py", line 4526, in merge
    counter=counter)
  File "/usr/lib64/portage/pym/portage/dbapi/vartree.py", line 4027, in treewalk
    phase.start()
  File "/usr/lib64/portage/pym/_emerge/AsynchronousTask.py", line 26, in start
    self._start()
  File "/usr/lib64/portage/pym/_emerge/EbuildPhase.py", line 122, in _start
    self._start_lock()
  File "/usr/lib64/portage/pym/_emerge/EbuildPhase.py", line 139, in _start_lock
    self._start_task(self._ebuild_lock, self._lock_exit)
  File "/usr/lib64/portage/pym/_emerge/CompositeTask.py", line 147, in _start_task
    task.start()
  File "/usr/lib64/portage/pym/_emerge/AsynchronousTask.py", line 26, in start
    self._start()
  File "/usr/lib64/portage/pym/_emerge/AsynchronousLock.py", line 52, in _start
    self.wait()
  File "/usr/lib64/portage/pym/_emerge/AsynchronousTask.py", line 53, in wait
    self._wait_hook()
  File "/usr/lib64/portage/pym/_emerge/AsynchronousTask.py", line 146, in _wait_hook
    self._exit_listener_stack.pop()(self)
  File "/usr/lib64/portage/pym/_emerge/EbuildPhase.py", line 148, in _lock_exit
    self._start_ebuild()
  File "/usr/lib64/portage/pym/_emerge/EbuildPhase.py", line 171, in _start_ebuild
    self._start_task(ebuild_process, self._ebuild_exit)
  File "/usr/lib64/portage/pym/_emerge/CompositeTask.py", line 147, in _start_task
    task.start()
  File "/usr/lib64/portage/pym/_emerge/AsynchronousTask.py", line 26, in start
    self._start()
  File "/usr/lib64/portage/pym/_emerge/AbstractEbuildProcess.py", line 106, in _start
    SpawnProcess._start(self)
  File "/usr/lib64/portage/pym/_emerge/SpawnProcess.py", line 122, in _start
    retval = self._spawn(self.args, **kwargs)
  File "/usr/lib64/portage/pym/_emerge/EbuildProcess.py", line 21, in _spawn
    actionmap=actionmap, **kwargs)
  File "/usr/lib64/portage/pym/portage/package/ebuild/doebuild.py", line 103, in _doebuild_spawn
    return spawn(cmd, settings, **kwargs)
  File "/usr/lib64/portage/pym/portage/package/ebuild/doebuild.py", line 1425, in spawn
    return spawn_func(mystring, env=mysettings.environ(), **keywords)
  File "/usr/lib64/portage/pym/portage/process.py", line 81, in spawn_bash
    return spawn(args, opt_name=opt_name, **keywords)
  File "/usr/lib64/portage/pym/portage/process.py", line 259, in spawn
    pid = os.fork()
  File "/usr/lib64/portage/pym/portage/__init__.py", line 230, in __call__
    rval = self._func(*wrapped_args, **wrapped_kwargs)
OSError: [Errno 12] Cannot allocate memory

>>> Failed to install sys-kernel/gentoo-sources-3.3.8, Log file:

>>>  '/var/tmp/portage/sys-kernel/gentoo-sources-3.3.8/temp/build.log'


Reproducible: Always

Steps to Reproduce:
Follow the installation instructions in the Handbook.
Actual Results:  
Failed to install sys-kernel/gentoo-sources-3.3.8

Expected Results:  
I guess I expected sys-kernel/gentoo-sources-3.3.8 to be installed.

VMWare virtual machine (up to date) on Mac OS X 10.8 (up to date). Two cores dedicated, and 1,536MB (1.5GB) RAM.
Comment 1 Jeffrey Walton 2012-08-12 23:44:59 UTC
Created attachment 321174 [details]
Build log from failed install

Build log from failed install
Comment 2 Chí-Thanh Christopher Nguyễn gentoo-dev 2012-08-12 23:53:53 UTC
> OSError: [Errno 12] Cannot allocate memory

This seems to be a problem with your system configuration rather than with a particular package.
Comment 3 Jeffrey Walton 2012-08-13 00:06:50 UTC
Oops.... different problem this time. It would be nice if the issue was deterministic.

#emerge gentoo-sources
 * Last emerge --sync was 134d 14h 49m 42s ago.
Calculating dependencies                                       ... done!

>>> Verifying ebuild manifests

>>> Emerging (1 of 1) sys-kernel/gentoo-sources-3.3.0
>>> Downloading 'http://distfiles.gentoo.org/distfiles/linux-3.3.tar.bz2'
--2012-08-12 19:54:48--  http://distfiles.gentoo.org/distfiles/linux-3.3.tar.bz2
Resolving distfiles.gentoo.org... 216.165.129.135, 64.50.233.100, 64.50.236.52, ...
Connecting to distfiles.gentoo.org|216.165.129.135|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 78963640 (75M) [application/x-tar]
Saving to: `/usr/portage/distfiles/linux-3.3.tar.bz2'

100%[======================================>] 78,963,640  1.68M/s   in 48s     

2012-08-12 19:55:36 (1.58 MB/s) - `/usr/portage/distfiles/linux-3.3.tar.bz2' saved [78963640/78963640]

 * linux-3.3.tar.bz2 RMD160 SHA1 SHA256 size ;-) ...                     [ ok ]
>>> Downloading 'http://distfiles.gentoo.org/distfiles/genpatches-3.3-1.base.tar.bz2'
--2012-08-12 19:55:37--  http://distfiles.gentoo.org/distfiles/genpatches-3.3-1.base.tar.bz2
Resolving distfiles.gentoo.org... 64.50.233.100, 64.50.236.52, 137.226.34.42, ...
Connecting to distfiles.gentoo.org|64.50.233.100|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2012-08-12 19:55:37 ERROR 404: Not Found.

>>> Downloading 'http://gentoo.osuosl.org/distfiles/genpatches-3.3-1.base.tar.bz2'
--2012-08-12 19:55:37--  http://gentoo.osuosl.org/distfiles/genpatches-3.3-1.base.tar.bz2
Resolving gentoo.osuosl.org... 64.50.233.100, 64.50.236.52
Connecting to gentoo.osuosl.org|64.50.233.100|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2012-08-12 19:55:37 ERROR 404: Not Found.

>>> Downloading 'http://ftp.halifax.rwth-aachen.de/gentoo/distfiles/genpatches-3.3-1.base.tar.bz2'
--2012-08-12 19:55:37--  http://ftp.halifax.rwth-aachen.de/gentoo/distfiles/genpatches-3.3-1.base.tar.bz2
Resolving ftp.halifax.rwth-aachen.de... 137.226.34.42
Connecting to ftp.halifax.rwth-aachen.de|137.226.34.42|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2012-08-12 19:55:38 ERROR 404: Not Found.

>>> Downloading 'http://gentoo.ussg.indiana.edu/distfiles/genpatches-3.3-1.base.tar.bz2'
--2012-08-12 19:55:38--  http://gentoo.ussg.indiana.edu/distfiles/genpatches-3.3-1.base.tar.bz2
Resolving gentoo.ussg.indiana.edu... 156.56.247.195
Connecting to gentoo.ussg.indiana.edu|156.56.247.195|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2012-08-12 19:55:38 ERROR 404: Not Found.

>>> Downloading 'http://gentoo-distfiles.mirrors.tds.net/distfiles/genpatches-3.3-1.base.tar.bz2'
--2012-08-12 19:55:38--  http://gentoo-distfiles.mirrors.tds.net/distfiles/genpatches-3.3-1.base.tar.bz2
Resolving gentoo-distfiles.mirrors.tds.net... 216.165.129.135
Connecting to gentoo-distfiles.mirrors.tds.net|216.165.129.135|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2012-08-12 19:55:38 ERROR 404: Not Found.

!!! Couldn't download 'genpatches-3.3-1.base.tar.bz2'. Aborting.
 * Fetch failed for 'sys-kernel/gentoo-sources-3.3.0', Log file:
 *  '/var/tmp/portage/sys-kernel/gentoo-sources-3.3.0/temp/build.log'

>>> Failed to emerge sys-kernel/gentoo-sources-3.3.0, Log file:

>>>  '/var/tmp/portage/sys-kernel/gentoo-sources-3.3.0/temp/build.log'

 * Messages for package sys-kernel/gentoo-sources-3.3.0:

 * Fetch failed for 'sys-kernel/gentoo-sources-3.3.0', Log file:
 *  '/var/tmp/portage/sys-kernel/gentoo-sources-3.3.0/temp/build.log'
Comment 4 Jeffrey Walton 2012-08-13 00:13:30 UTC
(In reply to comment #2)
> > OSError: [Errno 12] Cannot allocate memory
> 
> This seems to be a problem with your system configuration rather than with a
> particular package.
Well, I have 7 other VMs running fine (Debian, Ubuntu, RedHat, Fedora, Windows XP, Windows Vista, and Windows 7). I'm not sure what's the problem with a VM with 2 cores and 1.5 to 2 GB of memory.

Should I reduce the number of cores in case there is a race?
Should I increase the memory in case the swap file is not being used? If so, how much does Gentoo need?

This installation procedure is not too user friendly, in it appears to be rather fragile. Is it safe to shutdown in the middle due to a failed install (for configuration changes) and then try to pick back up? Or do I get to repeat most of the steps again?
Comment 5 Jeffrey Walton 2012-08-13 00:44:50 UTC
(In reply to comment #4)
> (In reply to comment #2)
> > > OSError: [Errno 12] Cannot allocate memory
> > 
> > This seems to be a problem with your system configuration rather than with a
> > particular package.
> Well, I have 7 other VMs running fine (Debian, Ubuntu, RedHat, Fedora,
> Windows XP, Windows Vista, and Windows 7). I'm not sure what's the problem
> with a VM with 2 cores and 1.5 to 2 GB of memory.
> 
> Should I reduce the number of cores in case there is a race?
> Should I increase the memory in case the swap file is not being used? If so,
> how much does Gentoo need?
> 
> This installation procedure is not too user friendly, in it appears to be
> rather fragile. Is it safe to shutdown in the middle due to a failed install
> (for configuration changes) and then try to pick back up? Or do I get to
> repeat most of the steps again?
I booted to a LiveCD (amd64). I've only used it to try and install(In reply to comment #2)
> > OSError: [Errno 12] Cannot allocate memory
> 
> This seems to be a problem with your system configuration rather than with a
> particular package.
I booted to a recently downloaded Gentoo LiveCD (x64). The only thing(s) I've done in this environment is try to install Gentoo per the handbook (and look for answers to questions on the web).

It looks like there are massive memory issue(s) with the software on this LiveCD. Nearly 1.5GB of RAM has been consumed.

Gentoo-2012 linux # top
top - 20:38:16 up  3:01,  5 users,  load average: 0.07, 0.21, 0.17
Tasks: 163 total,   2 running, 153 sleeping,   0 stopped,   8 zombie
%Cpu(s):  1.4 us,  1.4 sy,  0.0 ni, 97.3 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
Kb Mem:   1538216 total,  1508064 used,    30152 free,    36968 buffers
Kb Swap:        0 total,        0 used,        0 free,   587652 cached

  PID USER      PR  NI  VIRT  RES  SHR S  %CPU %MEM    TIME+  COMMAND           
17853 root      20   0  266m 135m  19m S   3.7  9.0   2:45.59 X                 
19758 gentoo    20   0  622m  35m  13m S   2.7  2.4   0:34.75 konsole           
19187 gentoo    20   0  605m  22m 7572 S   0.7  1.5   0:47.87 kwin              
18878 root      20   0  119m 9.8m 1656 S   0.3  0.7   0:06.21 wicd              
19109 gentoo    20   0 21624 2452  680 S   0.3  0.2   0:01.41 dbus-daemon       
19224 gentoo    20   0  418m   9m 3344 S   0.3  0.7   0:00.35 akonadi_mailfil   
19465 root      20   0     0    0    0 R   0.3  0.0   0:00.07 kworker/1:1       
20099 gentoo    20   0  265m  10m 3932 S   0.3  0.7   0:09.00 kdesu             
20857 root      20   0 25652 1676 1220 R   0.3  0.1   0:00.17 top               
    1 root      20   0  4120  676  572 S   0.0  0.0   0:01.36 init              
    2 root      20   0     0    0    0 S   0.0  0.0   0:00.00 kthreadd          
    3 root      20   0     0    0    0 S   0.0  0.0   0:01.13 ksoftirqd/0       
    5 root      20   0     0    0    0 S   0.0  0.0   0:00.03 kworker/u:0       
    6 root      rt   0     0    0    0 S   0.0  0.0   0:00.00 migration/0       
    7 root      rt   0     0    0    0 S   0.0  0.0   0:00.00 migration/1       
    9 root      20   0     0    0    0 S   0.0  0.0   0:00.27 ksoftirqd/1       
   11 root       0 -20     0    0    0 S   0.0  0.0   0:00.00 cpuset
Comment 6 Graham Murray 2012-08-13 07:08:41 UTC
(In reply to comment #5)
> > 
> I booted to a recently downloaded Gentoo LiveCD (x64). The only thing(s)
> I've done in this environment is try to install Gentoo per the handbook (and
> look for answers to questions on the web).
> 
> It looks like there are massive memory issue(s) with the software on this
>

Just a check. You have done the chroot and are installing onto the hard drive image? Otherwise you could be installing to the LiveCD RAM disk which will get filled and cause out of memory errors.
Comment 7 Göktürk Yüksek archtester gentoo-dev 2012-08-13 13:54:22 UTC
(In reply to comment #5)
> It looks like there are massive memory issue(s) with the software on this
> LiveCD. Nearly 1.5GB of RAM has been consumed.
> 
I'd suggest you use a minimal installation cd [0], rather than a full-fledged live dvd. The installation procedure doesn't require a graphical user environment anyway.

If you experience the problem again, would you append the output of 'df' and 'free' to your comments?

[0] http://distfiles.gentoo.org/releases/amd64/autobuilds/current-iso/