580934 – sys-apps/portage: buildpkg should support multithreaded bzip2 compressors

Bug 580934 - sys-apps/portage: buildpkg should support multithreaded bzip2 compressors

Summary: sys-apps/portage: buildpkg should support multithreaded bzip2 compressors

Status:	RESOLVED INVALID

Alias:	None

Product:	Portage Development
Classification:	Unclassified
Component:	Enhancement/Feature Requests (show other bugs)
Hardware:	All Linux

Importance:	Normal normal (vote)
Assignee:	Portage team

URL:
Whiteboard:
Keywords:

Depends on:
Blocks:

Reported:	2016-04-23 11:55 UTC by Lars Wendler (Polynomial-C) (RETIRED)
Modified:	2016-04-23 12:43 UTC (History)
CC List:	0 users

See Also:
Package list:
Runtime testing required:	---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description Lars Wendler (Polynomial-C) (RETIRED) gentoo-dev

2016-04-23 11:55:37 UTC

Running "emerge -ev --buildpkg --keep-going @world" right now shows that portage only utilizes one CPU core when creating the binpackages.
From what I see in the process list it seems portage is doing something similar like

  tar -cf ... | bzip2

which of course results in the compression being single-threaded because app-arch/bzip2 is not SMP capable.

I'd like to request the possibility to create binary packages with full utilization of as much CPU cores as possible when being on multicore systems. We already have two bzip2 compresors in the portage tree that have SMP support:

  app-arch/lbzip2
  app-arch/pbzip2

Comment 1 Lars Wendler (Polynomial-C) (RETIRED) gentoo-dev

2016-04-23 12:43:19 UTC

Turns out I'm just too stupid to read man pages.

mgorny told me about PORTAGE_BZIP2_COMMAND variable which indeed serves my needs.