Bug 675826 – sys-apps/portage: optimize INSTALL_MASK match with and index and minimize fnmatch calls

• Product: Portage Development
• Status: RESOLVED FIXED

[Description Zac Medico 2019-01-19 06:37:15 UTC]

INSTALL_MASK patterns that are anchored by a leading / can be indexed in a tree structure, allowing the number of fnmatch calls to be minimized.

[Comment 1 Zac Medico 2019-01-20 11:30:58 UTC]

Patch posted for review:

https://archives.gentoo.org/gentoo-portage-dev/message/e316232f92cb69156696229df9c58978
https://github.com/gentoo/portage/pull/402

[Comment 2 Larry the Git Cow 2019-01-20 23:31:07 UTC]

The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/proj/portage.git/commit/?id=eb2674c1c2d84b2c9e9923e1c1666cb7a596c36c

commit eb2674c1c2d84b2c9e9923e1c1666cb7a596c36c
Author:     Zac Medico <[e-mail]>
AuthorDate: 2019-01-19 08:39:47 +0000
Commit:     Zac Medico <[e-mail]>
CommitDate: 2019-01-20 22:57:28 +0000

    INSTALL_MASK: index patterns anchored with leading slash (bug 675826)
    
    For scalability, use a tree structure to index patterns that are
    anchored with a leading slash.
    
    Patterns anchored with leading slash are indexed by leading non-glob
    components, making it possible to minimize the number of fnmatch
    calls. For example:
    
      /foo*/bar -> {'.': ['/foo*/bar']}
    
      /foo/bar* -> {'foo': {'.': ['/foo/bar*']}}
    
      /foo/bar/ -> {'foo': {'bar': {'.': ['/foo/bar/']}}}
    
    Bug: https://bugs.gentoo.org/675826
    Signed-off-by: Zac Medico <[e-mail]>

 lib/portage/tests/util/test_install_mask.py | 36 +++++++++++++
 lib/portage/util/install_mask.py            | 84 ++++++++++++++++++++++++++---
 2 files changed, 113 insertions(+), 7 deletions(-)

[Comment 3 Larry the Git Cow 2019-01-21 00:11:37 UTC]

The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=7d999af4a47bf55e53e54713d98d145f935935c1

commit 7d999af4a47bf55e53e54713d98d145f935935c1
Author:     Zac Medico <[e-mail]>
AuthorDate: 2019-01-21 00:01:42 +0000
Commit:     Zac Medico <[e-mail]>
CommitDate: 2019-01-21 00:08:55 +0000

    sys-apps/portage: version bump to 2.3.57
    
     #675756 emerge: compare new SLOT USE to installed SLOT
     #675826 INSTALL_MASK scalability: minimize fnmatch calls
     #675828 pid-sandbox: fix child process signal disposition
    
    Bug: https://bugs.gentoo.org/671498
    Bug: https://bugs.gentoo.org/675756
    Bug: https://bugs.gentoo.org/675826
    Bug: https://bugs.gentoo.org/675828
    Package-Manager: Portage-2.3.57, Repoman-2.3.12
    Signed-off-by: Zac Medico <[e-mail]>

 sys-apps/portage/Manifest              |   1 +
 sys-apps/portage/portage-2.3.57.ebuild | 271 +++++++++++++++++++++++++++++++++
 2 files changed, 272 insertions(+)

[Comment 4 Zac Medico 2019-04-10 04:29:10 UTC]

Fixed in portage-2.3.62.