200095 2007-11-23 16:57 0000 sys-devel/catalyst-2.0.5_pre5 (or svn-trunk) patch to add support for sys-devel/icecream cluster compiling 2007-11-27 14:25:50 0000 1 1 1 Unclassified Gentoo Hosted Projects Catalyst unspecified All Linux RESOLVED FIXED InSVN P2 enhancement --- 200516 1 tais.hansen@osd.dk catalyst@gentoo.org tais.hansen@osd.dk 2007-11-23 16:57:13 0000 Here's a patch which enables sys-devel/icecream support for compiling targets in clusters. Requires the icecream daemon to be running on the host which is running catalyst. It is not necessary to run the daemon inside catalyst as catalyst will use the build host's icecc job directory (/var/cache/icecream). Remember to enable icecream by adding the keyword "icecream" to the options string in /etc/catalyst/catalyst.conf. Also remember to increase the number of make jobs by setting MAKEOPTS in /etc/catalyst/catalystrc. Icecream figures out how many jobs can be distributed automatically so you can set the number of jobs high without overloading the compile host. I.e. MAKEOPTS="-j15" is working just fine here. tais.hansen@osd.dk 2007-11-23 16:57:52 0000 Created an attachment (id=136784) Adds sys-devel/icecream support to catalyst wolf31o2@gentoo.org 2007-11-24 06:24:31 0000 Cool. I'll definitely check this out... wolf31o2@gentoo.org 2007-11-25 05:39:12 0000 Added to SVN... this will be released in a new catalyst shortly... agaffney@gentoo.org 2007-11-25 05:44:46 0000 Just to note, neither of us are familiar with icecream or how its usage differs from that of distcc. If this breaks, you've bought it. We'll also probably CC you on any bugs that people file in this code :) wolf31o2@gentoo.org 2007-11-25 05:48:22 0000 He's such a flirt, isn't he? What he means is we'll need to defer to you on questions until we've gotten a grasp on the functionality of icecream. This is in 2.0.5_pre6 which is going in the tree now. Let me know if it doesn't work for you. tais.hansen@osd.dk 2007-11-27 12:40:47 0000 I'm experiencing an issue with first stage building. The root-in-chroot stuff is doing weird things specifically breaking libperl configure (testing gcc) with permission problems. I'm working on figuring out why although I cannot reproduce it outside catalyst. agaffney@gentoo.org 2007-11-27 12:45:30 0000 Well, since it doesn't affect anything when it's not enabled, we're not going to touch the code. If you find a fix, please submit a patch. tais.hansen@osd.dk 2007-11-27 14:10:10 0000 I've narrowed it down to a bug in icecreams handling of $PATH when searching for the actual compiler. Perl's configure script adds /usr/libexec to $PATH and icecream sees gcc in /usr/libexec/gcc and forgets to check if it's actually a file. I'll have a patch ready for icecream in a few minutes. 136784 2007-11-23 16:57 0000 Adds sys-devel/icecream support to catalyst 2.0.5-icecream-support.diff text/plain SW5kZXg6IGNhdGFseXN0Cj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIGNhdGFseXN0CShyZXZpc2lvbiAxMjYwKQor KysgY2F0YWx5c3QJKHdvcmtpbmcgY29weSkKQEAgLTExMyw2ICsxMTMsMTAgQEAKIAkJcHJpbnQg IkRpc3RjYyBzdXBwb3J0IGVuYWJsZWQuIgogCQljb25mX3ZhbHVlc1siRElTVENDIl09IjEiCiAK KwlpZiAiaWNlY3JlYW0iIGluIHN0cmluZy5zcGxpdChjb25mX3ZhbHVlc1sib3B0aW9ucyJdKToK KwkJcHJpbnQgIkljZWNyZWFtIGNvbXBpbGVyIGNsdXN0ZXIgc3VwcG9ydCBlbmFibGVkLiIKKwkJ Y29uZl92YWx1ZXNbIklDRUNSRUFNIl09IjEiCisKIAlpZiAia2VybmNhY2hlIiBpbiBzdHJpbmcu c3BsaXQoY29uZl92YWx1ZXNbIm9wdGlvbnMiXSk6CiAJCXByaW50ICJLZXJuZWwgY2FjaGUgc3Vw cG9ydCBlbmFibGVkLiIKIAkJY29uZl92YWx1ZXNbIktFUk5DQUNIRSJdPSIxIgpJbmRleDogbW9k dWxlcy9nZW5lcmljX3N0YWdlX3RhcmdldC5weQo9PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBtb2R1bGVzL2dlbmVy aWNfc3RhZ2VfdGFyZ2V0LnB5CShyZXZpc2lvbiAxMjYwKQorKysgbW9kdWxlcy9nZW5lcmljX3N0 YWdlX3RhcmdldC5weQkod29ya2luZyBjb3B5KQpAQCAtMjAyLDYgKzIwMiwxMSBAQAogCQkJIyBm b3IgdGhlIGNocm9vdDoKIAkJCXNlbGYuZW52WyJDQ0FDSEVfRElSIl09Ii92YXIvdG1wL2NjYWNo ZSIJCiAKKwkJaWYgc2VsZi5zZXR0aW5ncy5oYXNfa2V5KCJJQ0VDUkVBTSIpOgorCQkJc2VsZi5t b3VudHMuYXBwZW5kKCIvdmFyL2NhY2hlL2ljZWNyZWFtIikKKwkJCXNlbGYubW91bnRtYXBbIi92 YXIvY2FjaGUvaWNlY3JlYW0iXT0iL3Zhci9jYWNoZS9pY2VjcmVhbSIKKwkJCXNlbGYuZW52WyJQ QVRIIl09Ii91c3IvbGliL2ljZWNjL2JpbjoiK3NlbGYuZW52WyJQQVRIIl0KKwogCWRlZiBvdmVy cmlkZV9jYnVpbGQoc2VsZik6CiAJCWlmIHNlbGYubWFrZWNvbmYuaGFzX2tleSgiQ0JVSUxEIik6 CiAJCQlzZWxmLnNldHRpbmdzWyJDQlVJTEQiXT1zZWxmLm1ha2Vjb25mWyJDQlVJTEQiXQpJbmRl eDogbW9kdWxlcy9jYXRhbHlzdF9zdXBwb3J0LnB5Cj09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIG1vZHVsZXMvY2F0 YWx5c3Rfc3VwcG9ydC5weQkocmV2aXNpb24gMTI2MCkKKysrIG1vZHVsZXMvY2F0YWx5c3Rfc3Vw cG9ydC5weQkod29ya2luZyBjb3B5KQpAQCAtMTU0LDYgKzE1NSw3IEBACiB2YWxpZF9jb25maWdf ZmlsZV92YWx1ZXMuYXBwZW5kKCJLRVJOQ0FDSEUiKQogdmFsaWRfY29uZmlnX2ZpbGVfdmFsdWVz LmFwcGVuZCgiQ0NBQ0hFIikKIHZhbGlkX2NvbmZpZ19maWxlX3ZhbHVlcy5hcHBlbmQoIkRJU1RD QyIpCit2YWxpZF9jb25maWdfZmlsZV92YWx1ZXMuYXBwZW5kKCJJQ0VDUkVBTSIpCiB2YWxpZF9j b25maWdfZmlsZV92YWx1ZXMuYXBwZW5kKCJFTlZTQ1JJUFQiKQogdmFsaWRfY29uZmlnX2ZpbGVf dmFsdWVzLmFwcGVuZCgiQVVUT1JFU1VNRSIpCiB2YWxpZF9jb25maWdfZmlsZV92YWx1ZXMuYXBw ZW5kKCJGRVRDSCIpCkluZGV4OiB0YXJnZXRzL3N1cHBvcnQvY2hyb290LWZ1bmN0aW9ucy5zaAo9 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09Ci0tLSB0YXJnZXRzL3N1cHBvcnQvY2hyb290LWZ1bmN0aW9ucy5zaAkocmV2aXNp b24gMTI2MCkKKysrIHRhcmdldHMvc3VwcG9ydC9jaHJvb3QtZnVuY3Rpb25zLnNoCSh3b3JraW5n IGNvcHkpCkBAIC05OSw2ICs5OSwyMyBAQAogCQljaG1vZCBhK3ggL3Vzci9saWIvZGlzdGNjL2Jp bi8ke0NIT1NUfS13cmFwcGVyCiAJCWZvciBpIGluIGNjIGdjYyBnKysgYysrOyBkbyBsbiAtcyAk e0NIT1NUfS13cmFwcGVyICR7aX07IGRvbmUKIAlmaQorCisJaWYgWyAtbiAiJHtjbHN0X0lDRUNS RUFNfSIgXQorCXRoZW4KKwkJY2xzdF9yb290X3BhdGg9LyBydW5fZW1lcmdlIC0tb25lc2hvdCAt LW5vZGVwcyBzeXMtZGV2ZWwvaWNlY3JlYW0gfHwgZXhpdCAxCisKKwkJIyBUaGlzIHNldHMgdXAg YXV0b21hdGljIGNyb3NzLWljZWNjLWZ1IGFjY29yZGluZyB0bworCQkjIGh0dHA6Ly9nZW50b28t d2lraS5jb20vSE9XVE9fU2V0dXBfQW5fSUNFQ1JFQU1fQ29tcGlsZV9DbHVzdGVyI0ljZWNyZWFt X2FuZF9jcm9zcy1jb21waWxpbmcKKwkJQ0hPU1Q9JChwb3J0YWdlcSBlbnZ2YXIgQ0hPU1QpCisJ CUxJQkRJUj0kKGdldF9saWJkaXIpCisJCWNkIC91c3IvJHtMSUJESVJ9L2ljZWNjL2JpbgorCQly bSBjYyBnY2MgZysrIGMrKyAyPi9kZXYvbnVsbAorCQllY2hvIC1lICcjIS9iaW4vYmFzaFxuZXhl YyAvdXNyLycke0xJQkRJUn0nL2ljZWNjL2Jpbi8nJHtDSE9TVH0nLWckezA6JFstMl19ICIkQCIn ID4gJHtDSE9TVH0td3JhcHBlcgorCQljaG1vZCBhK3ggJHtDSE9TVH0td3JhcHBlcgorCQlmb3Ig aSBpbiBjYyBnY2MgZysrIGMrKzsgZG8gbG4gLXMgJHtDSE9TVH0td3JhcHBlciAke2l9OyBkb25l CisJCWV4cG9ydCBQQVRIPSIvdXNyL2xpYi9pY2VjYy9iaW46JHtQQVRIfSIKKwkJZXhwb3J0IFBS RVJPT1RQQVRIPSIvdXNyL2xpYi9pY2VjYy9iaW4iCisJZmkKIH0KIAogc2V0dXBfbXllbWVyZ2Vv cHRzKCl7CkBAIC0xNjYsNiArMTgzLDE1IEBACiAJcm0gL3Vzci9saWIvZGlzdGNjL2Jpbi8qLXdy YXBwZXIKIH0KIAorY2xlYW51cF9pY2VjcmVhbSgpIHsKKwlMSUJESVI9JChnZXRfbGliZGlyKQor CWZvciBpIGluIGNjIGdjYyBjKysgZysrOyBkbworCQlybSAvdXNyLyR7TElCRElSfS9pY2VjYy9i aW4vJHtpfQorCQlsbiAtcyAvdXNyL2Jpbi9pY2VjYyAvdXNyLyR7TElCRElSfS9pY2VjYy9iaW4v JHtpfQorCWRvbmUKKwlybSAvdXNyLyR7TElCRElSfS9pY2VjYy9iaW4vKi13cmFwcGVyCit9CisK IHVwZGF0ZV9lbnZfc2V0dGluZ3MoKXsKIAkvdXNyL3NiaW4vZW52LXVwZGF0ZQogCXNvdXJjZSAv ZXRjL3Byb2ZpbGUKSW5kZXg6IHRhcmdldHMvc3RhZ2UyL3N0YWdlMi1wcmVjbGVhbi1jaHJvb3Qu c2gKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PQotLS0gdGFyZ2V0cy9zdGFnZTIvc3RhZ2UyLXByZWNsZWFuLWNocm9vdC5z aAkocmV2aXNpb24gMTI2MCkKKysrIHRhcmdldHMvc3RhZ2UyL3N0YWdlMi1wcmVjbGVhbi1jaHJv b3Quc2gJKHdvcmtpbmcgY29weSkKQEAgLTE1LDQgKzE1LDEwIEBACiAJY2xlYW51cF9kaXN0Y2MK IGZpCiAKK2lmIFsgLW4gIiR7Y2xzdF9JQ0VDUkVBTX0iIF0KK3RoZW4KKwlydW5fZW1lcmdlIC1D IHN5cy1kZXZlbC9pY2VjcmVhbSB8fCBleGl0IDEKKwljbGVhbnVwX2ljZWNyZWFtCitmaQorCiBy bSAtZiAvdmFyL2xvZy9lbWVyZ2UubG9nCkluZGV4OiB0YXJnZXRzL3N0YWdlMy9zdGFnZTMtcHJl Y2xlYW4tY2hyb290LnNoCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIHRhcmdldHMvc3RhZ2UzL3N0YWdlMy1wcmVj bGVhbi1jaHJvb3Quc2gJKHJldmlzaW9uIDEyNjApCisrKyB0YXJnZXRzL3N0YWdlMy9zdGFnZTMt cHJlY2xlYW4tY2hyb290LnNoCSh3b3JraW5nIGNvcHkpCkBAIC0xNSw0ICsxNSwxMCBAQAogCWNs ZWFudXBfZGlzdGNjCiBmaQogCitpZiBbIC1uICIke2Nsc3RfSUNFQ1JFQU19IiBdCit0aGVuCisJ cnVuX2VtZXJnZSAtQyBzeXMtZGV2ZWwvaWNlY3JlYW0gfHwgZXhpdCAxCisJY2xlYW51cF9pY2Vj cmVhbQorZmkKKwogcm0gLWYgL3Zhci9sb2cvZW1lcmdlLmxvZwpJbmRleDogdGFyZ2V0cy9ncnAv Z3JwLXByZWNsZWFuLWNocm9vdC5zaAo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSB0YXJnZXRzL2dycC9ncnAtcHJl Y2xlYW4tY2hyb290LnNoCShyZXZpc2lvbiAxMjYwKQorKysgdGFyZ2V0cy9ncnAvZ3JwLXByZWNs ZWFuLWNocm9vdC5zaAkod29ya2luZyBjb3B5KQpAQCAtOCw0ICs4LDkgQEAKIAljbGVhbnVwX2Rp c3RjYwogZmkKIAoraWYgWyAtbiAiJHtjbHN0X0lDRUNSRUFNfSIgXQordGhlbgorCWNsZWFudXBf aWNlY3JlYW0KK2ZpCisKIGdjb25mdG9vbC0yIC0tc2h1dGRvd24KSW5kZXg6IHRhcmdldHMvbGl2 ZWNkLXN0YWdlMS9saXZlY2Qtc3RhZ2UxLXByZWNsZWFuLWNocm9vdC5zaAo9PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0t LSB0YXJnZXRzL2xpdmVjZC1zdGFnZTEvbGl2ZWNkLXN0YWdlMS1wcmVjbGVhbi1jaHJvb3Quc2gJ KHJldmlzaW9uIDEyNjApCisrKyB0YXJnZXRzL2xpdmVjZC1zdGFnZTEvbGl2ZWNkLXN0YWdlMS1w cmVjbGVhbi1jaHJvb3Quc2gJKHdvcmtpbmcgY29weSkKQEAgLTcsMyArNyw4IEBACiB0aGVuCiAJ Y2xlYW51cF9kaXN0Y2MKIGZpCisKK2lmIFsgLW4gIiR7Y2xzdF9JQ0VDUkVBTX0iIF0KK3RoZW4K KwljbGVhbnVwX2ljZWNyZWFtCitmaQpJbmRleDogdGFyZ2V0cy9lbWJlZGRlZC9lbWJlZGRlZC1w cmVjbGVhbi1jaHJvb3Quc2gKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gdGFyZ2V0cy9lbWJlZGRlZC9lbWJlZGRl ZC1wcmVjbGVhbi1jaHJvb3Quc2gJKHJldmlzaW9uIDEyNjApCisrKyB0YXJnZXRzL2VtYmVkZGVk L2VtYmVkZGVkLXByZWNsZWFuLWNocm9vdC5zaAkod29ya2luZyBjb3B5KQpAQCAtNywzICs3LDgg QEAKIHRoZW4KIAljbGVhbnVwX2Rpc3RjYwogZmkKKworaWYgWyAtbiAiJHtjbHN0X0lDRUNSRUFN fSIgXQordGhlbgorCWNsZWFudXBfaWNlY3JlYW0KK2ZpCkluZGV4OiB0YXJnZXRzL3RpbmRlcmJv eC90aW5kZXJib3gtcHJlY2xlYW4tY2hyb290LnNoCj09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIHRhcmdldHMvdGlu ZGVyYm94L3RpbmRlcmJveC1wcmVjbGVhbi1jaHJvb3Quc2gJKHJldmlzaW9uIDEyNjApCisrKyB0 YXJnZXRzL3RpbmRlcmJveC90aW5kZXJib3gtcHJlY2xlYW4tY2hyb290LnNoCSh3b3JraW5nIGNv cHkpCkBAIC03LDMgKzcsOCBAQAogdGhlbgogCWNsZWFudXBfZGlzdGNjCiBmaQorCitpZiBbIC1u ICIke2Nsc3RfSUNFQ1JFQU19IiBdCit0aGVuCisJY2xlYW51cF9pY2VjcmVhbQorZmkK