87859 2005-04-03 18:39 0000 Suggestion for distcc improvement in a multi-architecture network 2005-06-18 12:40:22 0000 1 1 1 Unclassified Gentoo Linux Development unspecified All All RESOLVED FIXED P2 enhancement --- 1 adq_dvb@lidskialf.net morfic@gentoo.org lisa@gentoo.org adq_dvb@lidskialf.net 2005-04-03 18:39:50 0000 This is just a suggestion for a change I've found to be useful. Feel free to ignore if it its not any good :) I just thought it might be handy. The problem is machine A is i686-pc-linux-gnu. machine B is powerpc-pc-linux-gnu (well actually its not in my network, but this is a better example for various reasons). Now I can install a cross compiler on B so that A can distribute jobs to it no problem, as long as machine A uses the full compiler name - i686-pc-linux-gnu-XXX. However, there is an issue with the current symlinks in /usr/lib/distcc/bin on machine A. Since cc,c++,gcc,g++ are just linked directly to distcc, machine B will be asked to invoke just 'gcc', where really it should be asked to invoke i686-pc-linux-gnu-gcc. The result is the compilation fails because it will be asked to use an (i386 based) architecture it knows nothing about. This is fixable with a simple change to distcc-config - instead of symlinks for cc,c++,gcc,g++, create shell scripts like the following on machine A (this would be called g++): #!/bin/sh exec x86_64-pc-linux-gnu-g++ "$@" This way, it will always use the full compiler name with distcc, which will then be passed to machine B, which will then invoke the correct cross compiler. Theres a sample version of distcc-config patched to do this at http://lidskialf.net/distcc-config. adq_dvb@lidskialf.net 2005-04-03 18:42:00 0000 sorry, the sample script I included should be: #!/bin/sh exec i686-pc-linux-gnu-g++ "$@" Too many machines here :) lisa@gentoo.org 2005-04-19 06:03:41 0000 Can you post a diff of your distcc-config and the one in Portage please? adq_dvb@lidskialf.net 2005-04-19 06:12:35 0000 Created an attachment (id=56655) Example modification to use shell scripts Here you go. It now also creates a 'cc' shell script, which calls ${ARCH}-gcc since none of the cross compilers I created installed a ${ARCH}-cc link. lisa@gentoo.org 2005-05-31 04:26:41 0000 Markus, what do you think of this for the next version? morfic@gentoo.org 2005-06-04 14:43:19 0000 i don;t know about he change to distcc-config but i surely agree that the exec fullpath-gcc "$@" and exec fullpath-g++ "$@" scripts should be required to allow proper cross compiling, i didn't test the distc-config change yet, i simply as suggested by agaffney made gcc and g++ said scripts, linked CC and C++ to gcc and g++ respectively and now qt and boost compile as they should since the correct compiler is invoked on the host if this should be behind a USE flag, so be it :) at least it keeps us from having to setup manually a working cross compile capable distcc each time we upgrade if anyone can think of a way to get the ful path/name over to the host w/o shells, would be great, until then, this is good stuff morfic@gentoo.org 2005-06-04 14:44:10 0000 sorry, i always forget to add me to CC: with the comment morfic@gentoo.org 2005-06-12 14:01:09 0000 can i add it then if you are too busy? pYrania@gentoo.org 2005-06-12 17:45:03 0000 As I'm too busy with other stuff right now, just go ahead, morfic. pYrania@gentoo.org 2005-06-12 17:46:29 0000 reassigning. morfic@gentoo.org 2005-06-18 12:40:22 0000 2.18.3-r8 is now in portage, thanks Andrew 56655 2005-04-19 06:12 0000 Example modification to use shell scripts distcc-config.patch text/plain LS0tIC91c3IvYmluL2Rpc3RjYy1jb25maWcJMjAwNS0wNC0wMiAxNjowODo0NC4wMDAwMDAwMDAg KzAxMDAKKysrIGRpc3RjYy1jb25maWctYWRxCTIwMDUtMDQtMDcgMTQ6MDY6MjMuMDAwMDAwMDAw ICswMTAwCkBAIC02NSw3ICs2NSwyMiBAQAogZGVmIHBlcm1pc3Npb25zKHBhdGgsdXNlcixncm91 cCk6CiAJZm9yIGZpbGUgaW4gb3MubGlzdGRpcihwYXRoKToKIAkJI3ByaW50ICdDb25maWd1cmlu ZycscGF0aCtmaWxlKycuLi4nCi0JCW9zLmNob3duKHBhdGgrZmlsZSx1c2VyLGdyb3VwKQorCQlv cy5jaG1vZChwYXRoK2ZpbGUsMDc1NSkKKworZGVmIGluc3RhbGxvdmVycmlkZXMoY2hvc3QpOgor CWZvciBmaWxlIGluIFsnZ2NjJywgJ2MrKycsICdnKysnXToKKwkJcGF0aCA9ICcvdXNyL2xpYi9k aXN0Y2MvYmluLycKKwkJaWYgb3MucGF0aC5leGlzdHMoJy91c3IvYmluLycrY2hvc3QrJy0nK2Zp bGUpOgorCQkJaWYgb3MucGF0aC5leGlzdHMocGF0aCtmaWxlKToKKwkJCQlvcy51bmxpbmsocGF0 aCtmaWxlKQorCQkJb3ZlcnJpZGVfY21kID0gb3BlbihwYXRoK2ZpbGUsICd3JykKKwkJCW92ZXJy aWRlX2NtZC53cml0ZSgnIyEvYmluL3NoXG4nKQorCQkJb3ZlcnJpZGVfY21kLndyaXRlKCdleGVj ICcrY2hvc3QrJy0nK2ZpbGUrJyBcIiRAXCJcbicpOworCQkJb3MuY2hvd24ocGF0aCtmaWxlLHVz ZXIsZ3JvdXApCisJb3ZlcnJpZGVfY21kID0gb3BlbihwYXRoKydjYycsICd3JykKKwlvdmVycmlk ZV9jbWQud3JpdGUoJyMhL2Jpbi9zaFxuJykKKwlvdmVycmlkZV9jbWQud3JpdGUoJ2V4ZWMgJytj aG9zdCsnLWdjYycrJyBcIiRAXCJcbicpOworCW9zLmNob3duKHBhdGgrJ2NjJyx1c2VyLGdyb3Vw KQogCiBkZWYgaW5zdGFsbGxpbmtzKGNob3N0PScnKToKIAlmb3IgZmlsZSBpbiBbJ2djYycsICdj YycsICdjKysnLCAnZysrJ106CkBAIC0xMzksNyArMTU0LDcgQEAKIAltYWtlY29uZiA9IG9wZW4o Jy9ldGMvbWFrZS5jb25mJywgJ3InKS5yZWFkKCkKIAljaG9zdCA9IHJlLmNvbXBpbGUoJ0NIT1NU PSIoLiopIicpLnNlYXJjaChtYWtlY29uZikuZ3JvdXAoMSkKIAlwcmludCAnQ3JlYXRpbmcgc3lt bGlua3MuLi4nCi0JaW5zdGFsbGxpbmtzKCkKKwlpbnN0YWxsb3ZlcnJpZGVzKGNob3N0KQogCWlu c3RhbGxsaW5rcyhjaG9zdCkKIAogCXByaW50ICdDaGVja2luZyBwZXJtaXNzaW9ucy4uLicK