Is there any way to get the X11 specific stuff out of /usr/bin and stick them in /usr/X11R6/bin (replace bin with lib, include, etc)...
can you possibly narrow down what you mean by x11 specific stuff?
Afiak, acording to FHS (??), only XFree86 should reside in /usr/X11R6 ....
We follow FHS.