Packages should never depend on whole xorg-x11, instead only on libraries they really depend on. See Porting to modular X howto for details: http://www.gentoo.org/proj/en/desktop/x/x11/porting-modular-x-howto.xml
done