Please keyword dev-texlive/texlive-xetex and app-text/xdvipdfmx with ~x86-macos. I see no problem during emerging them by keywording in an overlay and compiling a file with installed xelatex. The versions I tested are texlive-xetex-2007 and xdvipdfmx-0.4.
Done, thanks!