/usr/bin/Xorg shouldn't be setuid.
And what instead? startx?
setuid bit is now configurable via USE="suid" (bug 419485), so I will mark this as fixed too.