the ipv6 USE flag should be used for the libSM and xauth packages, as it's a configure option (currently just defaults to --enable-ipv6) for both. there's probably others that also need the flag but i just happened to notice these two.
libXmu++
Added for all the packages I found, thanks for the heads-up.
oop we missed one. x11-apps/proxymngr