There is a bug in the ebuild for vim so when building with USE="-X" or without using X it still has support for X11 and will cause problems if you don't have a X server running. The fix for this was use X && myconf="$myconf --with-x" || myconf="$myconf --without-x" instead of: use X && myconf="$myconf --with-x" Thanks
committed