svgalib tries to build kernel modules (I think that's a bad idea anyways.) symlink to /usr/src/linux was pointed toward unconfigured source in the past this didn't matter but now it does. Tried using USE="-build" to no avail. Changed the symlink to point toward an old source directory and it worked.
configure your /usr/src/linux