I successfully compiled the app-crypt/libu2f-host ebuild version 1.1.10 on a Pinebook Pro with arm64 and used a YubiKey to login to a website using Firefox. Please add the ~arm64 keyword.
Thanks for the request!
arm64 done all arches done