Managed to build and run i3-gaps inside aarch64 VM without any additional patches.
arm64 done, all done