I'm not sure how you'd want to fix that. I guess have it query for which type of X you are using and grab the sources from the correct location.
Go ahead and make an xdirectfb patch that applies cleanly to xorg-x11. I'll gladly add it. Til then, I'm closing this. Please reopen if you do add that patch.