Found that "use_with xml system-libxml" is used within the .ebuild so i'd say it should be in IUSE also in that case - otherwise, why not?
That was an oversight of mine, the xml-use-flag is not used anymore, we now always depend on libxml2, just forgot to fix the logic in the ebuild itself. Have fixed this now. Thanks for reporting, closing.