xfce-base/xfce4-panel dont need gnome-base/librsvg in RDEPEND cos it depends on gtk+-2, and gtk+-2 should be compiled after gnome-base/librsvg in order that gtk+ -2 aplications can use SVG support. For more, please see the explanation in the bug #67989 ;-)
the statement in the initial comment is incorrect