I have a GemPC cardbus card reader which works with the ccid driver. However, it doesn't work out of the box due to missing permissions of pcscd. The device emulates a serial device (serial_cs driver in kernel) and pcscd doesn't have the appropriate permissions to access that. When I start pcscd as root it works. I think the proper fix would be adding the pcscd user to the uucp group.
Do you have an udev rule that can change the permission of the driver?
I agree with flameeyes, we do not want pcscd to access all serial devices, use a custom udev rule for assigning correct privileges for this specific serial.