Hi,
The most powerful PCIe card you can put in a G5 late 2005 is the NVIDIa FX Quardo FX4500. You can get a PC version and flash it to work in the Mac.
The next best is the 7800GT, again flashed for Mac.
How-tos and ROMs - start here:
http://themacelite.wikidot.com/nvflash-basics.You will need a PC which will boot from a Floppy disk to flash the video card using NvFlash.
I use NvFlash 5.06 downloaded from Guru3D.com and an old Dell Vostro 200.
If you have problems, I can dropbox you everything you need.
Incidentally, I have an SSD booting my Quad G5 via a FirmTek SeriTek 2SE2 PCIe card - the only bootable PCIe card for the late 2005 G5. It has 2 external eSATA ports, but I have cabled them to an internal Sonnet Jive mount for the SSD. This is more than twice as fast as the built in SATA connections.
Regards,
Nick