I compiled up a build of PPSSPP version 0.8.1-861-g408499c for Ubuntu 13.10. All you need to do is decompress the tar.gz archive and run the PPSSPPSDL executable. It *SHOULD* fire up and just work. Note there is no audio decoder plugin for linux, so sorry I don't have one.
NOTE: I compiled this on a 64-bit system. So it should be a 64-bit executable.