how many fps is running the emulator?.
Hey , your project is soo cool !!Could you release a alpha or something so we can test this cool emulator out ??
I am sure that a lot of assembly plus a lot of effort (and maybe a look on the fastest psx emu's code like Virtual Game Station or Bleem!) Will bring a good result! Good Luck!