see https://retropie.org.uk/docs/Smaller-RetroArch-Screen/
although also note that you can improve psx fidelity via https://retropie.org.uk/docs/Playstation-1/#video-double-internal-resolution
and you may also want to try the new experimental playstation emulator lr-duckstation, which includes even more (and more reliable) graphical improvements.
and finally we have some shader/smoothing options documented here (though note they can result in performance issues, depending on your hardware, which you did not mention - please see https://retropie.org.uk/forum/topic/3/read-this-first)