Adding to what @MagiusRetro said, you could also have the settings he mentioned applied on a per-game basis to avoid having to deal with the drawbacks in all your other games. More information can be found at the link below.
https://retropie.org.uk/forum/topic/370/custom-config-file-per-game