@MarcB it's the global RetroArch config file. But some configs are in other files.
For fast-forward for example, the input_hold_fast_forward_btn = "7" line
in configs\all\retroarch-joypads\Xbox360WirelessReceiver.cfg is enough. But keep in mind that this config will work only for your xbox joypad.