I resolved the issue by doing the following:

RetroPie -> RetroArch -> Settings -> Input -> Input Hotkey Binds

Then I bound "enable hotkeys" to the Logitech button and "quit retroarch" to the start button.

Make sure to save your configs before exiting retroarch. After that everything works.