I had been searching for a suitable answer to this question for awhile and never found one, finally figured it out myself so I figured I would share.
When you are editing the controls for the game you can set the Mapped Controller, set your player 2 mapped controller to player 1 and now both "controllers" will act as inputs for player 1.
This has to be done in game and make sure to only save the game remap file, not the core.