Default behaviour is to assign controller number in the order of connection.
You could use the @meleu 's joystick-selection script (available from experimental packages) to map your controllers by core (ie snes pad for snes games).