OK, so reflashing the install seems to have worked. I'm not sure if the original 64gb microsd was too large, or if something else I did messed things up, but this time around I wasn't asked a second time to initialize my controller settings, and I was able to get a few minutes of Super Mario World running with the controller functioning properly.
But, thanks for the help, no wonder nobody else was having these problems.