@teve Some additions to @Lurker 's comprehensive post:
This video explains the majority of arcade joysticks on the market.
A extremely detailed website about joysticks and button layouts is slagcoin.com. Its creator approaches the topic with almost scientific commitment.
Another thing about the buttons you're considering: They have microswitches that make rather noisy clicks every time they're pressed and released. If you don't like that (I don't), you should look for leaf switches which are somewhat less durable but nearly inaudible. Alternatively, there are "silent" microswitches that are promoted as (nearly) noiseless, but they are more expensive and I don't have any experience with them.
The choice of speakers depends on your quality standards. I didn't like the sound of cheap speakers. Now I'm happy with wideband speakers for 30€ each. See my Asteroids-themed cabinet for a picture of them where you can see their brand and model.