Ok, I found the problem : the rom I used was a .z64 one I grabbed from an emulation web site, and this rom was apparently patched for the z64 linux graphic plugin for mupen64 and this confused the controller setup. I got another one and this time it works...