RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    How do you organise romsets? MAME and (in particular) consoles

    Scheduled Pinned Locked Moved Help and Support
    romsgenesisnesmanagement
    45 Posts 8 Posters 38.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • G
      geneworld
      last edited by geneworld

      Just write a python program to unzip all the zips files to a single directory, then with the help of a variable [say keep = (U)] have it move all the files you want with the '(U)' in the file name to a different directory and you can see what your left with. After that you can just 'sudo rm -r' the old directory with the remaining roms and folders . It's simple actually ;)

      1 Reply Last reply Reply Quote 0
      • markwkiddM
        markwkidd @AndersHP
        last edited by

        @AndersHP my only experience is on Windows with ClrMamePro

        With the correct DAT file ClrMamePro made it easy for me to set a preferred region of 'USA' and only add ROMs from other regions if there was not a USA version. (I know your intended region may be different but the same process should apply)

        For example, depending on the specific system and what regions was available in, I could set ClrMamePro to filter my set based on a preference of USA ROMs > then EUR > then JPN.

        The resulting set of ROMs will feature a USA version of a game whenever possible, then look for a EUR region ROM for that title, and finally use the JPN only if no USA or EUR ROMs are in the folder. All regions with releases in a given system are supported (in other words you could set a preference of Spain > Europe > USA > Italy > Japan > etc.)

        AndersHPA 1 Reply Last reply Reply Quote 1
        • RionR
          Rion @AndersHP
          last edited by

          @AndersHP I use hyperspin datfiles for my rom collections. One game one region.

          The problem is that the output_file don't have the file extensions intact. So you have to add that after you run your roms thru the No-Intro collection that Hyperspin is using as it's source.

          FBNeo rom filtering
          Mame2003 Arcade Bezels
          Fba Arcade Bezels
          Fba NeoGeo Bezels

          1 Reply Last reply Reply Quote 0
          • AndersHPA
            AndersHP
            last edited by

            I just tried testing ClrMamePro, but I'm puzzled as to how it works. Tried making a test of rebuilding a "romset" consisting of dkong.zip, ddragon.zip, ddragon2.zip and ddragon3.zip.

            I was using the DAT file "lite" from the Github page for MAME2003 (0.78) and thought the result was Donkey Kong and Double Dragon 1-3. But no, the result was chinagat, darktowr, ddragon1-3 (check!) and ddungeon. The only games that worked was the Double Dragon games and Donkey Kong wasn't even there.

            I manually copied the DKong.zip onto my RPi, and the game functioned.

            I don't get why the other "games" got copied into my romset, since neither dkong nor the ddragon has any parents...?

            My "Bubble Bobble" Themed Bartop Arcade
            My Gameboy

            1 Reply Last reply Reply Quote 0
            • AndersHPA
              AndersHP @markwkidd
              last edited by AndersHP

              @markwkidd said in How do you organise romsets? MAME and (in particular) consoles:

              @AndersHP my only experience is on Windows with ClrMamePro

              With the correct DAT file ClrMamePro made it easy for me to set a preferred region of 'USA' and only add ROMs from other regions if there was not a USA version. (I know your intended region may be different but the same process should apply)

              For example, depending on the specific system and what regions was available in, I could set ClrMamePro to filter my set based on a preference of USA ROMs > then EUR > then JPN.

              The resulting set of ROMs will feature a USA version of a game whenever possible, then look for a EUR region ROM for that title, and finally use the JPN only if no USA or EUR ROMs are in the folder. All regions with releases in a given system are supported (in other words you could set a preference of Spain > Europe > USA > Italy > Japan > etc.)

              @markwkidd can you be more specific as to how you did this, or perhaps link to a guide?

              My "Bubble Bobble" Themed Bartop Arcade
              My Gameboy

              markwkiddM 1 Reply Last reply Reply Quote 0
              • markwkiddM
                markwkidd @AndersHP
                last edited by

                @AndersHP No-Intro creates and distributes the DAT files for 1G1R processing, and it turns out they have published a brief guide for how to remove the duplicated region ROMs. You might start with that guide: http://datomatic.no-intro.org/stuff/xml_details.txt

                AndersHPA 1 Reply Last reply Reply Quote 2
                • AndersHPA
                  AndersHP @markwkidd
                  last edited by

                  @markwkidd WOW, this is awesome, truly grateful for the link!
                  This totally did the trick on my SNES and MegaDrive roms. I cannot get the NES one to work, though, something about a missing XML file in the ClrMamePro header...?!

                  Also, what about MAME roms, specifically Finalburnalpha (arcade) and Finalburnalpha (neogeo)?

                  I cannot find DAT files on the DAT-o-MATIC site for these..?

                  My "Bubble Bobble" Themed Bartop Arcade
                  My Gameboy

                  D 1 Reply Last reply Reply Quote 0
                  • D
                    Dochartaigh @AndersHP
                    last edited by Dochartaigh

                    @AndersHP said in How do you organise romsets? MAME and (in particular) consoles:

                    k on my SNES and MegaDrive roms. I cannot get the NES one to work, though, something about a missing XML file

                    I was getting all sorts of errors too. I honestly spent a couple hours on it then gave up. Tried following like 4 different tutorials - all sorts of weird errors (which when I google that exact error there's 0 search results found on the entire internet!). I just broke down and manually edited my NES, SNES, and Sega Genesis ROMs.

                    AndersHPA 1 Reply Last reply Reply Quote 0
                    • AndersHPA
                      AndersHP @Dochartaigh
                      last edited by

                      @Dochartaigh I found the No-intro-NES xml header (it's the orange star on the last column in the NES row at the DAT-o-MATIC schedule) but it's to be placed in ClrMamePro's header subfolder, and since I'm running it on Mac through Wine I cannot add this file, but you could try.

                      I'll manually sort my NES.

                      But the question regarding MAME and NeoGeo FinalBurnAlpha still stands.

                      My "Bubble Bobble" Themed Bartop Arcade
                      My Gameboy

                      1 Reply Last reply Reply Quote 0
                      • RionR
                        Rion
                        last edited by Rion

                        @markwkidd Method is not a bad alternative. But many games for the consoles where only released in Europe or Brazil and so on, complete with English language support.

                        @AndersHP

                        If you sort out your rom collection for only games released in the Usa you will be missing some of these.

                        This is where hyperspin databases comes in. They already do this for you.

                        There is one downside to this and that is that the roms extension is missing when rebuilding a No-Intro Nes set. But this is easily fixed by adding the extension to the files with a file renamer.

                        FBNeo rom filtering
                        Mame2003 Arcade Bezels
                        Fba Arcade Bezels
                        Fba NeoGeo Bezels

                        1 Reply Last reply Reply Quote 0
                        • RionR
                          Rion
                          last edited by

                          For Fba and Neogeo look here in the wiki

                          FBNeo rom filtering
                          Mame2003 Arcade Bezels
                          Fba Arcade Bezels
                          Fba NeoGeo Bezels

                          AndersHPA 1 Reply Last reply Reply Quote 0
                          • AndersHPA
                            AndersHP @Rion
                            last edited by

                            @Rion I did, but these .DAT's don't support regions or 1G1R option in ClrMamePro (empty and greyed out).

                            Will try in Romlister instead and post my result.

                            My "Bubble Bobble" Themed Bartop Arcade
                            My Gameboy

                            RionR 1 Reply Last reply Reply Quote 0
                            • RionR
                              Rion @AndersHP
                              last edited by Rion

                              @AndersHP Of course Hyperspin dats don't support 1G1R because they already are 1G1R (English Only)

                              Here you can get the offical Hyperspin dats.

                              FBNeo rom filtering
                              Mame2003 Arcade Bezels
                              Fba Arcade Bezels
                              Fba NeoGeo Bezels

                              AndersHPA 1 Reply Last reply Reply Quote 0
                              • AndersHPA
                                AndersHP @Rion
                                last edited by AndersHP

                                @Rion Just tried the Hyperspin dats, it just skips all the roms. Guess it's not compatible with the newest romset 0.2.97.39.

                                When using the dats from github, everything gets added.

                                I also tried with Romlister. The result is the same. Either no roms get recognized (Hyperspin XML) or every rom gets added, including all the different regions (github XML).

                                So I still cannot get 1G1R to work with MAME... Anyone had luck with this?

                                My "Bubble Bobble" Themed Bartop Arcade
                                My Gameboy

                                1 Reply Last reply Reply Quote 0
                                • AndersHPA
                                  AndersHP
                                  last edited by

                                  OK, my conclusion so far on the rebuilding of MAME roms, is the following:

                                  MAME, general: MAME2003 with Github "lite" dat (no fruit machine, mahjong, adult etc.).

                                  MAME, not working from the above mentioned: trying to see if the FBA 0.2.97.39 version works. Basically handpicking these.

                                  NeoGeo games: FBA 0.2.97.39, using the "NeoGeo only" dat.

                                  I was keen on using FBA only, since these get regularly fixes and tweaks, and seems to have more working roms, but the absence of a "lite" dat makes the rom count add up to more than 4000 roms, which naturally includes a lot of junk.

                                  My "Bubble Bobble" Themed Bartop Arcade
                                  My Gameboy

                                  rbakerR 1 Reply Last reply Reply Quote 0
                                  • rbakerR
                                    rbaker @AndersHP
                                    last edited by

                                    @AndersHP said in How do you organise romsets? MAME and (in particular) consoles:

                                    MAME, not working from the above mentioned

                                    Are you going from a more recent version to an older version? This is important. I had a full 0.111 set and used the lite dat to generate a full 0.78 set. I have never experience an issue.

                                    AndersHPA 1 Reply Last reply Reply Quote 0
                                    • AndersHPA
                                      AndersHP @rbaker
                                      last edited by

                                      @rbaker so are you using the 0.78 for a newer set? So I could use this lite dat for fba? Or what do you mean?

                                      My "Bubble Bobble" Themed Bartop Arcade
                                      My Gameboy

                                      rbakerR 1 Reply Last reply Reply Quote 0
                                      • rbakerR
                                        rbaker @AndersHP
                                        last edited by

                                        @AndersHP I mean that you need a set newer than 0.78 to reliably generate a 0.78 set from it. So I used a 0.111 set to generate a 0.78 set. It would present a problem (probably) if I tried to generate a 0.111 set from the 0.78 set. I followed the video on the wiki page and it works every time.

                                        AndersHPA 2 Replies Last reply Reply Quote 0
                                        • B
                                          bobcat987 @AndersHP
                                          last edited by bobcat987

                                          @AndersHP
                                          I posted this around here a while ago, hopefully it will help. It runs on the pi, it may run on a Mac as well though I don't know if the 7z util is installed on a Mac by default.

                                          If you want to automatically pull North American files from a large zip bundle, first unzip the bundle into a directory. The result will be a directory filled with 7z files. If running on the pi, as opposed to a linux workstation, you will need to install 7z utilities for the next step with:
                                          sudo apt-get install p7zip-full
                                          Now, change to the directory with the 7z files and run the following command:
                                          while read line; do i=$(7z l "$line" | egrep '\((W|U|UE|JU|JUE)\)( \([^\)]*\))?( \[!\])?\.[^\.]*$' | tail -1 | sed -e 's/^.* \(.*\)$/\1/g'); if [ -n "$i" ] ; then echo "Extracting $i from $line"; 7z e "$line" "$i"; fi; done < <(ls -1 *.7z)
                                          This takes a while to run on a PC (10-20 min) and will take longer on a pi, but the end result is the extraction of all North American from the 7z files with very little manual work. After this just move the extracted files to the rom directory and you should be set. Using the totally made up file extension, .nes, the command would look something like this:
                                          mv *.nes <rom folder>

                                          Note: If you want something special, like an English translation of a Japanese only game, you'll have to manually extract.

                                          1 Reply Last reply Reply Quote 0
                                          • AndersHPA
                                            AndersHP @rbaker
                                            last edited by

                                            @rbaker said in How do you organise romsets? MAME and (in particular) consoles:

                                            @AndersHP I mean that you need a set newer than 0.78 to reliably generate a 0.78 set from it.

                                            Why is this?
                                            I don't think I really grasp the differences yet.
                                            I thought a .78 set was about the roms versions, and as soon as I used something newer than this, the Pi would struggle or be incompatible.

                                            Do you recommend the .78 Lite Dat file for the .111 romset then? And everything pretty much works? Because the .111 is not even mentioned here https://github.com/retropie/retropie-setup/wiki/MAME#advancemame-1.4

                                            Also, what video? Sorry for all the answers..

                                            My "Bubble Bobble" Themed Bartop Arcade
                                            My Gameboy

                                            rbakerR 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.