RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    How do you organise romsets? MAME and (in particular) consoles

    Scheduled Pinned Locked Moved Help and Support
    romsgenesisnesmanagement
    45 Posts 8 Posters 38.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dankcushionsD
      dankcushions Global Moderator @AndersHP
      last edited by

      @AndersHP said in How do you organise romsets? MAME and (in particular) consoles:

      @rbaker Romlister needs a Mame list XML file... Can I use the compatibility sheet for FBA on Github?
      Or where do I get this XML file for my FBA romset?

      i think the .dat files we supply on the FBA/mame wiki pages are what you need. just rename from .dat to .xml. i don't know why they're often in .dat format when they're xml within. i guess it's historical.

      1 Reply Last reply Reply Quote 0
      • D
        Dochartaigh @AndersHP
        last edited by Dochartaigh

        @AndersHP said in How do you organise romsets? MAME and (in particular) consoles:
        I really wanted a way to extract all the files to one folder (already here I have issues, since I'm running Mac) and sorting by [!] and maybe [U] for Complete, American versions of the games only.

        How do you do this, especially on Mac? And do you have recommendations for sorting MAME / FBA romsets as well?

        Mac actually excels at sorting files. Even unzipping like 3,000+ files from terminal will save you about 90% of time (vs. double-clicking all the roms at once and have whatever utility program you have installed unzip them all - that takes a TON more time).

        Mac Finder (i.e. Mac's Windows Explorer) even has a built in renaming/find-replace function for multiple files.

        Mac Terminal (a la linux-flavor) brings in so many other options it's not even funny. You can actually search for a certain keyword, make a .txt file from all those file names, edit that text file to your liking, then run a second easy command to either delete all those files at once, or do something like put them in a folder to sort them. It's REALLY powerful (can do similar/same thing in terminal on the Pi too).

        For MAME, I suggest non-merged sets so each individual version of a single game has ALL the files needed to run it in one file. Certainly saves me tons of time since I usually only play 1 version (maybe 2) of a certain rom.

        @rbaker said in How do you organise romsets? MAME and (in particular) consoles:

        My "No Intro Collection" for the NES never needed cleaning.

        I disagree. No Intro collection still has like 5-10ish versions of a single game, like for 1000+ games PER system. Looking at their NES right now (from the bottom), and there's 5x Yoshi Cookies, 6x Zelda II's, 3x Zoids, 2x and 3x of nearly everything else...just from from Y-Z.

        If you play every version of a game then that's great (and speak like 10 different languages ;) . But for all the rest of us there's a LOT to cleanup if you want ONLY 1 good version (from your language/region hopefully) of every game. I've still not found a good way to automate this search and delete process to filter out the ones I don't like - except by doing it mostly manually.

        rbakerR 1 Reply Last reply Reply Quote 1
        • rbakerR
          rbaker @Dochartaigh
          last edited by

          @Dochartaigh I see, it appears then that I do not have the said "no intro" set. I have 655 roms and they are all (U) versions with no duplicates.

          markwkiddM 1 Reply Last reply Reply Quote 0
          • markwkiddM
            markwkidd @rbaker
            last edited by

            @rbaker said in How do you organise romsets? MAME and (in particular) consoles:

            @Dochartaigh I see, it appears then that I do not have the said "no intro" set. I have 655 roms and they are all (U) versions with no duplicates.

            It sounds like your set may have been processed by a "1 Game 1 Rom" or 1G1R DAT file. They are available at the No-Intro site and maybe what the OP is looking for.

            AndersHPA 1 Reply Last reply Reply Quote 1
            • markwkiddM
              markwkidd @AndersHP
              last edited by

              @AndersHP when it comes to using the catver.ini file, please be aware that you need to use a catver.ini with the same version as your ROMs and your MAME emulator.

              For example you can find a MAME 2003/MAME 0.78 catver here: https://github.com/libretro/mame2003-libretro/tree/master/metadata

              You might have luck running the MAME category sorting (and clone removing) tool that I have been developing, but as with the others it's a Windows app. Not sure if it will work in OS X via WINE, as no one has tried: https://retropie.org.uk/forum/topic/7606/simple-mame-category-sorter-get-rid-of-mahjong-rom-tool

              1 Reply Last reply Reply Quote 0
              • AndersHPA
                AndersHP @markwkidd
                last edited by AndersHP

                @markwkidd said in How do you organise romsets? MAME and (in particular) consoles:

                @rbaker said in How do you organise romsets? MAME and (in particular) consoles:

                @Dochartaigh I see, it appears then that I do not have the said "no intro" set. I have 655 roms and they are all (U) versions with no duplicates.

                It sounds like your set may have been processed by a "1 Game 1 Rom" or 1G1R DAT file. They are available at the No-Intro site and maybe what the OP is looking for.

                YES! This is what I'm looking for, just had my hopes up that the No Intro Romsets were split in regional subfolders... But no.

                I'm no programmer, I cannot find a "1g1r dat file", and I'm not sure how to process it if I had one.

                I'm now using finder on Mac to first find Europe versions, copying these into a different folder, and then World and doing the same, I guess....

                My "Bubble Bobble" Themed Bartop Arcade
                My Gameboy

                markwkiddM RionR 2 Replies Last reply Reply Quote 0
                • G
                  geneworld
                  last edited by geneworld

                  Just write a python program to unzip all the zips files to a single directory, then with the help of a variable [say keep = (U)] have it move all the files you want with the '(U)' in the file name to a different directory and you can see what your left with. After that you can just 'sudo rm -r' the old directory with the remaining roms and folders . It's simple actually ;)

                  1 Reply Last reply Reply Quote 0
                  • markwkiddM
                    markwkidd @AndersHP
                    last edited by

                    @AndersHP my only experience is on Windows with ClrMamePro

                    With the correct DAT file ClrMamePro made it easy for me to set a preferred region of 'USA' and only add ROMs from other regions if there was not a USA version. (I know your intended region may be different but the same process should apply)

                    For example, depending on the specific system and what regions was available in, I could set ClrMamePro to filter my set based on a preference of USA ROMs > then EUR > then JPN.

                    The resulting set of ROMs will feature a USA version of a game whenever possible, then look for a EUR region ROM for that title, and finally use the JPN only if no USA or EUR ROMs are in the folder. All regions with releases in a given system are supported (in other words you could set a preference of Spain > Europe > USA > Italy > Japan > etc.)

                    AndersHPA 1 Reply Last reply Reply Quote 1
                    • RionR
                      Rion @AndersHP
                      last edited by

                      @AndersHP I use hyperspin datfiles for my rom collections. One game one region.

                      The problem is that the output_file don't have the file extensions intact. So you have to add that after you run your roms thru the No-Intro collection that Hyperspin is using as it's source.

                      FBNeo rom filtering
                      Mame2003 Arcade Bezels
                      Fba Arcade Bezels
                      Fba NeoGeo Bezels

                      1 Reply Last reply Reply Quote 0
                      • AndersHPA
                        AndersHP
                        last edited by

                        I just tried testing ClrMamePro, but I'm puzzled as to how it works. Tried making a test of rebuilding a "romset" consisting of dkong.zip, ddragon.zip, ddragon2.zip and ddragon3.zip.

                        I was using the DAT file "lite" from the Github page for MAME2003 (0.78) and thought the result was Donkey Kong and Double Dragon 1-3. But no, the result was chinagat, darktowr, ddragon1-3 (check!) and ddungeon. The only games that worked was the Double Dragon games and Donkey Kong wasn't even there.

                        I manually copied the DKong.zip onto my RPi, and the game functioned.

                        I don't get why the other "games" got copied into my romset, since neither dkong nor the ddragon has any parents...?

                        My "Bubble Bobble" Themed Bartop Arcade
                        My Gameboy

                        1 Reply Last reply Reply Quote 0
                        • AndersHPA
                          AndersHP @markwkidd
                          last edited by AndersHP

                          @markwkidd said in How do you organise romsets? MAME and (in particular) consoles:

                          @AndersHP my only experience is on Windows with ClrMamePro

                          With the correct DAT file ClrMamePro made it easy for me to set a preferred region of 'USA' and only add ROMs from other regions if there was not a USA version. (I know your intended region may be different but the same process should apply)

                          For example, depending on the specific system and what regions was available in, I could set ClrMamePro to filter my set based on a preference of USA ROMs > then EUR > then JPN.

                          The resulting set of ROMs will feature a USA version of a game whenever possible, then look for a EUR region ROM for that title, and finally use the JPN only if no USA or EUR ROMs are in the folder. All regions with releases in a given system are supported (in other words you could set a preference of Spain > Europe > USA > Italy > Japan > etc.)

                          @markwkidd can you be more specific as to how you did this, or perhaps link to a guide?

                          My "Bubble Bobble" Themed Bartop Arcade
                          My Gameboy

                          markwkiddM 1 Reply Last reply Reply Quote 0
                          • markwkiddM
                            markwkidd @AndersHP
                            last edited by

                            @AndersHP No-Intro creates and distributes the DAT files for 1G1R processing, and it turns out they have published a brief guide for how to remove the duplicated region ROMs. You might start with that guide: http://datomatic.no-intro.org/stuff/xml_details.txt

                            AndersHPA 1 Reply Last reply Reply Quote 2
                            • AndersHPA
                              AndersHP @markwkidd
                              last edited by

                              @markwkidd WOW, this is awesome, truly grateful for the link!
                              This totally did the trick on my SNES and MegaDrive roms. I cannot get the NES one to work, though, something about a missing XML file in the ClrMamePro header...?!

                              Also, what about MAME roms, specifically Finalburnalpha (arcade) and Finalburnalpha (neogeo)?

                              I cannot find DAT files on the DAT-o-MATIC site for these..?

                              My "Bubble Bobble" Themed Bartop Arcade
                              My Gameboy

                              D 1 Reply Last reply Reply Quote 0
                              • D
                                Dochartaigh @AndersHP
                                last edited by Dochartaigh

                                @AndersHP said in How do you organise romsets? MAME and (in particular) consoles:

                                k on my SNES and MegaDrive roms. I cannot get the NES one to work, though, something about a missing XML file

                                I was getting all sorts of errors too. I honestly spent a couple hours on it then gave up. Tried following like 4 different tutorials - all sorts of weird errors (which when I google that exact error there's 0 search results found on the entire internet!). I just broke down and manually edited my NES, SNES, and Sega Genesis ROMs.

                                AndersHPA 1 Reply Last reply Reply Quote 0
                                • AndersHPA
                                  AndersHP @Dochartaigh
                                  last edited by

                                  @Dochartaigh I found the No-intro-NES xml header (it's the orange star on the last column in the NES row at the DAT-o-MATIC schedule) but it's to be placed in ClrMamePro's header subfolder, and since I'm running it on Mac through Wine I cannot add this file, but you could try.

                                  I'll manually sort my NES.

                                  But the question regarding MAME and NeoGeo FinalBurnAlpha still stands.

                                  My "Bubble Bobble" Themed Bartop Arcade
                                  My Gameboy

                                  1 Reply Last reply Reply Quote 0
                                  • RionR
                                    Rion
                                    last edited by Rion

                                    @markwkidd Method is not a bad alternative. But many games for the consoles where only released in Europe or Brazil and so on, complete with English language support.

                                    @AndersHP

                                    If you sort out your rom collection for only games released in the Usa you will be missing some of these.

                                    This is where hyperspin databases comes in. They already do this for you.

                                    There is one downside to this and that is that the roms extension is missing when rebuilding a No-Intro Nes set. But this is easily fixed by adding the extension to the files with a file renamer.

                                    FBNeo rom filtering
                                    Mame2003 Arcade Bezels
                                    Fba Arcade Bezels
                                    Fba NeoGeo Bezels

                                    1 Reply Last reply Reply Quote 0
                                    • RionR
                                      Rion
                                      last edited by

                                      For Fba and Neogeo look here in the wiki

                                      FBNeo rom filtering
                                      Mame2003 Arcade Bezels
                                      Fba Arcade Bezels
                                      Fba NeoGeo Bezels

                                      AndersHPA 1 Reply Last reply Reply Quote 0
                                      • AndersHPA
                                        AndersHP @Rion
                                        last edited by

                                        @Rion I did, but these .DAT's don't support regions or 1G1R option in ClrMamePro (empty and greyed out).

                                        Will try in Romlister instead and post my result.

                                        My "Bubble Bobble" Themed Bartop Arcade
                                        My Gameboy

                                        RionR 1 Reply Last reply Reply Quote 0
                                        • RionR
                                          Rion @AndersHP
                                          last edited by Rion

                                          @AndersHP Of course Hyperspin dats don't support 1G1R because they already are 1G1R (English Only)

                                          Here you can get the offical Hyperspin dats.

                                          FBNeo rom filtering
                                          Mame2003 Arcade Bezels
                                          Fba Arcade Bezels
                                          Fba NeoGeo Bezels

                                          AndersHPA 1 Reply Last reply Reply Quote 0
                                          • AndersHPA
                                            AndersHP @Rion
                                            last edited by AndersHP

                                            @Rion Just tried the Hyperspin dats, it just skips all the roms. Guess it's not compatible with the newest romset 0.2.97.39.

                                            When using the dats from github, everything gets added.

                                            I also tried with Romlister. The result is the same. Either no roms get recognized (Hyperspin XML) or every rom gets added, including all the different regions (github XML).

                                            So I still cannot get 1G1R to work with MAME... Anyone had luck with this?

                                            My "Bubble Bobble" Themed Bartop Arcade
                                            My Gameboy

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.