How do you organise romsets? MAME and (in particular) consoles
-
@AndersHP said in How do you organise romsets? MAME and (in particular) consoles:
I really wanted a way to extract all the files to one folder (already here I have issues, since I'm running Mac) and sorting by [!] and maybe [U] for Complete, American versions of the games only.How do you do this, especially on Mac? And do you have recommendations for sorting MAME / FBA romsets as well?
Mac actually excels at sorting files. Even unzipping like 3,000+ files from terminal will save you about 90% of time (vs. double-clicking all the roms at once and have whatever utility program you have installed unzip them all - that takes a TON more time).
Mac Finder (i.e. Mac's Windows Explorer) even has a built in renaming/find-replace function for multiple files.
Mac Terminal (a la linux-flavor) brings in so many other options it's not even funny. You can actually search for a certain keyword, make a .txt file from all those file names, edit that text file to your liking, then run a second easy command to either delete all those files at once, or do something like put them in a folder to sort them. It's REALLY powerful (can do similar/same thing in terminal on the Pi too).
For MAME, I suggest non-merged sets so each individual version of a single game has ALL the files needed to run it in one file. Certainly saves me tons of time since I usually only play 1 version (maybe 2) of a certain rom.
@rbaker said in How do you organise romsets? MAME and (in particular) consoles:
My "No Intro Collection" for the NES never needed cleaning.
I disagree. No Intro collection still has like 5-10ish versions of a single game, like for 1000+ games PER system. Looking at their NES right now (from the bottom), and there's 5x Yoshi Cookies, 6x Zelda II's, 3x Zoids, 2x and 3x of nearly everything else...just from from Y-Z.
If you play every version of a game then that's great (and speak like 10 different languages ;) . But for all the rest of us there's a LOT to cleanup if you want ONLY 1 good version (from your language/region hopefully) of every game. I've still not found a good way to automate this search and delete process to filter out the ones I don't like - except by doing it mostly manually.
-
@Dochartaigh I see, it appears then that I do not have the said "no intro" set. I have 655 roms and they are all (U) versions with no duplicates.
-
@rbaker said in How do you organise romsets? MAME and (in particular) consoles:
@Dochartaigh I see, it appears then that I do not have the said "no intro" set. I have 655 roms and they are all (U) versions with no duplicates.
It sounds like your set may have been processed by a "1 Game 1 Rom" or 1G1R DAT file. They are available at the No-Intro site and maybe what the OP is looking for.
-
@AndersHP when it comes to using the catver.ini file, please be aware that you need to use a catver.ini with the same version as your ROMs and your MAME emulator.
For example you can find a MAME 2003/MAME 0.78 catver here: https://github.com/libretro/mame2003-libretro/tree/master/metadata
You might have luck running the MAME category sorting (and clone removing) tool that I have been developing, but as with the others it's a Windows app. Not sure if it will work in OS X via WINE, as no one has tried: https://retropie.org.uk/forum/topic/7606/simple-mame-category-sorter-get-rid-of-mahjong-rom-tool
-
@markwkidd said in How do you organise romsets? MAME and (in particular) consoles:
@rbaker said in How do you organise romsets? MAME and (in particular) consoles:
@Dochartaigh I see, it appears then that I do not have the said "no intro" set. I have 655 roms and they are all (U) versions with no duplicates.
It sounds like your set may have been processed by a "1 Game 1 Rom" or 1G1R DAT file. They are available at the No-Intro site and maybe what the OP is looking for.
YES! This is what I'm looking for, just had my hopes up that the No Intro Romsets were split in regional subfolders... But no.
I'm no programmer, I cannot find a "1g1r dat file", and I'm not sure how to process it if I had one.
I'm now using finder on Mac to first find Europe versions, copying these into a different folder, and then World and doing the same, I guess....
-
Just write a python program to unzip all the zips files to a single directory, then with the help of a variable [say keep = (U)] have it move all the files you want with the '(U)' in the file name to a different directory and you can see what your left with. After that you can just 'sudo rm -r' the old directory with the remaining roms and folders . It's simple actually ;)
-
@AndersHP my only experience is on Windows with ClrMamePro
With the correct DAT file ClrMamePro made it easy for me to set a preferred region of 'USA' and only add ROMs from other regions if there was not a USA version. (I know your intended region may be different but the same process should apply)
For example, depending on the specific system and what regions was available in, I could set ClrMamePro to filter my set based on a preference of USA ROMs > then EUR > then JPN.
The resulting set of ROMs will feature a USA version of a game whenever possible, then look for a EUR region ROM for that title, and finally use the JPN only if no USA or EUR ROMs are in the folder. All regions with releases in a given system are supported (in other words you could set a preference of Spain > Europe > USA > Italy > Japan > etc.)
-
@AndersHP I use hyperspin datfiles for my rom collections. One game one region.
The problem is that the output_file don't have the file extensions intact. So you have to add that after you run your roms thru the No-Intro collection that Hyperspin is using as it's source.
-
I just tried testing ClrMamePro, but I'm puzzled as to how it works. Tried making a test of rebuilding a "romset" consisting of dkong.zip, ddragon.zip, ddragon2.zip and ddragon3.zip.
I was using the DAT file "lite" from the Github page for MAME2003 (0.78) and thought the result was Donkey Kong and Double Dragon 1-3. But no, the result was chinagat, darktowr, ddragon1-3 (check!) and ddungeon. The only games that worked was the Double Dragon games and Donkey Kong wasn't even there.
I manually copied the DKong.zip onto my RPi, and the game functioned.
I don't get why the other "games" got copied into my romset, since neither dkong nor the ddragon has any parents...?
-
@markwkidd said in How do you organise romsets? MAME and (in particular) consoles:
@AndersHP my only experience is on Windows with ClrMamePro
With the correct DAT file ClrMamePro made it easy for me to set a preferred region of 'USA' and only add ROMs from other regions if there was not a USA version. (I know your intended region may be different but the same process should apply)
For example, depending on the specific system and what regions was available in, I could set ClrMamePro to filter my set based on a preference of USA ROMs > then EUR > then JPN.
The resulting set of ROMs will feature a USA version of a game whenever possible, then look for a EUR region ROM for that title, and finally use the JPN only if no USA or EUR ROMs are in the folder. All regions with releases in a given system are supported (in other words you could set a preference of Spain > Europe > USA > Italy > Japan > etc.)
@markwkidd can you be more specific as to how you did this, or perhaps link to a guide?
-
@AndersHP No-Intro creates and distributes the DAT files for 1G1R processing, and it turns out they have published a brief guide for how to remove the duplicated region ROMs. You might start with that guide: http://datomatic.no-intro.org/stuff/xml_details.txt
-
@markwkidd WOW, this is awesome, truly grateful for the link!
This totally did the trick on my SNES and MegaDrive roms. I cannot get the NES one to work, though, something about a missing XML file in the ClrMamePro header...?!Also, what about MAME roms, specifically Finalburnalpha (arcade) and Finalburnalpha (neogeo)?
I cannot find DAT files on the DAT-o-MATIC site for these..?
-
@AndersHP said in How do you organise romsets? MAME and (in particular) consoles:
k on my SNES and MegaDrive roms. I cannot get the NES one to work, though, something about a missing XML file
I was getting all sorts of errors too. I honestly spent a couple hours on it then gave up. Tried following like 4 different tutorials - all sorts of weird errors (which when I google that exact error there's 0 search results found on the entire internet!). I just broke down and manually edited my NES, SNES, and Sega Genesis ROMs.
-
@Dochartaigh I found the No-intro-NES xml header (it's the orange star on the last column in the NES row at the DAT-o-MATIC schedule) but it's to be placed in ClrMamePro's header subfolder, and since I'm running it on Mac through Wine I cannot add this file, but you could try.
I'll manually sort my NES.
But the question regarding MAME and NeoGeo FinalBurnAlpha still stands.
-
@markwkidd Method is not a bad alternative. But many games for the consoles where only released in Europe or Brazil and so on, complete with English language support.
If you sort out your rom collection for only games released in the Usa you will be missing some of these.
This is where hyperspin databases comes in. They already do this for you.
There is one downside to this and that is that the roms extension is missing when rebuilding a No-Intro Nes set. But this is easily fixed by adding the extension to the files with a file renamer.
-
For Fba and Neogeo look here in the wiki
-
@Rion I did, but these .DAT's don't support regions or 1G1R option in ClrMamePro (empty and greyed out).
Will try in Romlister instead and post my result.
-
-
@Rion Just tried the Hyperspin dats, it just skips all the roms. Guess it's not compatible with the newest romset 0.2.97.39.
When using the dats from github, everything gets added.
I also tried with Romlister. The result is the same. Either no roms get recognized (Hyperspin XML) or every rom gets added, including all the different regions (github XML).
So I still cannot get 1G1R to work with MAME... Anyone had luck with this?
-
OK, my conclusion so far on the rebuilding of MAME roms, is the following:
MAME, general: MAME2003 with Github "lite" dat (no fruit machine, mahjong, adult etc.).
MAME, not working from the above mentioned: trying to see if the FBA 0.2.97.39 version works. Basically handpicking these.
NeoGeo games: FBA 0.2.97.39, using the "NeoGeo only" dat.
I was keen on using FBA only, since these get regularly fixes and tweaks, and seems to have more working roms, but the absence of a "lite" dat makes the rom count add up to more than 4000 roms, which naturally includes a lot of junk.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.