Scrape MAME Metadata?
-
Well friend with mine I didnt see any issues. I chat with @Screech frequently and if its doing something crazy with your romset he will want to know.
Can you create a fresh folder for the old version and give it a go?
https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases/download/2.0.0.5/Universal_XML_Scraper64.exe
also if you would not mind providing a http://hastebin.com/ ofls -latr
in your in your mame rom directory? -
Are you sure you want me to use the 2.0.0.5 version and not the 2.0.0.7 from 3 days ago? I should mention that I was using 2.0.0.6 the last time I scraped...
I don't know what hastebin is or how to use it, but here is a pastebin:
-
I think maybe I need to rebuild my rom list in clrmamepro. Get rid of all the dupes to make it 1 game 1 rom. I did that with my consoles.
This is my 5-minute UXS test. There are multiple entries for my 19XX game. But when I compare it with the rom folder, I have:
- 19xx.zip
- 19xxa.zip
- 19xxh.zip
- 19xxj.zip
- 19xxjr1.zip
So I dunno, maybe it's working correctly? I just don't like seeing the same game listed 5 times. I guess I can change the UXS naming format. It's default to
Standard
. Which just does "The Game Name". Maybe if I change it toGamename+Country
it will look better? I'll try that.
Well, not much progress. This is what my game list inside ES looks like now for 19XX:
- 19XX: The War Against Destiny (USA)
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny (Japon)
So it's somewhat there. The 3 that didn't display a country are Non-Working, HISPANIC, and a Japanese. Japon is also Japanese. So maybe the reason they're being displayed like that is because the scraper's database is incomplete? Like, it doesn't have the country information so it doesn't include it? What's even worse is down at "720 Degrees" where it's listed 6 times without any country information. So this isn't helpful. I'm going to try the
Gamename+Bracket
mode next. It says it does it as "The Game Name + The Rom FilName Bracket". So maybe that will help distinguish. I really feel like I should probably just go in and rebuild a clean set without all the dupes/clones.
Ok, re-scraped up the the A's with the
Gamename+Bracket
and it didn't do anything. It scrapes and makes the gamelist.xml just have the game name. It completely skipped adding the (filename) to the game (this is definitely a bug, NONE of the games had their filenames attached to the game name). So I went back and tried to scrape using the internal ES scraper. It scrapes just the flyer artwork, and also fails like the UXS to identify differences in clones on the game list. So I think what I'm going to do is go back to theGamename+Country
mode which at least showed the countries where the data exists. I'll just have to live with that I guess. I'd hate to have to rebuild a romset because of this. There are differences that are advantageous in clones. Things like Japanese only games being "illegally" translated into English, games hacked to use joysticks instead of steering wheels, etc. So having clones is a good thing. I just wish there was a scraper out there that could identify those games, rather than simply saying the obvious name of it multiple times without no distinction. -
Ah ok this makes sense now.
You don't need to use the old version. UXS is doing exactly what it is supposed to do. You need to merge your romset into one zip file. Right now everything is separated out with the parent and the clones from all the different regions. Merging them will combine all the parents and clones in one zip.
For UXS to work right you will need to merge them.
Don't forget to clear out all the old art as well before scraping again....it can start to consume quite a bit of space on a tiny SD card.
You might want to try with just a handful of games to start...until you're sure we have this figured out ;-) -
@hansolo77 sselph scraper uses mamedb, which has been down for ages. many posts about this.
-
@hansolo77 This is a limitation of the current database on screenscraper.fr.
More info about it here
-
@Shakz Will merging the ROMs cause me to lose the ability to play various clones? How does it display them in the ES if they're merged?
-
Yeah it will....squishes them all up under the parent rom and thats what you play. :-(
Unless someone knows a trick in lr-mame
If they are merged they just display as one game....the parent. -
Bummer. I think I'll just use what I got then, and wait for an updated database that has more details about the country/etc.
-
hi @hansolo77
So just for information :
Name + Country will try to match your rom country to the database (and if weel register in DB and found) will show you the country.
Name + Bracket will catch the bracket from your Rom Filname (ex : mario (jap)(v2).zip will give you : Mario Bros. (jap)(v2) )So for now the DB on Arcade game is not complete... And we have a lot's of work to do on it...
The main thing is, today, we can't specify so much things about clone (except some country).
the Screenscraper V2 website and DB is in progress, when it's finish, we can add lot's more information about clone (country all of them, clone, and some other stuff). So when it's done I can put these information in UXS to scrape.
The best way (today) is to merge your rom to avoid duplicate. Sorry.
-
Name+Bracket only generates a gamelist.xml with the Game Name. mario (jap)(v2).zip creates Mario Bros.
In my previous example... Name+Bracket creates:
- 19xx.zip
- 19xxa.zip
- 19xxh.zip
- 19xxj.zip
- 19xxjr1.zip
to
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny
- 19XX: The War Against Destiny
Where as GameName+Country will at least provide the (country) in the name if the data exists in the db. Games like Pacman, which is a clone of Puckman, just doesn't show up. I think it should be listed as Pacman (Clone of Puckman).
-
that's normal...
19xx.zip
19xxa.zip
19xxh.zip
19xxj.zip
19xxjr1.ziphaven't anything between bracket ;)
if you have something like :
19xxjr1 (1 player).zip then name will be 19XX: The War Against Destiny (1 player)Like I say, the next DB version will provide more information on clone (at least "clone") so I can add these info in UXS ;)
-
Alright, cool. :)
-
I'm back again trying to scrape MAME. Using the options available in the latest version of USX I'm still getting a simple gamelist without all the extra bits. Has the database been updated any with the information on clones/etc yet? I know you said this was in the works before, but this thread is 8 months old and I thought maybe SOME progress has been made...
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.