[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

screech

2.0.0.6 Beta is out...

Lot's of change :

Corrected :

French, German, spanish and english translation correction.
First rom sometime doesn't be scrapped corrected.
Include/Exclude label size corrected
Registering link with Digimirror corrected.
Some roms don't be scraped because of "not allowed" characteres corrected.

Added :

New XML Include
Bypass research function (to make dedicated profil for some system like scummvm)
New Mix Profil to Test SCUMMVM on Recalbox V4 (MIX)
Rewrite of path option to add some tag :
- %SystemDir% = Full path to the system directory
- %System% = Name of the System directory
- %Source_RootPath% = Path to the local Root
Rewrite of Retropie Profil to match Retropie Path (to test)

Merge with verybadsoldier fork :

Added a new function to scrape IN zip files when zip file rom isn't found. (THANKS A LOT verybadsoldier)

sonicsheppard

Loving this! Thank you!

vbs

Big thanks for the scraper! I just discovered it some days ago and I like it alot!

windale

I just did a scrape of my MAME collection and the end result left a "Mame_missing" text file saying it could not find 6 roms. I just want the gamelist to link these last 6 roms to a screenshot. I checked the gamelist and theres no sign of them. So even if you have the roms (and screenshots) it doesn't add an entry to the gamelist and they won't show up after scraping. People will be seeing a lot less roms in Retropie than they actually have.

So to summarize, if the rom is not found in your database can we have an option to add it to the gamelist so it will show up and display the screenshot (that we manually added) ? (Steven Selph's scraper has an option to "add not found" ).

I tried the option "Add missing roms in XML" but i'm not sure what the option does and it didn't help.

paradadf

@windale that option should do exactly what sselph's scraper does. But even without selecting it, ES should be able, as long a the rom exists, to show the game.

sonicsheppard

@screech

I've had a far higher success rate at scraping roms using the new .6 beta, however I have noticed it is now having trouble with roms containing apostrophes ('). An example would be Crack'Ed on Atari7800.

This wasn't an issue on the .5 beta.

If you need any more info please let me know.

Thanks so much!

screech

@windale I have an issue open on the "Add missing roms in XML" doesn't work well.. I need to check... But like @paradadf says normally even if the rom isn't scraped, it will show in the ES Game list (as a non scraped one)

@sonicsheppard Strange, I add a "correction" normally on the rom with a ' in the name and it works on my try... Need to test it again :S sorry...

windale

@screech said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

@windale I have an issue open on the "Add missing roms in XML" doesn't work well.. I need to check... But like @paradadf says normally even if the rom isn't scraped, it will show in the ES Game list (as a non scraped one)

Yes, but I like to have the option "parse gamelists only" on in Retropie so that it doesn't show the non-scraped Bios files and multi disk games etc. I manually added the 6 not found to my gamelist. I'll wait to see if the option "Add missing roms in XML" gets fixed.

screech

@windale I'm on it ;)

screech

I just release what I think is the first stable version ;)

some improvement for Retropie on it ;)

(autoconfiguration path are normalized with Reptropie Path and Scraped extension file are restricted to the Retropie used extension)

@windale the Add missings roms in XML is corrected ;)
@sonicsheppard the ' problem is normmaly resolved ;)

UXS V2 Stable here

sonicsheppard

@screech

Hi, happy to report the issue about roms with apostrophes being missed is verified fixed in the latest version, as is the fixed pathing for RetroPie.

Couple of questions though, in this new V2 Stable version I've noticed that the rom titles in the gamelist.xml now contain the region, e.g. Aliens vs Predator (USA). This wasn't happening in the previous versions, is there an option to disable that? Also, for roms with a World region, they are being displayed as the French (Monde).

Thanks for sorting this though, it's coming along great! If you need any more info just let me know.

Cheers!

vbs

@sonicsheppard
You can configure in UXS how you want your game names composed. I currently cannot check for the exact menu though. I think its in "options".

sonicsheppard

@vbs

Wicked, found it in Configuration -> Options configuration -> Item Choice/Name Format.

Works a treat. Thanks!

windale

@sonicsheppard said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

@screech
Also, for roms with a World region, they are being displayed as the French (Monde).

Yeah, I reported this earlier today (before this version was released). 'Japan' was also misspelt as 'Japon', and 'Platform' was 'Plateform'. I think they said that 'Plateform' was fixed. Can't check at the moment.

screech

Hello all,

I release some new version, with little correction ;) -> 2.0.0.3

For the wrong english translation, it's due to the DB.

Screenscraper (at start) was made for french people :S with more and more people we add (quickly) other language... But it's not so well added ;)

So a Screenscraper V2 is under developpement to manage every language ;) (for data AND media ;) )

Be patient it will come ;)

vbs

@screech said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

Screenscraper (at start) was made for french people :S with more and more people we add (quickly) other language... But it's not so well added ;)

So a Screenscraper V2 is under developpement to manage every language ;) (for data AND media ;) )

Be patient it will come ;)

Thats really cool to hear! Will the forum be in english too?

screech

I will ask ^^

It's obvious it's not easy for foreign user to speak with us ^^

But if you have problem, don't hesitate to visit us on our IRC Channel, we will be please to answer any question you have ;)

https://kiwiirc.com/client/irc.freenode.net/?#recalbox

Dochartaigh

This looks great, but I'm afraid I'll have to wait until this can be run on the Pi itself, and not a 2nd system which has network drive access to the PI. (plus I'm on a Mac so I feel leftout....and Wine has never worked well for me in the past :(

vbs

Has anyone an idea how to scrape MAME sets with parents and clones so that you get sensible game titles in the end?

Lets say the files are named:

airbustrj.zip
airbustrb.zip
airbustr.zip

Which should map to something like "Air Buster (Japan)", "Air Buster (bootleg)" and "Air Buster (World)". But what whatever filename option I use in UXS I either get the plain filename (cryptic) or for all three the same just "Air Buster".

Rion

@vbs I have been talking about this with @screech on the official irc channel for screenscraper.fr. There have been talks about implementation of Arcade Italia's datbase. What i last heard is that it's planned for v2 of the website.

Mamedb is down as we all know and have/had not been updated as of Mame 0.15X

Right now when you scrape games for Mame/fba you get the same names for the parrent rom and the clones with some few deviation from roms that have (World) or (Japan) in them.

Hopefully this will see the light of day soon.