[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

screech

@mattrixk OH !! Yes... You Are right ^^ (My Origin refere to the Screen origin to allow CENTER/LEFT/RIGHT on this Origin point ^^)

I think I never understand well how Origin works in theme ;)

I'll do some modification on the Mix Template function so ;)

Wait for the next release ^^

mattrixk

That's great to hear @screech.

While I have you, I have 2 questions about what the scraper can do:

Can you use the scraper to download the game videos? Maybe save them out as .mp4 or .gif?
Can you use the scraper to save individual images separately? Let me explain. Your default "Standard (3img)" MIX profile downloads 3 different images (screenshot, 3d box art and wheel logo) and combines them into a single image. Would it be possible to make the scraper download those same 3 images, but save them out separately? Either into separate folders within "downloaded_images", or with "-screenshot", "-boxart", "-wheel" appended to the end of the filenames?

Concat

So... when the scraper can't find a match, the recommendation is to change the file name?

When I do that, it seems as though I have to change the extension as well... and then change it back, and manually edit the gamelist so the extension is corrected there as well. Mind numbing progress on my Dreamcast games and PS games...

Then save states won't work after, so have to change name again and manually edit gamelist. Hmm...

Anyone figure out a faster way to resolve these orphaned roms?

screech

@mattrixk
1- It's already possible (I have add a new profil with video downloading in MP4 ;) )
2- It's possible, look at the scrapeprofile. They are in XML, you can add everything you want ;) (like the MIX Profile ;) ) And you can choose to put an extension like -screenshot, -boxart,....
Don't hesitate to ask if you can't manage to do it ;) I will send you a special profil ;)

@Concat If your Rom come from a well known source.
You can use F-CRC Calculator to calculate CRC and MD5 (don't forget to check the MD5 Checkbox).

Then send me a pastebin with the new Hash. I will add them to the DB ;)

It's the easiest way ;)

http://ffulgore.free.fr/site/f-crc/us/download.htm

mattrixk

That's awesome, thanks @screech. I'll hopefully have a chance to look at that tomorrow or the day after.

bunman

First off, thanks for UXS. My Retropie Picade and my Recalbox mini NES cased Pi now have an amazing looking frontend.

Quick question, is the server down? I almost finished scraping my systems, but now it completes hashing the roms, but finds no details.

Thanks,
Ali

screech

normally not... The server is up and responsive right now :S

wich system ?

bunman

Neo Geo Pocket and Color. There is a very good possibility it's just me! I'll check over my settings again. Thanks for getting back to me though.

bunman

I started UXS from a scratch installation and it works perfectly. I did say it was probably me! I'm just wondering if I didn't reset the profile when I went from scraping for RetroPie to Recalbox?! Should have just stuck to one OS for both Pis ;O) Anyway, thanks again for UXS.

screech

Normally you can swap from retropie to Recalbox easily, just change your profil ;)

Concat

@screech
Hey, for roms without a match, can I just send you the missing .txt file for each system after the scrape?

I created an account on screenscraper.fr, but I can't find a way of submitting these. All I found was info on how to update Roms and Games that already exist on the site. If it makes your life easier, I can follow the website's process. Looks like I get extra threads this way too...

Oh and if I haven't said it already, great tool. Thank you!

bunman

I'm having problems when I try to scrape just a 2D box image. I select 'Box 2D' for the default picture setting and 'Screenshot' for the alternative picture setting, but I'm mostly only get screenshots. I know there are box images as they appeared when I used the Mix profile. I'm using the Recalbox V4 profile if that makes any difference. Some systems come up with no boxarts at all, like the Lynx, then some, like 32X get most as boxarts, but 6 or 7 as screenshots. But if I used the mix profile, all the 32X pictures have box and screenshot, so the boxarts must be available?!

mattrixk

@screech: I'm having a similar problem to @bunman. When using the default "RetroPie" Scrape Profile, I have 5 snes roms and when I try to scrape box art, not all of them find it, even though the box art shows up when using the Standard (3img) Mix Profile on the same roms.

This happens with wheel art as well, except only 2 of the 5 roms scrape wheel art.

It doesn't matter if it's 2D or 3D box art, or normal/carbon/steel wheels.

5 games, all scrape screenshots and fanart properly, but only 4 scrape box art and only 2 scrape wheel art.

It's a tad frustrating because I know the images are there to be scraped, for some reason they just don't want to be.

screech

Need to check My fallback on signle picture function :S

if it's work on MIX it should work on "single"... I'll check that tonight ;)

mattrixk

Awesome, thanks @screech. I've managed to make my own Scrape Profile that downloads screenshot, box art, fan art, wheel art and video, appending "-screenshot", "-fanart" etc to the end of the filenames. It also spits out a gamelist.xml that has links to all of them like <screenshot>folder/folder/folder/aladdin-screenshot.jpg</screenshot>. It's great.

I do have another question though: is it possible to scrape different size images in the same scrape profile? At the top of the XML are the lines:

<Target_Image_Width>640</Target_Image_Width>
<Target_Image_Height>480</Target_Image_Height>

This downloads every image at the same size. Is it possible to download the screenshot at 640x480, but download the fanart at 1280x720? Or do I have to do that in 2 separate Scrape Profiles?

screech

Humm... Need to modify some part of code ;) but I note that in my todo ;)

daeks

I know it is a bit offtopic, but what would be really nice: Fully translated webpage. Most of the interesting parts are only available in french. (for example the webapi doc). Is there a way to get it translated?

mattrixk

@daeks: Chrome translate?

screech

@daeks we are working on translation (but like most French People we aren't so good in foreign language ^^)

You can see the % of translation just under the country flag ;) Right now we are at 75% of english tranlsation ^^

If you have question on the API part, don't hesitate to Ask. I'll try to answer you in my "bad english" ^^

Concat

Really I just want to know how to submit new roms to the site. heh...