[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

mattrixk

Awesome, thanks @screech. I've managed to make my own Scrape Profile that downloads screenshot, box art, fan art, wheel art and video, appending "-screenshot", "-fanart" etc to the end of the filenames. It also spits out a gamelist.xml that has links to all of them like <screenshot>folder/folder/folder/aladdin-screenshot.jpg</screenshot>. It's great.

I do have another question though: is it possible to scrape different size images in the same scrape profile? At the top of the XML are the lines:

<Target_Image_Width>640</Target_Image_Width>
<Target_Image_Height>480</Target_Image_Height>

This downloads every image at the same size. Is it possible to download the screenshot at 640x480, but download the fanart at 1280x720? Or do I have to do that in 2 separate Scrape Profiles?

screech

Humm... Need to modify some part of code ;) but I note that in my todo ;)

daeks

I know it is a bit offtopic, but what would be really nice: Fully translated webpage. Most of the interesting parts are only available in french. (for example the webapi doc). Is there a way to get it translated?

mattrixk

@daeks: Chrome translate?

screech

@daeks we are working on translation (but like most French People we aren't so good in foreign language ^^)

You can see the % of translation just under the country flag ;) Right now we are at 75% of english tranlsation ^^

If you have question on the API part, don't hesitate to Ask. I'll try to answer you in my "bad english" ^^

Concat

Really I just want to know how to submit new roms to the site. heh...

screech

you can't directly to the web site...

Only Admin can (to avoid pollution ;) )

The easy way :

If you scrape with UXS, juste send me your missing.txt file ;) I will add it.

The little less easy way :

Use this software : http://ffulgore.free.fr/site/f-crc/us/download.htm
Don't forget to check the CRC and MD5 checkbox.
Calculate the file you want.
And send me the log file ;) I will add it.

For information :

There is an "autoassociation" process that associate rom to game. But it's not a 100% match.
So sometime Rom are orpheans. And you need to associate them (you can do this directly from the website)

For information Bis :

We take every rom IF they are comming from a well know source (no single user or particular rom).
Ziped if they are the original zip from the source (don't dezipe and rezip a file, it change the HASH checksum)

Concat

@screech
Thank you screech! I thought I could submit through the website and I just wasn't having luck looking through all the French instructions :)

Do you have an email address I can send them to? What if I have made my own roms...? Are those not eligible? For example, repacking .bin PS1 games to PBP files.

Another question - how can we submit requests to add or correct games (not roms)? For example, Hot Shots 1 & 2 for PS1 is listed as Everybody's Golf as the US version, but it's actually the European version. Ironically the art there is Hot Shots Golf... I've seen other similar examples but can't remember them now.

screech

you can post a pastebin here ;)
Or send me an email (screech @ free.fr)
Or come to see us on IRC ( https://kiwiirc.com/client/irc.freenode.net/?theme=basic#Screenzone)

To submit correction, it's easy ;) just create an account, log in, go to the game and submit new information ;) (or if it's an information you cannot submit like "duplicate", "bad rom association" leave a comment on the game page ;) )

Don't know if you notice the flag on the upper left corner, you can choose the english one ;) 75% of the webiste is translated in english ;) )

EDIT : And for PBP you can submit them. If you do it from "regular/common" rom it will be good ;)

daeks

@screech I have also a couple of missing roms, but they are all known by http://datomatic.no-intro.org/ - Do you also need them or will you add the DAT files from them in the future?

screech

On wich system ? Give me the datomatic link to the dat ;) I will add it ;)

daeks

@screech I have dropped you a mail :)

screech

Sorry :( don't receive it :S (screech @ free.fr ;) )

Edit : I receiv a Mail from Gmail saying there is a Virus in the file... so I can't even grab it :S)

screech

Bonjour, nous avons eu un petit soucis de DNS sur le Serveur de Screenscraper... Tous devrait rentrer dans l'ordre très rapidement.

Hello, we have a little DNS problem... Everything will be back soon.

mattrixk

Hi @screech, I don't know if this has been asked before, but is it possible to use UXS to scrape the "System" info? I'm making a new theme and I want to get a bunch of the images for each system (console, controller, bezel, illustration, etc). I'm currently doing it one system at a time, one image at a time and it's a tad time consuming.

Is it possible to write a Scrape Profile that will target specific systems and download certain images? If I could get the system info too (production dates, generation, etc) it would be good, but not needed.

As a note, I've already written a scrape profile to download multiple images, add a suffix to each and output an xml based on them, so I have an okay grasp on how to make scrape profiles.

screech

Unfortunatly, you can only with MIX profil :s
I need to check if I can put this in the "standard" profil...
(So much work ^^ sorry, I'm very late on my todolist :S)

mattrixk

@screech I'm sorry I keep loading requests for other stuff onto you.

Danorak1981

This looks like such a good idea, unfortunately I'm an OSX user so will never be able to use it.

What I've taken to doing is replacing the box art myself, but it doesn't affect me too much as I only have about 60 games loaded into Retropie-even then it's just the SNES and the (two!) N64 games I have that get the treatment. I prefer the PAL box art so hunt Google for reasonably decent quality scans, then either recreate the box myself (plenty of logo .png files to be found) or tidy up the ones that are more difficult or have complex back rounds all in Photoshop. I've only uploaded two to my Flickr but they're in the RPi album if it takes your fancy.

I do find the current scraper is pretty good, but doesn't always pick up some games (FZero, SNES was one I had to enter manually as it would not scrape any info at all).

I'd love the idea of being able to do it at my computer though, kudos to you @screech for the effort!

Aksen

I really love this tool and screenscraper seems to have a lot of stuff i need, so I signed up for the patreon, vive la france!

Anyway, I've noticed that the scraping is noticeably slower than it was a while ago. My GBA folder has 900 roms in it, and UXS was reporting that it would take 2 days to scrape it. Could it be that screenscraper.fr is being overloaded...?

columboscoat

@Aksen Yip. I would say it's getting a lot more hits since @screech started promoting his scraper here.