[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

BORIStheBLADE1

@screech Will give it a try, thanks

mattrixk

Hi @screech, you probably know this already, but the screenscraper.fr site is currently down. Did you ever get around to making the change that lets a user run the program, even if it can't connect to the screenscraper server?

I'd still like to be able to play with MIX profiles and other things that don't necessarily require access to the server.

Note: I still use v2.1.0.6 because it works well for me. I understand that v2.2.0.0 was a pretty major upgrade, but I just haven't had to the time to sit down and play with it yet to work out all the differences.

ortsac

Help is appreciated for a newbie here. Is UXS a separate from Retropie? Where can I get it and how to install it? I need to get download game videos and someone suggested it is a great avenue for such tasks...

AlexMurphy

@ortsac Yes, it's totally separate and needs to be run using a Windows PC. Link: https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

ortsac

@AlexMurphy Awesome!!! thanks for the reply. will give it a try.

ortsac

@ortsac Does anyone know if screescraper.fr is down? I subscribed to the site and it replied afterwards that my credentials were saved but will require confirmation via link that will be provided on an email. I repeated the subscription about 30 minutes later, making sure the email address I provided was good. It's been 1 hour since and I have not gotten the confirmation link email. Maybe the site is not overseen during off hours or week end, so I'm wondering if the site is currently down?

AlexMurphy

@ortsac It's working fine for me. https://screenscraper.fr/ Have you checked your spam folder?

EDIT: It will still work without an account but you only get a single thread, so will take longer.

ortsac

@AlexMurphy not in the spam folder either.

ortsac

@AlexMurphy where in the site can I get game videos exactly. Just to download one to try out....Thanks for the help.

AlexMurphy

@ortsac Hmmm, the connection is actually timing out on me now. But when it does work there is a menu up top including media. You can also click on the little US flag on the left to get a (mostly) translated version of the site.

ortsac

OK...I got the site in English. which area in the site contains games video for download?

EctoOne

@ortsac the videos are found in (some) game details. Like https://screenscraper.fr/gameinfos.php?plateforme=2&gameid=754 it's listed under All Media. If you want to scrape them with UXS you need to pick the right profil or enable an option (can't remember what works now and actually never really tried it).

screech

@ortsac I just forced your validation ;) (sometime, email don't want to be send :S )

For information, we've got some problem with the server today... And normally it's ok now ;)

ortsac

This post is deleted!

ortsac

@screech Thanks!!! I'll give it a try again.

screech

You can't download rom ^^ it's only a DB to scrape your own rom.
And to Scrape, the best way is to use a scraper ;) like the one from sselph or UXS ;)

herb_fargus

@ortsac you don't download roms. thats illegal. its only the metadata.

TMNTturtlguy

@ortsac just an FYI it is not ok to share details or even ask about obtaining or downloading roms. You may want to quickly edit your post and keep the topic about scraping art and video. Thanks

mattrixk

@screech: I've come across some oddness when scraping NeoGeo.

I have a folder with ~130 NeoGeo roms, and when I scrape them about 45 of them come back as "2020 Super Baseball". They also download the images for 2020 Super Baseball.

You can see a copy of the gamelist.xml here.

I've had a look at a few of the affected titles on screenscraper.fr and they all seem to have correct data and images, so I don't know what could be causing it.

I've deleted the gamelist.xml and the images and tried scraping again, but the same thing happened again to the same games.

Any thoughts?

screech

wow... that's really weird :S

Can you send me your log : screech[@]free.fr ? Just to check ?
(My neogeo folder scrape well ^^)

For information : 2.2.0.2 is out :
https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases/tag/2.2.0.2

Corrected :

Full Scrape don't neverend anymore.
SSH kill works now on scrape demande.
Date with only a 'Year' will work now (the date will be 'Year/01/01')
When adding Missing Rom, Name were "(Clone, Beta, Demo, ...)". It's OK now ;)
When you force JPG or PNG, Video stay in MP4.

Modification :

New ProgressBar changing color (Green = OK, Red = Timeout or error download, Yellow = Not found)

Added :

New, in case UXS Hang (it never happen ^^), when you re-launch a Scrape, it will ask you if you want to generate a gamelist.xml with the temporary file found.
New Shortcut was created at the first launch : 'Silent_UXS'. You can now run UXS silently ;)
New Visual info about Engine Use. Some check box corresponding to the Thread Number will tell you if the Engine is used or not.
2 New Advanced Menu : Reset Autoconfiguration Path and Alt Autoconfiguration Path (only for Retropie, it put the Rom's Folder Path)
New Element Type : RomExcluded

Exemple :

	<Element Type="RomExcluded">
		<Source_Type>Variable_Value</Source_Type>
		<Source_Value>%AutoExclude%</Source_Value>
		<AutoExcludeEXT>bin|img|iso|ccd|sub</AutoExcludeEXT>
		<AutoExcludeValue>(Track |[Bios]|(Bios)</AutoExcludeValue>
	</Element>

Mean :
When a duplicate name file (without extension) is found:
- it check the extension. If in list (bin|img|iso|ccd|sub) it won't scrape it
- it check if the file contain a value ("(Track ","[Bios]","(Bios)"). If yes, it won't scrape it