[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture
-
Hi @screech, I don't know if this has been asked before, but is it possible to use UXS to scrape the "System" info? I'm making a new theme and I want to get a bunch of the images for each system (console, controller, bezel, illustration, etc). I'm currently doing it one system at a time, one image at a time and it's a tad time consuming.
Is it possible to write a Scrape Profile that will target specific systems and download certain images? If I could get the system info too (production dates, generation, etc) it would be good, but not needed.
As a note, I've already written a scrape profile to download multiple images, add a suffix to each and output an xml based on them, so I have an okay grasp on how to make scrape profiles.
-
Unfortunatly, you can only with MIX profil :s
I need to check if I can put this in the "standard" profil...
(So much work ^^ sorry, I'm very late on my todolist :S) -
@screech I'm sorry I keep loading requests for other stuff onto you.
-
This looks like such a good idea, unfortunately I'm an OSX user so will never be able to use it.
What I've taken to doing is replacing the box art myself, but it doesn't affect me too much as I only have about 60 games loaded into Retropie-even then it's just the SNES and the (two!) N64 games I have that get the treatment. I prefer the PAL box art so hunt Google for reasonably decent quality scans, then either recreate the box myself (plenty of logo .png files to be found) or tidy up the ones that are more difficult or have complex back rounds all in Photoshop. I've only uploaded two to my Flickr but they're in the RPi album if it takes your fancy.
I do find the current scraper is pretty good, but doesn't always pick up some games (FZero, SNES was one I had to enter manually as it would not scrape any info at all).
I'd love the idea of being able to do it at my computer though, kudos to you @screech for the effort!
-
I really love this tool and screenscraper seems to have a lot of stuff i need, so I signed up for the patreon, vive la france!
Anyway, I've noticed that the scraping is noticeably slower than it was a while ago. My GBA folder has 900 roms in it, and UXS was reporting that it would take 2 days to scrape it. Could it be that screenscraper.fr is being overloaded...?
-
-
@columboscoat I paused my antivirus and it seems to be going faster. 1 hour for the GBA roms. Still waaaaaaaaaaaay slower than the sselph scraper.
-
@Danorak1981 The inbuilt scraper for ES that uses thegames.db is VERY fussy over special characters such as dashes and ampersands etc. It also has issues with names less than 3 characters...
-
@Aksen Yeah, but 900 gba ROMs... really? Seems like a lot! Uxmls can be slow. It just depends on the time of day. I guess the screenscraper.fr servers are in France and it's evening time there. Just the time when things get busy on servers hosting stuff like this.
-
I have been having some issues getting the software to pull down marquees when using the Retropie(Video) profile when scraping for final burn alpha. Nothing I seem to set for default picture gets me the marquees. Edit: It does not seem to want to pull down a7800 boxes either even though I see them on the site. :/ Does not seem to be pulling down a lot of a2600 boxes either. Still getting all the video though.
-
on the General Configuration page of UXS, what does the option
"Add missing roms in XML" actually mean?I have used UXS without it checked, and games that it did not have any artwork found still showed up.
though it seems straight forward, I would like to know what it really means before I re-scan some folders.
thanks
-
@detron i believe that options just add an entry for the roms on the gamelist.xml, although without data, as no match was found.
-
@paradadf Yes that's right. I use it for rom translations and hacks. Then i manually add the information to that rom.
-
I would like to add a suggestion if it hasn't been suggested already.
Can an option be added to skip the image if it already exists in the images folder.
Thanks
-
normally it's already the case...
-
@screech Can there be an option to scrape metadata but skip the image? I'd like to re-scrape at some point, because some of my scraped metadata was in french.
-
@Aksen
Normally the basic option do that :
Recreate the XML, but if picture exist, don't touch it... Can you give it a try?@mattrixk
Just release a new version : You can now put a size for every media you download (in the standard profil)
(Need to see for sys info/media now...)Some new things added :
You can now add Genre Picto in the Mix
You can now put some text in Mix
You can now rotate picture in Mix
Lot's of correction on the fallback function (some pictures doesn't download exemple : 2DBox in standard profil now work nice ;) )
Added a Mirror server to avoid main server instability. (automatique fallback)The Wiki is up to date with the new function for MIX : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/[TUTO]-Making-a-MIX-Template
-
@screech You're a legend. Hopefully I'll get the chance to try this out today or tomorrow.
-
@screech I downloaded the latest version, but when I try to run it I get this error:
Universal XML Scraper fatal error ! (Time Out)Edit: I'm on a Windows 7 PC.
Edit 2: I just realised it could be because screenscraper.fr is down. It would be nice if I could still play with the program, even if the website isn't working. I could keep working on Profiles without actually scraping, even if the website was down.
I just tried the previous version (v2.1.0.3) that worked yesterday. It doesn't work at the moment either.
-
@mattrixk at least you confirmed I'm not crazy... i get the same error.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.