[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture
-
This is huge. Great work @screech!
-
Is it possible to use this scraper on roms folder on the PC hard drive instead of on the Pi itself? I have a backup of my pi roms folder on the PC so want to run it on that instead.
-
@a7mag3ddon you can download the 32 or 64 bit version of the scraper here and run it on your PC. It's what I use to build scrape and mix profiles. (I don't even know how to use it on the Pi itself shhh, don't tell anybody).
-
Sorry i didnt explain, i have it for PC but i want to scrape FOLDERS on my pc instead of on the PI :-)
-
@a7mag3ddon Oh, sorry. It's late and I've had a big day. I can't really brain at the moment, I have the dumb.
-
Just to inform you I just release a new version with a little change on Retropie Profil.
No more (Video) profil. Now you can add Marquee and/or video (+ the standard "image") juste with a litle configuration in the "Option configuration menu" ;)
@a7mag3ddon Of course you can scrape a folder on your PC, USB Key, external hardrive, network drive, or directly to the PI ;)
My advice : choose a Retropie Profil with [ROM FOLDER] in the name ;)So Gamelist and downloaded_image folder will be put in the "rom folder" ;)
when selected (use the wizzard), just select the "main" folder with all the subfolder to the plateform rom. Then use the autoconfig ;)
-
@a7mag3ddon share your local folders as "roms" and "configs" and add "\\yourpcname\roms" to the scraper as path. Works fine.
-
Ooohhh thanks! I think it will be quicker, and i dont have to have the Pi on for days when my pc is already on anyway.
Can i also ask. will it put the files and gamelist in the folder with them like it does on the pi?
-
On retropie, you have to way to handle the Scrape :
What I call the "easy" one ;) All in the rom folder :
Exemple :
In your Rom/Snes/ you have- your roms
- the gamelist.xml
- the downloaded_images folder (with all the picture in it).
If I don't mistake, it's the first place where emulationstation check for these info.
But it's not compatible if you scrape with the Retropie Scraper.
And the good thing, it's easily transportable.So, for UXS, the "[Rom folder]" profile are these one.
The second way is the "standard" way Retropie default folder.
- Your roms are in : /home/pi/RetroPie/roms/%system%/
- Your gamelist.xml are in : /home/pi/.emulationstation/gamelists/%System%/
- Your picture are in : /home/pi/.emulationstation/downloaded_images/%system%/
So, for UXS, the "standard" profile are these one.
-
See i want the gamelist.xml to have the correct paths to games/ artwork etc. but i want to do all the scraper FROM and ON the pc hard drive.
-
so you need to "simulate" the Retropie standard path on your PC... like I did for the test ^^
Make a folder name Retropie.
and subfolder /configs/all/emulationstation/downloaded_images
and subfolder /configs/all/emulationstation/gamelists
and subfolder /romsSo you just need to put your different plateform folder (named exactly the same as retropie) in the Roms folder and just tell UXS you want to autoconfigure on this one ;) (with the wizzard and a standard profil ;) )
-
Hello!
Anyone experiencing this error when scraping roms :-
Seeing this error several times when scraping 800 Megadrive roms with 3 pictures per rom.
Should probably add I'm on the very latest version as well (2.1.0.6). I wasn't going to mention the 'unusual' error ;-)
Thanks,
Chicaned
-
@C-hicaned error.. png fucked... lol XD
I'm sure @screech can help you with that.
-
@Nismo Unusual error message lol!
-
Oups !! sorry for this unusual error message ^^
It's a debug one who normally don't happen anymore (it's when I try to resize a picture and the original one have no dimension... so the picture is a fu£$*%^ one ;) )Need to recheck why it can appear again :S
-
Will this scrape videos as well? Looking for a way to build up a collection for the new themes.
-
Hi. First of all thanks for your scrapper and sorry my realy bad english (from Ukraine). Please tell me why skrapper skips part of the Roms? Whether it is possible to manually select the cover for missed games?
-
@Keikato said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:
Hi. First of all thanks for your scrapper and sorry my realy bad english (from Ukraine). Please tell me why skrapper skips part of the Roms? Whether it is possible to manually select the cover for missed games?
games from us and jpn regions, some with fan translations, but i still dont see any regulars
-
Im having two big problems with this but also really appreciate you putting this together im sure this took alot of work. Thanks :)
When using with Retropie if I press scrape all systems I get this error message everytime.
Also after using threading it seemed to mess something up and crash everytime afterwards.
Thanks
-
A bit of mixed feelings about this software. I really like the idea but in practice it has many issues.
I'll list some of the issues I can remember:- Won't open on my main computer, freeze the file explorer and I can't find the process to kill it, I have to restart windows 10. On an old laptop with windows 10 works fine.
- I have tried with master system because I have few games and is faster but no matter what "Mix image profile" I choose, it always creates "BigPicture"
- Some games are not found with this software, the non found can be find with the default retropie scraper. Examples: Fantasy zone II
- After setting my pi roms folder url "\192.168.1.199\roms" on the wizard, and running the scrape, it throws and error because SSH is still pointing to the default HOST, not to 192.168.1.199, I have to manually edit this configuration.
- I think creating files and folder when first lunch may not be a good idea unless you ask for confirmation, many pleople try to open open downloaded software from the browser.
- scraping some plataforms like fba with 4 images (mix), I have same error as mentioned above by @gameplaygoon
- Very slow for some systems, I tried for pc engine and it tooks 8 minutes for only one game, it didn't find the game and now I have "Akumajou dracula X" duplicated because this scraper did something wrong. this is part of the error log:
@error description: $XML_ERR_PARSE=11 Error: with Parsing objects, .parseError.errorCode=0 Use _XML_ErrorParser_GetDescription() for get details. @extended description: $XML_EXT_DEFAULT=0 Default - Do not return any additional information [11:56:38] - /!\ _XML_Open ERROR (Data/jeu/regionshortnames/regionshortname) [11:56:38] - /!\ _XML_Load @error: @error description: $XML_ERR_PARSE=11 Error: with Parsing objects, .parseError.errorCode=0 Use _XML_ErrorParser_GetDescription() for get details.I hope this help, I would really like to try those "Mix image profile", I'll have a look at Screenscraper to see if I can help with anything.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.