[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

SuperMagicom

@Squilenator It's not just that mix profile either. The mix scraping is totally fubar in the latest version. I opened an issue ticket on github the other day so hopefully he fixes it soon. Until then I've gone back to the previous version and everything scrapes normally.

SuperMagicom

@screech Latest versions, including today's update, throwing "AutoIt error: Subscript used on non-accessible variable" and crashing after boot screen. 2.1.0.4 is the newest version that will run normally. :(

yortdog

Loved using this tool !!!
For what it's worth, I've been using 2.1.0.6 perfectly for the last 2 weeks, and today is giving me the "Error: Subscript used on non-accessible variable" message, too. There have been no changes to my firewall settings.

Also, when I click on the link above (https://raw.githubusercontent.com/Universal-Rom-Tools/Universal-XML-Scraper/master/Ressources/ServerList.txt) it opens the browser with the text: "404: Not Found." Is that expected?

Thanks again for all your hard work. Amazing tool.

paradadf

@yortdog I can see that file wirhout any problems. Maybe a proxy issue?

yortdog

@paradadf : Not sure, but logged in this morning & it's working fine. Perhaps a localized network connection problem. I can see the text file now.

Sorry for the false alarm. The Universal_XML_Scraper64.exe program loads fine for me today.

SuperMagicom

@paradadf The file was not there when he posted it. I checked it myself.

SuperMagicom

Latest version still is not creating mix profiles properly. The 2.2 versions have been major downgrades both in GUI usability and stability.

Dochartaigh

@SuperMagicom said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

@screech Latest versions, including today's update, throwing "AutoIt error: Subscript used on non-accessible variable" and crashing after boot screen. 2.1.0.4 is the newest version that will run normally. :(

Same "subscript used on non-accessible variable" error for me as well. Actually went back to the old non-updated version since the new version seems to crash more than the old...

SuperMagicom

@Dochartaigh I noticed that the new versions tend to miss a lot of roms that the old version does not. They're also slower and the interface has also become unnecessarily complicated (settings buried in submenus). I'm sticking with 2.1.0.4 for the foreseeable future.

AnalogHero

I really like this tool. It works almost perfect, altough it seems it has issues with some characters in filnames.
When i look at the missing txt in my snes folder it has not scraped any roms with " ' " in it.

I dont think its possible but it would be great if this tool would work on the pi itself from emulationstation. But im dreaming here ofcourse...

denisuu

In the new version it seems to have moved the pictures and the XML file to a different location. How can I move them to the game folder again?

Configuration > advanced > Auto configuration Path configuration

Then what do I change the paths to, to make it like it was in previous versions?

screech

@denisuu
Try this :

In ProfilsFiles Folder, open Retropie.xml

Look for the section <AutoConf>

and replace it by :

<AutoConf>  
<Source_RootPath>\\retropie\roms</Source_RootPath>  
<Target_XMLName>%Source_RootPath%\%system%\gamelist.xml</Target_XMLName>  
<Target_RomPath>./</Target_RomPath>
<Source_ImagePath>%Source_RootPath%\%system%\downloaded_images</Source_ImagePath>
<Target_ImagePath>./downloaded_images/</Target_ImagePath>
</AutoConf>

rapidfire

i dont know if this topic is still active or not, but ive got several problems with the xml scraper

it keeps downloading corrupt or empty .PNG files.
these corrupt files slow down emulation station to a crawl and when you quit emulation station you can see a screen full of error messages about wrong dimensions in png files.
it keeps naming some of the roms in gamelist.xml as "(CLONE, PROTO, HACK ... etc.

when i first downloaded the scraper it worked perfectly on all games and gave nice results.
now its doing this

im using V2.2.0.1

retropie v4.2
a pi3 b

mattrixk

@rapidfire What Scrape/Mix Profiles are you using? Have you started using different ones recently? Are they the ones built into the system, have you made your own, or are you using the ones from the ES Toolkit?

mattrixk

@screech: I'm using v2.1.0.6 and I've been scraping stuff without a problem for the last couple of days, but I just got this error while scraping PC Engine:
Imgur

I haven't made any changed to the scraper or the Profiles used. The scraper made it 153 entries into a total of 234 items.

This is the end of the log file: Pastebin.

It seems to have borked at "Power Eleven". When I clicked "OK" on the error box, the program continued scraping the rest of the files, but it skipped the next 8 files after "Power Eleven".

It seemed to scrape the rest of the files without issue.

rapidfire

@mattrixk said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

@rapidfire What Scrape/Mix Profiles are you using? Have you started using different ones recently? Are they the ones built into the system, have you made your own, or are you using the ones from the ES Toolkit?

i use the 2img profil
i was using 4img and arcade-zoomed-moon-retropie previously, but changed to 2img because i just wanted a screenshot and not much else

i see from another post you are using 2.2.0.6. where do i download that version from? i went to github and it only has 2.2.0.1.

ive never used estoolkit (didnt even know it was a thing until you mentioned it)

mattrixk

@rapidfire I'm using the 2106 version, not the 2206 version. I haven't really tried any of the 2.2 versions yet because they're a pretty big change from v2.1, and 2.1.0.6 does what I need it to.

I put together the Toolkit (with the help of Herb Fargus) so people could easily get started with making themes.

rapidfire

follow up to my problem.
just tried it again using only the visual option (not mix)

fba, and nes all give gamelist.xml similar to this (this is a small section from the fba gamelist)
zx spectrum downloads no images whatsoever. i know they exist on screenscrapers because sselphs scraper grabs them.

<gameList>
<game id="" source="ScreenScraper">
<path>/home/pi/RetroPie/roms/fba/1941.zip</path>
<name> (Clone, Beta, Demo, Proto, Trad, Hack, Unl)</name>
<desc/>
<image/>
<image/>
<marquee/>
<video/>
<thumbnail/>
<rating>0</rating>
<releasedate>00000000T000000</releasedate>
<developer/>
<publisher/>
<genre/>
<players/>
</game>
<game id="" source="ScreenScraper">
<path>/home/pi/RetroPie/roms/fba/1942.zip</path>
<name> (Clone, Beta, Demo, Proto, Trad, Hack, Unl)</name>
<desc/>
<image/>
<image/>
<marquee/>
<video/>
<thumbnail/>
<rating>0</rating>
<releasedate>00000000T000000</releasedate>
<developer/>
<publisher/>
<genre/>
<players/>
</game>

mattrixk

@screech: I've been using the same copy of 2106 on my work computer for a while now, but today I just started getting this error when I try to open the program:

Imgur

I get this error with the following versions: 2105, 2106, 2201.

When I first run the program, this is what the log says:

[12:34:53] - C:\MattK\UXS\Universal_XML_Scraper64.exe (2.1.0.6)
[12:34:53] - WIN_7(X64) - 0409
[12:34:53] - Scrape in x64
[12:34:53] - Starting files installation
[12:34:56] - Error Downloading URL : https://raw.githubusercontent.com/Universal-Rom-Tools/Universal-XML-Scraper/master/Ressources/ServerList.txt

Then when I try to run it again it says this:

[12:35:21] - C:\MattK\UXS\Universal_XML_Scraper64.exe (2.1.0.6)
[12:35:21] - WIN_7(X64) - 0409
[12:35:21] - Scrape in x64
[12:35:21] - > No updated files needed (Version : 2.1.0.6)
[12:35:21] - Starting files installation
[12:35:21] - > Ending files installation
[12:35:22] - Error Downloading URL : https://raw.githubusercontent.com/Universal-Rom-Tools/Universal-XML-Scraper/master/Ressources/ServerList.txt
[12:35:22] - /!\ Error Downloading File : C:\MattK\UXS\Ressources\ServerList.txt
[12:35:22] - /!\ Bytes read: 0
[12:35:22] - /!\ Size: 0
[12:35:22] - /!\ Complete: True
[12:35:22] - /!\ successful: False
[12:35:22] - /!\ @error: 13
[12:35:22] - /!\ @extended: 12029

When I go to https://raw.githubusercontent.com/Universal-Rom-Tools/Universal-XML-Scraper/master/Ressources/ServerList.txt it shows:

Fallback
https://www.screenscraper.fr/
https://mirror.screenscraper.fr/

I've tried both the 64bit and normal versions and get the same error message.

Note: This is happening on my work computer, as far as I'm aware, my home computer still works fine, but I haven't used UXS at home for a day or 2.

BORIStheBLADE1

Ok so has anyone scraped their ROM collection on their computer with this program? I've been trying to do it but it's not working right. It will scrap one system but after that it doesnt save any pictures. What folder structure are you also using?

Thanks