[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

elahrairah

So I downloaded video and 3d box with xml scraper for psx and all went well but the gamelist.xml shows the wrong paths to my video art.

I use on my retropie setup (with external hdd) two seperate folders for images and video:
Image : folder "boxart
Video: folder "snap"
Both these folders are in the system rom folder: /roms/psx
This is the conventional method almost every retropie user uses.
But when looking at the paths to the video and art in the gamelist I see they both point to same location which is /retropie/roms/psx/boxart. This means I have to put all the art in the same "boxart" folder, which I do not want.

So I did try to fix it myself and change the path in configuration to "boxart" location which is the right path for the 3d boxes. But I want the gamelist to also create a seperate path to the video in the gamelist.xml, so it points to my art folder "snap"

How do I do this?

Long question in short: how do I change the paths in the gamelist.xml so each type of art is linked to a seperate folder?

EctoOne

@elahrairah there is no way to set differnt paths in the scraper as far as i know. you have to manually edit the video paths in the gamelist.xml. Doing a search/replace should be the easiest method. I suggest to search for <video>OLDPATH/instead of just OLDPATH/ this will prevent that the path to your images will also be changed.

elahrairah

@ectoone don't know if I will go through those lengths but I appreciate your answer, at least now I know it's not possible, so I think I'll just put all art in 1 folder.. No big deal.

EctoOne

@elahrairah with something like notepad++ it is very simple to achieve though. It lets you search/replace in multiple files and what not. I did the same thing for all four media files (boxart, marquee, thumbnail and video) and have them in separate folders now.

hooperre

@screech Is there a way to add a game for PC for example on the screenscraper.fr website? I see Windows 3.1 and stuff.

Also, I haven't been able to login from Google Chrome for about a year. I have had to use Microsoft Edge. :\

BiZzAr721

Excellent program! Extremely usefull and simple.

I have been searching for an answer for a question that maybe can be answered here. I have a lot of MS -DOS games that I would like to scrape. I have tried scraping entire folders, renaming files, even creating a blank file with the name & extension shown on ScreenScraper.fe.

Quite a bit of ms-dos games have screenshot/box/disk art. I was able to get scummVM to scrape by naming the scripts to match exactly, but I can't figure out why it will not work with MS-DOS. I asked over at ScreenScraper.fe forums but they seem to be pretty empty and haven't gotten a response. Is it possible to create custom images from multiple images by having all the images in folders on a pc? It would still be a lot better than what I have been doing, which is editing, resizing and combining each artwork manually. Thank you.

AndersHP

I just rescraped my entire arcade catalog, but cannot get UXML V2 to scrape a few selected games: why this issue with even some pretty known titles (and some not)?:

Qbert
krull
ZigZag
Vendetta
Rainbow Islands

..along with a few others. In the final scraping status screen it says 100% found, but it returns 1KB empty images/videos.

AndersHP

Just saw that in MAME on screenscraper.fr neither Vendetta or Q*Bert shows up via browser. These were definitely there last time I scraped - how come these games suddenly goes missing?

mitu

@andershp They're somewhere on the site, they're not missing

screech

There is some work to do on Arcade Game (it's not finished yet ;) there is so much...)

But I just create a New "system" : Gottlieb we haven't.
So now their is 20 new games referenced and sorted nicely (like Q*Bert and Krull ;)
I check the other game and some roms were orphean so I attach them to the good game ;)

normally it's ok now...

(I still have to clean the DB and add stuff, but there is at least some info on media on each game in your list ;) )

Let me know if it's ok ;)

AndersHP

It looks like it worked, thanks @screech ! But I have another question:
I rescraped my arcades folder, in the hope that it would just supplement the missing titles, but it scraped EVERY wheelart.png again, but with wheelart.jpg even though I had them already. In my pictures configuration I have chosen png, so why does it do this now?

Edit: Even with "default" it still scrapes jpg wheelart - these doesn't look as crisp as png's, how do I force png if the png option doesnt make any difference?

BlockABoots

Is there a way to speed this program up it seems super slow!. I have it currently sraping 4000 MAME rom files and it says its going to take 21hrs to complete!!!!

hooperre

Hey, @screech . I have an issue with Dreamcast (about a month). It says it is testing the server, but then just goes until it times out. It times out with a message "Unable to allocate memory." Thanks.

hermit

could the names of the files used by MESS be added to the database? thank you

mastersetter

This is a great app, but for some reason, when scraping videos, about 10 out of 50 dont work. They play but have a black screen and no sound, so i have to replace these with ones from mame packs and rename them to add the -video tag, the others work fine but its a bit of a hassle when some of my systems are over 100 roms. Any ideas? My log in is using 6 threads and is quick enough.

spannernick1

Hi Is there any way of changing the names of the images..? I ask because I have a Armiga and it don't have a scraper and it names the covers the name of the rom plus .adf.jpg so the rom name is say 1943.adf.jpg.

Its naming them at the moment 1943-image.jpg because I had to pick Retropie,would love this to support it,I can connect to the Armiga by FTP only. so I can transfer them over to the right folder.

EctoOne

@spannernick1 There might be if you edit the profile.xml that you're using. But I'm not sure, haven't done it myself. But you could use a different tool to remove the -image part and add the extension. I personally use AntRenamer Portable for such things.

Carcayu

@mastersetter this is something that also happened to me. As soon as I converted all videos (mostly are 640x480 at 60hz and I changed it to 320x240 at 30hz to save space) it play all the videos, don't know why if it is because of resolution or codec

paffley

Hi, is there anyway to scrape video snaps at 320x240 (30hz) from within the scraper?

hooperre

Hello all. Is there any way to contribute roms/games to the screenscraper.fr site? I know there are millions of DOS games out there, but there is really no good way to scrape them at this point. Only DOOM works out of my collection. More work for ScummVM, but not all. Retropie uses a .svm file extension and on the site only .scummvm is listed.

Found the answer regarding auto-additions in the forum.