Scraping in EmulationStation not working..

lucidious

So I tried scraping all my games overnight but to my dismay when I woke up most of my games had been skipped..

When going through my games, screenscraper gives me this error message.

lv10:  ScreenScraperRequest - Error Parsing XML
No document element found.

Does anyone know why this could be happening? Other people online say it's often a server side issue but I'm not sure. Also is there a limit to how much you can scrape of website for instance in a certain month as I have been doing a lot lately as I've re-done my entire retropie set up.

Thanks for ya help!

morpie

I believe there are a number of possibilities. I did the same and woke up to none scraped, as thegamesdb appeared to be down. I used a few different sources but seem to have a bunch skipped that I know art existed for on other systems I've scraped with. Makes me wonder if it's something I changed or if it's similar to your situation.

What did you have as your scraping source and what didn't scrape?

mitu

Please add more info about your system, as detailed in https://retropie.org.uk/forum/topic/3/read-this-first.
What scraping source are you using ? There are 2 options in EmulationStation - TheGamesDB and ScreenScraper - and the former is not functional at the moment.

morpie

Yeah glad thats confirmed, I didn't get anything with theGamesDB so used the other. Used to use GamesDB with good success, but times are changing.

Running a 3B with most recent image of RetroPie here.

mitu

@morpie said in Scraping in EmulationStation not working..:

Running a 3B with most recent image of RetroPie here.

Well, at this level of details - what can I say ? Works for me, I just scraped today a number of games and didn't get this error.

lucidious

Well this is weird. It seemed to just fix itself. I tried rebooting and that didn't work but a while later it just started working... The weird thing for me is that I did try thegamesdb scraper and that didn't work even though you said only screenscraper wasn't functional. Must have been something at my end.

I was using screenscraper and it skipped literally every game and took about half a second on each one and just gave up. Usually when it does work it takes 2-3 seconds at the least to search for the metadata and art.

mitu

@lucidious said in Scraping in EmulationStation not working..:

The weird thing for me is that I did try thegamesdb scraper and that didn't work even though you said only screenscraper wasn't functional

No, it's the other way around. If it's overloaded ScreenScraper returns nothing to un-registered users and it also has a 10000 requests (?) limit per day. You might have hit such cases when you tried scraping.

lesk

@mitu said in Scraping in EmulationStation not working..:

Please add more info about your system, as detailed in https://retropie.org.uk/forum/topic/3/read-this-first.
What scraping source are you using ? There are 2 options in EmulationStation - TheGamesDB and ScreenScraper - and the former is not functional at the moment.

Do you know when TheGamesDB will be functional again?

This is from the website:
"Update:
due to certain family commitments, we were not able to get the latest backup as of yet.
for now, we're using a READ ONLY old backup, and the API is also back online,
but using the prefix /v1/ which is both to get devs to explicitly make sure old data doesn't just crash their apps,
but this prefix will remain as our main endpoint for this api going forward (aka once latest backup is restored)"

Is this something we can change? Change it to use the prefix v1, whatever that means xD