Scraper help

IceChes1

Both of the ES scrapers do not work, and I do not know the commands or instructions to run Selph Scraper or Skyscraper. Help please.

Pi Model or other hardware: Raspberry Pi 4B 1GB
Power Supply used: CanaKit 3.5 amp 5 volt PSU
RetroPie Version Used: 4.1
Built From: Manual master branch install
USB Devices connected: Logitech F310, AmazonBasics Wired mouse, Transcend 16 GB USB Drive.
Controller used: Logitech F310

AlienUA

https://www.screenscraper.fr/index.php lock service for unregistered users.

StigNasty

@IceChes1 it’s not just you. I think there’s something wrong with it. Confirmed on my install, neither screenscraper or gamesdb is working to scrape. It just flies past titles without scraping.

In the terminal, I see the following:

For screenscraper:
lvl0: ScreenScraperRequest - Error Parsing XML.
No document element found

For gamesDB:
Lvl0: TheGamesDBJSONRequest - Error parsing JSON.
Invalid value.

retropieuser555

@StigNasty I was finding this today and was going to post about it. Sucks as I quite like the internal scraper.

Clyde

From another thread:

@mitu said in Scraping:

It looks like the ScreenScraper site has a few issues at the moment with their API, scraping is going to be either very slow or have lots of failed requests until they get it back. This was posted in their forum:

Hello ScreenScraper community,

we have a technical problem with the ScreenScraper clone server. This causes significant slowdowns on the site and the api and therefore on your scrapers. We recommend you to wait until both servers are working normally again to do your scrapes.

Thank you for your patience, the ScreenScraper team.

IceChes1

What about Skyscraper/Selph Scraper? Anyone know what to do for those?

Clyde

@IceChes1 What do you mean by "to do for those"? If screenscraper.fr has problems, all scrapers are affected. Apart from that, their usage is explained in https://retropie.org.uk/docs/Scraper/.

If you have problems or explicit questions about them after reading those instructions, ask away, but please be more specific.

nightbirdmedia

@Clyde I think he means how to get them to work. They kept asking me to register when I attempted to use them. But how do you register for them? I tried to register at https://www.screenscraper.fr but it wouldn't send me a confirmation email.

nick1984

I scraped all my systems, for covers and video samples and I fount in many systems that most of ROMS appears 2 3 or 4 times in the ROM lists. They were not copied (I checked with Filezilla) but I see more than one in the game list.

Pi Model or other hardware: raspberry pi 3 b+
RetroPie Version Used: 4.1

AlienUA

You can install skyscraper and register on http://screenscraper.fr/
Then add your creds into
sudo nano /opt/retropie/configs/all/skyscraper/config.ini

in end fo file add
[screenscraper]
userCreds="user:pass"

use skyscraper, it works for me.

saccublenda

Is it possible to use screenscraper.fr credentials in the Emulationstation's internal scraper?

mitu

@saccublenda said in Scraper help:

Is it possible to use screenscraper.fr credentials in the Emulationstation's internal scraper?

No, that's not supported.

AlienUA

@saccublenda Sorry, I didn't check this.

Clyde

@nightbirdmedia You don't have to register at screenscraper.fr, but they'll close the access for non-registered users if their servers are under heavy load – like at the moment, as I just checked. You can see their server status on their website.

More access will be granted to monthly paying subscribers. A mere 1€ per month will get you access even if the access for registered (non-paying) users is closed, as well as 50.000 scrapes per day instead of only 20.000.

See their website for this and more information.

nightbirdmedia

@Clyde thanks.