What scrapper should I use in 2020?

muldjord

@Spectreman Please read this thoroughly. It describes to different scrapers you can use. The most important thing to remember is that the scraping sources, such as ScreenScraper, needs user credentials to work properly. So go to their site and register a user. You can then gain additional threads by supporting them by adding missing data to their database or by supporting them otherwise.

For Skyscraper, when you have registered your user, you can use the credentials by editing /home/pi/.skyscraper/config.ini and adding the following:

[screenscraper]
userCreds="user:pass"

Just put in your user and pass there.

Mr. Berlin

@muldjord hey! is there any way to scarp systems like neogeo cd and naomi and atomiswave ' if not can u please add support for themes platforms i try to scrape naomi using -p arcade but not luck for almost 80% of my roms .

Spectreman

@muldjord

Thanks , I had forgot that you need exit emulationstation before running Selph's Scraper . Maybe was this that give a XML parsing error in the new instalation. I did another reinstall and now is fine.

Is not the case to remove the scrapper option in Emulationstation menu? And update with the Selph's Scraper in a more automatic way that you don´t need to type the sudo command?

Thorr69

I use this scrapper. https://i.imgur.com/hNiP65G.png

But I doubt that's what you really want. In RetroPie, you want a SCRAPER. I tend to use Universal XML Scraper.

muldjord

@Spectreman The integrated ES scraper is fine for a few games and it's convenient for some users, no need to remove it. Skyscraper can be used directly from the command-line. You don't have to use it from the retropie menu.

muldjord

@Mr-Berlin For the arcade sub-platforms I'm pretty sure they are already supported by at least ScreenScraper. Are you sure your files are ok? That's usually the problem.

nexusone13

Hi, @Spectreman , you could try ARRM, it's a windows application. Wiki : http://jujuvincebros.fr/wiki/arrm/doku.php?id=start-en

Spectreman

@muldjord Yes. But this seems not being working without registering for a 2 or 3 years from now. Is not Scraper a basic function that should be easy for new Retropie users? This can be another factor leading new users to just use a image pack with thousands of roms already installed rather than building your colection because scraper is annoying to use?

mitu

@Spectreman said in What scrapper should I use in 2020?:

But this seems not being working without registering for a 2 or 3 years from now

No, this happened starting last week.

muldjord

@Spectreman Please understand the difference between the scraper software and the scraper sources. Neither RetroPie or Skyscraper is affiliated with the scraping sources. We don't control what requirements they have to use their API's. It is them who require registering, not RetroPie or Skyscraper.

The reason the sources need registering is because their servers are overloaded. So it's either that, or nothing. You can do free scraping with thegamesdb as source though. They still allow 3000 unregistered scraping per month.

gokuh306

Due to heavy load, I know Screenscraper has disabled it's API to non registered users. Try using a different API, or register an account with Screenscraper then use a scraper that can be configured to use your login credentials, Skyscraper has a line in it's config,ini as mentioned above. I've been using Skraper. It runs on Windows and scrapes through samba shares.

jarven77

@mr-berlin The Atomiswave roms are working with gamesdb scraper if You place the roms in arcade folder.
But Naomi games I cannot scrape this way.

REK607

This post is deleted!

REK607

I am using Skyscrapper for pics and Steven Selph's scrapper for videos (as I couldn't login in Screenscraper, now I know how thanks to this thread!). My pics and metadata are ok but my videos are just sound and a blackscreen, any idea what's wrong? I'm on a Pi 3B + retropie 2.7.1, OMX player is on.