Can't Find a Complete Scraper

AlphaBetaPie

I have curated all my console sets down to just the US releases, so I decided to test scraping for art on just my NES collection. I have around 764 ROMs in my collection. However, I've tried just about every scraper I can find (for PC, don't have a pie setup yet), and none of them seem to find all my games.

Even just the bascis stuff (like screenshots and 2D cover art) comes up short. I've never gotten more than about 720-ish results for any of them, and they're all No-Intro naming. I've tried SkraperUI and SkySkraper, but none seem to make a difference. Is this normal in the community, or is there a way to get complete results?

mitu

@AlphaBetaPie It's not just the naming, both Skraper and Skyscraper use primarily checksums for the ROMs and search the scraping database (ScreenScraper) using it. Still, 96% success rate is pretty good.

Also, consider that some of the ROMs might not have artwork/metadata on the source site - so the scraper might not find anything.
When using Skyscraper, you have to option to change the source - use TheGamesDB instead of ScreenScraper and see if any new data comes in.

Lastly, post some of the ROMs that are not scraped - filename and checksum (MD5), so we can see why they're not found.

t3l01v

@mitu said in Can't Find a Complete Scraper:

When using Skyscraper, you have to option to change the source - use TheGamesDB instead of ScreenScraper and see if any new data comes in.

How do you do this with Skyscraper?

mitu

@t3l01v said in Can't Find a Complete Scraper:

How do you do this with Skyscraper?

If you use the scriptmodule interface, it's just a selection list - https://retropie.org.uk/docs/Scraper/#using-skyscraper. If you're running skyscraper from the command line, there is a parameter to change - -s I believe - https://github.com/muldjord/skyscraper/blob/master/docs/SCRAPINGMODULES.md.

anmag70

@mitu checkout youtube on how to manually add artwork paths. there are several.

mitu

@anmag70 I'm not the one that started the topic, but can you link one the videos you mentioned ? Otherwise your guidance reads like 'use Google to find the answer'.