Skraper and general scraping problems

[che_don_john]

Hi all,

Like most of you, I've been having problem with the ES built-in scraper. First encountered issues a few months ago; updating ES seemed to resolve it for a while, but once again it's not working (tried it on some new Dreamcast roms) - neither updating ES or the RP scripts has fixed it.

I then went to my second option, which is the Selphe Scraper - again, not matter which 'source' I choose, nothing is scraped. Third option was Syscraper - that worked on some of my Dreamcast roms but not others; and, I couldn't work out how to only scrape non-scraped ROMs.

Finally I tried the Skraper Beta and it worked really well! Only problem is, I can't figure out how to make it so that it only scrape non-scraped roms; it just overwrites again and again, thus increasing the time it takes and undoign any fixes I've made manually.

Does anyone know how I can tell Skraper to just scrape the non-scraped new roms?

Cheers

[mitu]

For Stephen Selph's scraper, there is an option to scrape only ROMs that have missing information, both in the GUI or on the command line (-append).
As for Skraper or Skyscraper, there's no penalty in re-running the scraping over a full system, since both cache the resources locally and don't re-download it again from the online scraper.
As a fail-safe method, leave only the ROMs needed in the folder/system you're trying to scrape and they'll be the only ones scraped. You can then copy back the rest of the ROMs and then merge the 2 gamelist.xml files produced for the 2 sets.

[che_don_john]

@mitu said in Skraper and general scraping problems:

For Stephen Selph's scraper, there is an option to scrape only ROMs that have missing information, both in the GUI or on the command line (-append).

Thanks. Will try what you suggested with Skraper, but regarding Selph's scraper, none of the console sources seem to work.

TheGamesDB.net is, I believe, the same one that the in-built ES scraper uses, so I guess that doesn't work for the same reasons discussed elsewhere. But are there any known issues with ScreenScraper.fr and OpenVGDB, or is it likely to be user error?!

[mitu]

@che_don_john Skyscraper can use TheGamesDB since it doesn't rely on the legacy API. I don't know if SScraper has that.
I don't think there are any issues - in Skyscraper at least - with Screenscraper.fr or OpenVGDB.
If you have specific examples - ROM names and checksums - where the entries are in the scraping site, but not found by Skyscraper, then please report them also in the Skyscraper topic.