Scraping no longer working due to old api

ByteThis

@BuZz Is all good ! So are we going to acquire ScreenScraper as well as TheGamesDB for internal scrapers ? Teamwork man. You guys are great.

BuZz

@ByteThis that's the plan :-)

naddel81

great job! what do I have to do to make the internal scraper work again? just update retropie?

mediamogul

@BuZz said in Scraping no longer working due to old api:

I will push out a new stable Emulation Station soon.

Would it be possible to graduate @pjft's fix for scraping directories without crashing in the next stable release? I'm about to hit the open highway for part of a move and may not see the response for a while, but I just thought I'd put it out there. Thanks to all involved on keeping the internal ES scrapers operational. They really come in handy on occasion.

BuZz

@mediamogul I'm planning to resync stable with the dev branch so it should include that.

naddel81

Please tell us when you are ready so we can update our pi devices. Thanks.

ColBojank

@ByteThis

Skyscraper can pull from different sources. I use both thegamesdb and screenscraper.

It has a bit of learning curve if you really want to get it all right, but it's great once you figure it out.

mitu

@ColBojank This topic is about the Emulationstation's internal scraper, not Skyscraper or Steven Selph's scraper.

ByteThis

@ColBojank I have been using Skyscraper but there are some titles that are missing at times. As I mentioned, the internal scraper helps to fill in the missing blanks.

naddel81

internal scraper is on its way to old glory! not quite there, yet.

A Bored Ninja

Very much looking forward to the fix! Skyscraper has been great, but it hates a handful of my PSX titles. It'll be great to fill in the gaps.

naddel81

@A-Bored-Ninja same here! can't wait! :)

naddel81

sorry to be the one, but has it been updated, yet?

quicksilver

@naddel81 "a watched pot never boils" seems to apply here. You'll just have to be patient.

quicksilver

Looks like the internal scraper is functional again. Although using screenscraper as a source only returns the same result no matter which game I'm scraping. Also after updating emulationstation all of my scraped images disappeared. Had to change games list view style from automatic to detailed to get them to appear again.

mitu

@quicksilver Yes, the dev branch made it to stable, so now there's 2 internal scrapers.

EDIT: can you give me some examples of Roms that are not scraping correctly with SS (name/system) ?

quicksilver

@mitu if I scrape any game in my arcade folder it returns "landstalker" for Sega Genesis.

If I scrape any game for atari2600 I get "the revenge of shinobi" for Sega Genesis

Scraping any game for neogeo returns "landstalker"

Scraping any game for NES returns "alien storm" for Genesis.

It may be like this for every system but these were the ones I tested

retrogamer0897

Hello,

Looks like the scraper is working great with the source set to TheGamesDB. Thanks for the hard work on this, I think plenty of people will be happy with this!

I did experience the issue as quicksilver mentioned, with the images now showing in Emulationstation until until switching the view to "detailed". A big thanks to Quicksilver, because I don't think I was going to figure out changing the view right away, so you saved me a headache!

For Screenscraper, an example would be that I am attempting to scrape missing NES games and no matter what title is entered in the search, Alien Storm for Sega Genesis is showing up. The same thing happens if you go to "input" and manually enter a search. And in fact, it doesn't seem to matter if you type a legitimate title in the search or not.

BUT, TheGamesDB source is working as it should, and this is a huge help and gives users an option. Thanks again for the hard work!

mitu

@quicksilver Yes, I tested also and it seems there's something weird coming back from the API (same results as yours).

quicksilver

@mitu is it possible the API is using subliminal messaging in an attempt to get us to play more Sega games? ;)