Scraping no longer working due to old api

mitu

@quicksilver For now, I don't think a bounty is needed. A couple of patches have been posted on the ES RetroPie repository to enable scraping again - one of them is mine -, they're just waiting for review and merge. I avoided adding an update on the forum so that the github page wouldn't be paged with unnecessary 'please fix/me too' messages.

quicksilver

@mitu That is awesome! Thanks for your hard work on this and all your troubleshooting support as well!

retrogamer0897

@mitu Thanks for the update! The hard work is definitely appreciated. The internal scraper is far from useless, as some has said, and definitely has its place on the RetroPie system.

MetalManTN

I would also like to join the list of those who would like to see the internal scraper updated to use the new api for thegamesdb. I do not want to sound ungrateful to all the other efforts going on, and I do hope those efforts continue and are successful. However, I would personally prefer to continue being able to scrape from thegamesdb and not some other site. Thanks for everything!

skhull2

After spending 4-6 hours trying everything, I found this. Thanks a TON for working on a fix for Scraping. Can't wait for the update to be available.

BuZz

@skhull2 if you install emulationstation-dev you can test it now. From experimental section.

zefolhadela

i which i know more to fix it man. skyscrapper method is good but not so good as the built in one, lets say you had 10 games i prefere just scrape them individualy in the built in one cause it is more practical and if you make sure you have the right info for the right rom. unfortunaly recently i had a bunch of sega cd, pc engine cd, amiga and msdos games and not get lucky to scrape them. i get comitted to scrape them manually

skhull2

@BuZz AWESOME!!! Got Screenscaper going right now! AWESOME job Buzz, AWESOME!!!!

BuZz

@skhull2 Glad it's working. I did very little btw. @mitu did the work. :-)

(Edit) accidentally tagged muldjord first time as I got confused with skyscraper. Which @mitu integrated into retropie-setup also (an excellent scraper written by @muldjord)

ByteThis

@BuZz Thanks for deciding on a different internal scraper source. Skyscraper is great but misses a few titles and this one fills the blanks. And also @mitu for your hard work ! Works fantastic ! Is this the beta or final version ?

BuZz

@ByteThis there's another patch coming to put gamesdb back in also. Not from me - just to clarify I'm not the one doing the work in this case. I will push out a new stable Emulation Station soon. Thanks!

ByteThis

@BuZz Is all good ! So are we going to acquire ScreenScraper as well as TheGamesDB for internal scrapers ? Teamwork man. You guys are great.

BuZz

@ByteThis that's the plan :-)

naddel81

great job! what do I have to do to make the internal scraper work again? just update retropie?

mediamogul

@BuZz said in Scraping no longer working due to old api:

I will push out a new stable Emulation Station soon.

Would it be possible to graduate @pjft's fix for scraping directories without crashing in the next stable release? I'm about to hit the open highway for part of a move and may not see the response for a while, but I just thought I'd put it out there. Thanks to all involved on keeping the internal ES scrapers operational. They really come in handy on occasion.

BuZz

@mediamogul I'm planning to resync stable with the dev branch so it should include that.

naddel81

Please tell us when you are ready so we can update our pi devices. Thanks.

ColBojank

@ByteThis

Skyscraper can pull from different sources. I use both thegamesdb and screenscraper.

It has a bit of learning curve if you really want to get it all right, but it's great once you figure it out.

mitu

@ColBojank This topic is about the Emulationstation's internal scraper, not Skyscraper or Steven Selph's scraper.

ByteThis

@ColBojank I have been using Skyscraper but there are some titles that are missing at times. As I mentioned, the internal scraper helps to fill in the missing blanks.