Can't scrape from thegamesdb.net - known problem?
-
@mitu said in Can't scrape from thegamesdb.net - known problem?:
@jasonmicron said in Can't scrape from thegamesdb.net - known problem?:
This seems to indicate scraping is, as of right now, completely broken. Thegamesdb seems to have implemented a new API, so as far as I can ascertain, all scraping is dead in the water right now until all scrapers are updated.
Am I correct in that assessment, or is there something else afoot?The posts you referenced are about the 2 different scrapers. The Emulationstation built-in scraper has been updated when the 1st change on thegamesdb.net has been implemented, but the final change on the 3rd of July has broken the legacy.thegamesdb.net API site and triggered the errors in Emulationstation's scraper.
You can choose another source for scraping in Steven Selph's scraper, so you don't get this error and scraping will work. You can certainly run the scraper from the CLI (though you'd still have to stop ES from running) - see https://github.com/sselph/scraper/wiki.
Ahh cheers, thanks! I only dabble in RetroPie when I'm demanded by my family to add/remove games, and the last time I dabbled was late 2016. So I took the opportunity to update to Stretch from Jessie, among other outstanding updates. I saw a few blank entries for some games, which included, of all things, Super Metroid, so I wanted to re-scrape, which to got me here.
Thanks for the links :) If all goes well, you won't see a reply!
-
For a week now I have not been able to scrape for the games data base..that is from Steven Selph's Scraper. the Emulation Station gui, even from Attract Mode or the universal xml scraper. As far as I can tell they are doing some updating might have to wait till they get it fixed and their end..nothing can be done from a users ends right now..unless you want to build it from scratch by hand..the gamesdb.net site is up and mostly working
-
Any news on this?
-
@arno Yes, update your Emulationstation package and it should work.
-
Indeed it does. Thanks!
-
@mitu my PI is a version before 4.4 i didnt update cause i didnt need too since all the games i run are 8 and 16 bit, is there anyways to fix this without updating it?... im sure it will screw thing up right?
-
@nestor1924 updating retropie-setup then updating emulationstation isnt going to screw anything up. Why do you think it will?
-
@nestor1924 It's enough to update just Emulationstation if you want the fix for the scraping error. Updating the rest of the emulators won't hurt either, as @edmaul69 said.
-
Is it possible to manually scrape, e.g. by logging into screenscraper.fr or something? Never really found out how, but my scraper refuses to scrape a few games, and I'm just getting fed up now :)
-
@andershp Which scraper are you talking about ? The built-in ES scraper uses thegamesdb.net, not screenscraper.fr.
-
@edmaul69 because i thought that it would update it to 4.4 aswell and when the update came out people where sugested to do a fresh install of yhe firmware, which is the option thaf would update it to 4.4 ? just so that i can avoid it
-
@mitu Sorry, getting OT here, it's Universal XML Scraper I'm using. But nevertheless - any place to scrape manually online, if your scraper refuses to scrape a few games?
-
@andershp I guess you could always get the media from the site you wish, save if on your Pi and them manually edit the gamelist.xml and point to it.
-
@mitu i updated the retropie setup script and still not working? What did i do wromg?
-
@nestor1924 you also need to update emulation station under core packages. The newest version of ES fixes the scraper
-
@lostless but like i said before i have not update my retropie, mine its 4.3, if i do will there be an issue with my system?
-
@nestor1924 Backup your sd card, then upgrade the ES package only. If anything doesn't work, then you'll have the backup. IMHO if your last full update was after October last year, then you shouldn't have a problem.
Note that there isn't any problem for you to upgrade to 4.4 from the RetroPie setup script, for the moment the OS you're using (Raspbian Jessie) is still supported by Retropie. This will change in the future though and probably at some point you should also upgrade the OS with the new RetroPie image.
-
@nestor1924 no there is no issue with updating emulation station
-
I updated es. I have retro pie 4.4 and the gamesdB scraper built in still isn't finding anything for me. Any help?
-
@orehruoy Are you connected to the internet ? What is the Emulationstation version ? What game do you try to scrape and is not found ?
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.