Scraping no longer working due to old api
-
@mitu said in Scraping no longer working due to old api:
@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.
that would be awesome!
-
@mitu sounds great thanks. I think recalbox includes support for screenscraper.fr in their ES fork - might be useful for reference.
-
Sweet it will be harder to use now. I haven't cursed at this os enough. I need to blow my voice screaming! 🤒
-
@Failrunner it will soon work again and maybe better than before with gamesDB.
-
Can someone please make instructions on how to get the internal scraper "THEGAMEDB" working again? I have one game I need to scrape and I tried Skyscraper and Steven Selph's Scraper and it just didn't work out for me. I kept getting a bash error in the terminal with Skyscaper. With Steven Selph's Scraper I kept getting "It appears that thegamesdb.net isn't up. If your are sure it is use -skip_check to bypass this error. No sources available
-
@Nikorasu081 just look at the help and support section. Every other post today has been about scraping - in summary the in-built scraper isn't currently working, other alternatives are available, and there is a will it/won't it be fixed debate.
Personally, I'm surprised I've not seen it called "scrapping" today. Always laugh when I see that someone has tried to "scrap" games. At the end of the day fighting never solved anything.
-
@omen_peter As you can see in my above post nothing worked for me.
-
we have to wait for @mitu to fix the scraper. really looking forward to it.
-
This post is deleted! -
As simple mortal end user, I just wanted to add my 2 cents in and say that the work of developers is much appreciated!
I also wanted to chime in and say that I also appreciate the built-in scraper for being able to manually search and add individual games. I usually use the Selph scraper to take care of the bulk, then manually add the ones it doesn't find.
Thank you!
-
@BuZz While I understand that the internal scraper may be far from the best tool, it is the only one that I've found that works (worked) fantastic for scraping just a single ROM that I've added to my list. As someone who is a bit less on the technical side, having this tool has been a great help in many situations. Even if it is not high on the priority list to fix, I for one would be greatly appreciative of it was somewhere on the list down the road. Thanks for all the time and hard work put into this!
-
Since there seem to be a lot of people interested in this feature I would suggest waiting to see what mitu is able to come up with. He stated he is working on a fix to have the internal scraper switched to a different website. If that fix doesn't come then those that want it should probably consider putting together a bounty to get it fixed. This is a good way for those of us with no coding skills to motivate those who have the skills.
-
@quicksilver For now, I don't think a bounty is needed. A couple of patches have been posted on the ES RetroPie repository to enable scraping again - one of them is mine -, they're just waiting for review and merge. I avoided adding an update on the forum so that the github page wouldn't be paged with unnecessary 'please fix/me too' messages.
-
@mitu That is awesome! Thanks for your hard work on this and all your troubleshooting support as well!
-
@mitu Thanks for the update! The hard work is definitely appreciated. The internal scraper is far from useless, as some has said, and definitely has its place on the RetroPie system.
-
I would also like to join the list of those who would like to see the internal scraper updated to use the new api for thegamesdb. I do not want to sound ungrateful to all the other efforts going on, and I do hope those efforts continue and are successful. However, I would personally prefer to continue being able to scrape from thegamesdb and not some other site. Thanks for everything!
-
After spending 4-6 hours trying everything, I found this. Thanks a TON for working on a fix for Scraping. Can't wait for the update to be available.
-
@skhull2 if you install emulationstation-dev you can test it now. From experimental section.
-
i which i know more to fix it man. skyscrapper method is good but not so good as the built in one, lets say you had 10 games i prefere just scrape them individualy in the built in one cause it is more practical and if you make sure you have the right info for the right rom. unfortunaly recently i had a bunch of sega cd, pc engine cd, amiga and msdos games and not get lucky to scrape them. i get comitted to scrape them manually
-
@BuZz AWESOME!!! Got Screenscaper going right now! AWESOME job Buzz, AWESOME!!!!
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.