Scraping no longer working due to old api
-
@mitu thanks for sharing, altho i thought i’d still make this with the question if this is going to get patched, or updated. Since i have had issues with those other scrapers before.
-
@Smeltie I don't know anyone working on it. I'm more inclined to just remove the scraping from ES.
-
@BuZz
Oh, uhh you mean all scraping or just the built in one? -
@Smeltie I'd hope(and presume) he's just refering to the built in scraper - which is pretty useless tbh.
I got skyscraper working it's a little effort but it's definitely more than adequate -
@Smeltie the built in one. Why would I remove the working ones? :-)
-
@BuZz that would be a shame. It was useful for scraping individual games or ones that don't match a specific list (dos games).
-
@quicksilver I have zero interest in fixing it. Never used it. Patches welcome if you want to update it to use the new API.
-
@BuZz sorry I wasn't trying to come across demanding or anything. I appreciate all you do to let us end users enjoy retropie.
-
@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.
-
being able to scrape games manually is crucial for the roms that have translations etc. and are not found through automatic scraping. I am currently missing several covers due to this on every system. would really appreciate the inbuilt scraper to be working again for its manual approach! that would be awesome!
-
@MosaicDragon i tried skyscraper but no matter what i try the output keeps outputting a compiled image consisting of the cover, screenshot and the wheel.
I have tried the different included xml files but those all give error’s so i don’t know what now 😅.
I’d just like to have covers only just like the built in scraper. -
@Smeltie You could have asked in the Skyscraper topic and I'm sure somebody would have helped. Have you looked in the documentation to see how the
artwork.xml
works ? -
@mitu have tried.
To anyone still looking i tried a tool called "Skraper"
And it works phenominally.
it can really do it all, from combined art, to video's to 2d boxart it does it all.
i highly reccomend everyone try it.
i found it to work best when running on a windows computer with the configs and roms folders shared and added as drives under windows 10. -
but skraper can't do it manually for missing games. :(
-
@mitu said in Scraping no longer working due to old api:
@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.
that would be awesome!
-
@mitu sounds great thanks. I think recalbox includes support for screenscraper.fr in their ES fork - might be useful for reference.
-
Sweet it will be harder to use now. I haven't cursed at this os enough. I need to blow my voice screaming! 🤒
-
@Failrunner it will soon work again and maybe better than before with gamesDB.
-
Can someone please make instructions on how to get the internal scraper "THEGAMEDB" working again? I have one game I need to scrape and I tried Skyscraper and Steven Selph's Scraper and it just didn't work out for me. I kept getting a bash error in the terminal with Skyscaper. With Steven Selph's Scraper I kept getting "It appears that thegamesdb.net isn't up. If your are sure it is use -skip_check to bypass this error. No sources available
-
@Nikorasu081 just look at the help and support section. Every other post today has been about scraping - in summary the in-built scraper isn't currently working, other alternatives are available, and there is a will it/won't it be fixed debate.
Personally, I'm surprised I've not seen it called "scrapping" today. Always laugh when I see that someone has tried to "scrap" games. At the end of the day fighting never solved anything.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.