Scraping no longer working due to old api
-
@Smeltie I don't know anyone working on it. I'm more inclined to just remove the scraping from ES.
-
@BuZz
Oh, uhh you mean all scraping or just the built in one? -
@Smeltie I'd hope(and presume) he's just refering to the built in scraper - which is pretty useless tbh.
I got skyscraper working it's a little effort but it's definitely more than adequate -
@Smeltie the built in one. Why would I remove the working ones? :-)
-
@BuZz that would be a shame. It was useful for scraping individual games or ones that don't match a specific list (dos games).
-
@quicksilver I have zero interest in fixing it. Never used it. Patches welcome if you want to update it to use the new API.
-
@BuZz sorry I wasn't trying to come across demanding or anything. I appreciate all you do to let us end users enjoy retropie.
-
@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.
-
being able to scrape games manually is crucial for the roms that have translations etc. and are not found through automatic scraping. I am currently missing several covers due to this on every system. would really appreciate the inbuilt scraper to be working again for its manual approach! that would be awesome!
-
@MosaicDragon i tried skyscraper but no matter what i try the output keeps outputting a compiled image consisting of the cover, screenshot and the wheel.
I have tried the different included xml files but those all give error’s so i don’t know what now 😅.
I’d just like to have covers only just like the built in scraper. -
@Smeltie You could have asked in the Skyscraper topic and I'm sure somebody would have helped. Have you looked in the documentation to see how the
artwork.xml
works ? -
@mitu have tried.
To anyone still looking i tried a tool called "Skraper"
And it works phenominally.
it can really do it all, from combined art, to video's to 2d boxart it does it all.
i highly reccomend everyone try it.
i found it to work best when running on a windows computer with the configs and roms folders shared and added as drives under windows 10. -
but skraper can't do it manually for missing games. :(
-
@mitu said in Scraping no longer working due to old api:
@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.
that would be awesome!
-
@mitu sounds great thanks. I think recalbox includes support for screenscraper.fr in their ES fork - might be useful for reference.
-
Sweet it will be harder to use now. I haven't cursed at this os enough. I need to blow my voice screaming! 🤒
-
@Failrunner it will soon work again and maybe better than before with gamesDB.
-
Can someone please make instructions on how to get the internal scraper "THEGAMEDB" working again? I have one game I need to scrape and I tried Skyscraper and Steven Selph's Scraper and it just didn't work out for me. I kept getting a bash error in the terminal with Skyscaper. With Steven Selph's Scraper I kept getting "It appears that thegamesdb.net isn't up. If your are sure it is use -skip_check to bypass this error. No sources available
-
@Nikorasu081 just look at the help and support section. Every other post today has been about scraping - in summary the in-built scraper isn't currently working, other alternatives are available, and there is a will it/won't it be fixed debate.
Personally, I'm surprised I've not seen it called "scrapping" today. Always laugh when I see that someone has tried to "scrap" games. At the end of the day fighting never solved anything.
-
@omen_peter As you can see in my above post nothing worked for me.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.