Scraping no longer working due to old api

Smeltie

@mitu thanks for sharing, altho i thought i’d still make this with the question if this is going to get patched, or updated. Since i have had issues with those other scrapers before.

BuZz

@Smeltie I don't know anyone working on it. I'm more inclined to just remove the scraping from ES.

Smeltie

@BuZz
Oh, uhh you mean all scraping or just the built in one?

MosaicDragon

@Smeltie I'd hope(and presume) he's just refering to the built in scraper - which is pretty useless tbh.
I got skyscraper working it's a little effort but it's definitely more than adequate

BuZz

@Smeltie the built in one. Why would I remove the working ones? :-)

quicksilver

@BuZz that would be a shame. It was useful for scraping individual games or ones that don't match a specific list (dos games).

BuZz

@quicksilver I have zero interest in fixing it. Never used it. Patches welcome if you want to update it to use the new API.

quicksilver

@BuZz sorry I wasn't trying to come across demanding or anything. I appreciate all you do to let us end users enjoy retropie.

mitu

@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.

naddel81

being able to scrape games manually is crucial for the roms that have translations etc. and are not found through automatic scraping. I am currently missing several covers due to this on every system. would really appreciate the inbuilt scraper to be working again for its manual approach! that would be awesome!

Smeltie

@MosaicDragon i tried skyscraper but no matter what i try the output keeps outputting a compiled image consisting of the cover, screenshot and the wheel.
I have tried the different included xml files but those all give error’s so i don’t know what now 😅.
I’d just like to have covers only just like the built in scraper.

mitu

@Smeltie You could have asked in the Skyscraper topic and I'm sure somebody would have helped. Have you looked in the documentation to see how the artwork.xml works ?

Smeltie

@mitu have tried.
To anyone still looking i tried a tool called "Skraper"
And it works phenominally.
it can really do it all, from combined art, to video's to 2d boxart it does it all.
i highly reccomend everyone try it.
i found it to work best when running on a windows computer with the configs and roms folders shared and added as drives under windows 10.

naddel81

but skraper can't do it manually for missing games. :(

naddel81

@mitu said in Scraping no longer working due to old api:

@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.

that would be awesome!

BuZz

@mitu sounds great thanks. I think recalbox includes support for screenscraper.fr in their ES fork - might be useful for reference.

Failrunner

Sweet it will be harder to use now. I haven't cursed at this os enough. I need to blow my voice screaming! 🤒

naddel81

@Failrunner it will soon work again and maybe better than before with gamesDB.

Nikorasu081

Can someone please make instructions on how to get the internal scraper "THEGAMEDB" working again? I have one game I need to scrape and I tried Skyscraper and Steven Selph's Scraper and it just didn't work out for me. I kept getting a bash error in the terminal with Skyscaper. With Steven Selph's Scraper I kept getting "It appears that thegamesdb.net isn't up. If your are sure it is use -skip_check to bypass this error. No sources available

omen_peter

@Nikorasu081 just look at the help and support section. Every other post today has been about scraping - in summary the in-built scraper isn't currently working, other alternatives are available, and there is a will it/won't it be fixed debate.

Personally, I'm surprised I've not seen it called "scrapping" today. Always laugh when I see that someone has tried to "scrap" games. At the end of the day fighting never solved anything.