Scraping no longer working due to old api

quicksilver

@BuZz that would be a shame. It was useful for scraping individual games or ones that don't match a specific list (dos games).

BuZz

@quicksilver I have zero interest in fixing it. Never used it. Patches welcome if you want to update it to use the new API.

quicksilver

@BuZz sorry I wasn't trying to come across demanding or anything. I appreciate all you do to let us end users enjoy retropie.

mitu

@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.

naddel81

being able to scrape games manually is crucial for the roms that have translations etc. and are not found through automatic scraping. I am currently missing several covers due to this on every system. would really appreciate the inbuilt scraper to be working again for its manual approach! that would be awesome!

Smeltie

@MosaicDragon i tried skyscraper but no matter what i try the output keeps outputting a compiled image consisting of the cover, screenshot and the wheel.
I have tried the different included xml files but those all give error’s so i don’t know what now 😅.
I’d just like to have covers only just like the built in scraper.

mitu

@Smeltie You could have asked in the Skyscraper topic and I'm sure somebody would have helped. Have you looked in the documentation to see how the artwork.xml works ?

Smeltie

@mitu have tried.
To anyone still looking i tried a tool called "Skraper"
And it works phenominally.
it can really do it all, from combined art, to video's to 2d boxart it does it all.
i highly reccomend everyone try it.
i found it to work best when running on a windows computer with the configs and roms folders shared and added as drives under windows 10.

naddel81

but skraper can't do it manually for missing games. :(

naddel81

@mitu said in Scraping no longer working due to old api:

@BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.

that would be awesome!

BuZz

@mitu sounds great thanks. I think recalbox includes support for screenscraper.fr in their ES fork - might be useful for reference.

Failrunner

Sweet it will be harder to use now. I haven't cursed at this os enough. I need to blow my voice screaming! 🤒

naddel81

@Failrunner it will soon work again and maybe better than before with gamesDB.

Nikorasu081

Can someone please make instructions on how to get the internal scraper "THEGAMEDB" working again? I have one game I need to scrape and I tried Skyscraper and Steven Selph's Scraper and it just didn't work out for me. I kept getting a bash error in the terminal with Skyscaper. With Steven Selph's Scraper I kept getting "It appears that thegamesdb.net isn't up. If your are sure it is use -skip_check to bypass this error. No sources available

omen_peter

@Nikorasu081 just look at the help and support section. Every other post today has been about scraping - in summary the in-built scraper isn't currently working, other alternatives are available, and there is a will it/won't it be fixed debate.

Personally, I'm surprised I've not seen it called "scrapping" today. Always laugh when I see that someone has tried to "scrap" games. At the end of the day fighting never solved anything.

Nikorasu081

@omen_peter As you can see in my above post nothing worked for me.

naddel81

we have to wait for @mitu to fix the scraper. really looking forward to it.

Smeltie

This post is deleted!

retrogamer0897

As simple mortal end user, I just wanted to add my 2 cents in and say that the work of developers is much appreciated!

I also wanted to chime in and say that I also appreciate the built-in scraper for being able to manually search and add individual games. I usually use the Selph scraper to take care of the bulk, then manually add the ones it doesn't find.

Thank you!

TPR

@BuZz While I understand that the internal scraper may be far from the best tool, it is the only one that I've found that works (worked) fantastic for scraping just a single ROM that I've added to my list. As someone who is a bit less on the technical side, having this tool has been a great help in many situations. Even if it is not high on the priority list to fix, I for one would be greatly appreciative of it was somewhere on the list down the road. Thanks for all the time and hard work put into this!