EmulationStation Scraper NOT Working

mitu · 11 Jul 2018, 06:44

It seems to work fine now, just make sure you have an up-to-date Emulationstation package.

MrJordaaany · 11 Jul 2018, 08:19

@mitu The latest for me is 2.7.5. This correct?

Not working for me if so.

mitu · 11 Jul 2018, 08:27

@mrjordaaany When did you last update it ?

MrJordaaany · 11 Jul 2018, 08:35

@mitu Just now. Binary then restarted my Pi.

mitu · 7 Nov 2018, 09:38

@mrjordaaany Hm, i'm running the dev version (on Windows), I'll try an update from source later to see if the stable version has the same problem. Thanks for testing.

MrJordaaany · 11 Jul 2018, 08:39

@mitu I see, so the Raspberry Pi build may not be working yet. Thanks

mitu · 11 Jul 2018, 08:45

@mrjordaaany No, I now see the change added a few months back is not in the stable branch.
@jdrassa, @pjft - do you think you could add thegamesdb redirection commit to the stable branch also ? They've completely replaced the /api endpoint with the new API and the stable branch still looks at the thegamesdb.net instead of legacy.thegamesdb.net.
I assumed it was a configuration error on their side since they did the move on the 3rd of July, but it seems it's fine.

GreenHawk84 · 7 Nov 2018, 12:18

@mongo64 you will find that the internal scraper is very basic and barely works. I do wish they would implement a scraper that lets you choose all sorts of artworks from all sorts of places with previews etc. Something that really allows full (and easy) customization of the setup. Something that comes with ES that has a nice UI to interact with.

pjft · 11 Jul 2018, 11:35

@mitu Thanks. I don't have the rights to merge those to the stable branch, so either @jdrassa or @BuZz (sorry for pinging you here) would have to be the ones to come to the rescue :|

Daistaar · 11 Jul 2018, 17:10

This may have been asked before (couldn't find it in the search) but is it in the pipeline to add additional sources to the ES Scraper? The fact that it has "thegamesdb.net" as a selection option gives the impression you could cycle to other sources such as Screenscraper or ArcadeItalia.

BuZz · 7 Nov 2018, 18:18

@mitu Thanks. I have cherry-picked the commit and bumped stable version. Binaries are building now - but people can update from source if they want the changes right away.

MrJordaaany · 11 Jul 2018, 22:39

@mitu Thanks man

and thanks @BuZz. When is it good to update from Binary? does it take a few hours to build before I am good to try this option?

@GreenHawk84 Yeah I see a few people saying the built in scrapper is no good in this thread. It's always worked perfectly fine for me though. It would be good if it was a bit more robust, but it's always handy for me as I only use it when I've added a new game. All my stuff has been scraped with other scraping tools, but when I add just one new game, the quickest way to get it's info is to just use the ES scraped. Rather than going to command line etc.

BuZz · 11 Jul 2018, 22:47

@mrjordaaany binaries are now updated.

MrJordaaany · 11 Jul 2018, 23:09

@buzz Love your work Buzz :)

MrJordaaany · 11 Jul 2018, 23:18

@BuZz @mitu Can confirm ES is updated to 2.7.6 and its working when scraping games. Thanks

MrJordaaany · 11 Jul 2018, 23:46

It is working, but shit it's slow. Im getting time-outs 90% of the time. I am aware this is probably due to their site though and not ES...

herb_fargus · 11 Jul 2018, 23:56

@mrjordaaany the new api has limits which will hopefully address the issues they had with excessive bandwidth on their servers

MrJordaaany · 12 Jul 2018, 00:04

@herb_fargus Oh yeah? Sort of like a queue? So when theres too much traffic it just wont work for you?

herb_fargus · 12 Jul 2018, 01:37

@mrjordaaany last I checked the limit was 1000

gizmobjb · 16 Jul 2018, 02:16

I just updated and still not working. Also the alternate scraper is not working