Versatile C++ game scraper: Skyscraper

muldjord

@AlCzervik It really shouldn't be an issue. It's using https (port 443) which is always open. Otherwise you couldn't visit any encrypted webpages, which is basically all webpages. Is it possible for you to put it on wired network to test it?

AlCzervik

@muldjord Unfortunately, it's all built into an arcade cabinet. I'm thinking about how else I can determine why that particular call would be getting blocked.

muldjord

@AlCzervik If you at all have the chance, I would be curious to know if you could run this on any other machine. But let me know if you have further questions. Unfortunately I don't really know what else I can do at this point.

EDIT: Quick idea, do you have a DNS server registered for the connection? If not, then it won't work since it won't be able to resolve screenscraper.fr. Can you do ping www.google.com and get a response?

AlCzervik

@muldjord pinging google worked just fine. Tell me more about the DNS server issue?

muldjord

@AlCzervik No need. If you can ping www.google.com it is not the issue. Try doing ping www.screenscraper.frjust for the heck of it. But it's not pinging on port 443 so it doesn't really tell us if that's the issue.

AlCzervik

@muldjord pinging screenscraper worked too

muldjord

@AlCzervik What happens if you do telnet www.screenscraper.fr 443 and then type test and press enter? That will connect to the server on port 443 and send testto it, which should result in a 400 Bad Request reply.

AlCzervik

@muldjord telnet command not found

muldjord

@AlCzervik Then you should be able to do sudo apt install telnet

AlCzervik

@muldjord Done. Sorry, was doing that too. Okay, I got the 400 Bad Request reply once I successfully installed telnet

muldjord

@AlCzervik I am very puzzled now. Then you have access to the server over port 443 (https) which means the connection works. But for some reason it always responds to you with an empty reply. Which it doesn't do for me here.

AlCzervik

@muldjord Could it be my version of retro pie or some other inconsistency I have installed with your latest skyscraper version?

muldjord

@AlCzervik I can't come up with anything that would cause this. What happens if you remove the credentials entirely from config.ini? Do you get the service closed for unregistered users reply when scraping games?

AlCzervik

@muldjord Good idea. Here's the screenshot:

muldjord

@AlCzervik Well, at least that leads us to conclude that this is not an issue with the login. It is a general problem on your machine. Can you scrape any games with -s thegamesdb --refresh? Or does that also not work?

AlCzervik

@muldjord I used Skyscraper along with ArcadeDB and it worked like a charm. Just tried it again and it worked great (and fast!!)

muldjord

@AlCzervik Also when adding --refresh? Otherwise it will just read it from the cache instead of connecting to the service.

AlCzervik

@muldjord Yep. Just tried it with refresh. One thing to note, I've been running this via the RetroPie_setup.sh menu, not the command line. Should I try the command line too?

muldjord

@AlCzervik Well, it shouldn't make a difference. Although from command-line it would be easier to ensure it does exactly what we want it to do. But frankly, I don't think it will change anything.

AlCzervik

@muldjord What directory do I run it from?