RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Versatile C++ game scraper: Skyscraper

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscrapergamelist.xmlscrapinggithub
    1.6k Posts 113 Posters 1.6m Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • muldjordM
      muldjord @AlCzervik
      last edited by muldjord

      @AlCzervik I can't see that, it is too small

      EDIT: Nevermind, it was processing, I can see it now.

      EDIT2: It actually gives me some other information. It seems that you have no connection to screenscraper.fr at all. The "Retrying request..." only happens when it receives an empty reply. This should not happen. Are you behind some weird firewall or something? Is your wifi / network connection running at all?

      EDIT3: I've just tested it, right now, on my own machine. It works just fine. I'm pretty sure this is a local issue to your machine.

      A 2 Replies Last reply Reply Quote 0
      • A
        AlCzervik @muldjord
        last edited by

        @muldjord I tried a larger size version but still seems super small. Regardless, you are right, that error message did change to include "empty"

        1 Reply Last reply Reply Quote 0
        • A
          AlCzervik @muldjord
          last edited by

          @muldjord Okay, perhaps that is it. Wifi is running fine, that's how I updated to v3.4.4. Must be something with calling that API directly and my Wifi is blocking it.

          muldjordM 1 Reply Last reply Reply Quote 0
          • muldjordM
            muldjord @AlCzervik
            last edited by muldjord

            @AlCzervik It really shouldn't be an issue. It's using https (port 443) which is always open. Otherwise you couldn't visit any encrypted webpages, which is basically all webpages. Is it possible for you to put it on wired network to test it?

            A 1 Reply Last reply Reply Quote 0
            • A
              AlCzervik @muldjord
              last edited by

              @muldjord Unfortunately, it's all built into an arcade cabinet. I'm thinking about how else I can determine why that particular call would be getting blocked.

              muldjordM 1 Reply Last reply Reply Quote 0
              • muldjordM
                muldjord @AlCzervik
                last edited by muldjord

                @AlCzervik If you at all have the chance, I would be curious to know if you could run this on any other machine. But let me know if you have further questions. Unfortunately I don't really know what else I can do at this point.

                EDIT: Quick idea, do you have a DNS server registered for the connection? If not, then it won't work since it won't be able to resolve screenscraper.fr. Can you do ping www.google.com and get a response?

                A 1 Reply Last reply Reply Quote 0
                • A
                  AlCzervik @muldjord
                  last edited by

                  @muldjord pinging google worked just fine. Tell me more about the DNS server issue?

                  muldjordM 2 Replies Last reply Reply Quote 0
                  • muldjordM
                    muldjord @AlCzervik
                    last edited by muldjord

                    @AlCzervik No need. If you can ping www.google.com it is not the issue. Try doing ping www.screenscraper.frjust for the heck of it. But it's not pinging on port 443 so it doesn't really tell us if that's the issue.

                    A 1 Reply Last reply Reply Quote 0
                    • A
                      AlCzervik @muldjord
                      last edited by

                      @muldjord pinging screenscraper worked too

                      1 Reply Last reply Reply Quote 0
                      • muldjordM
                        muldjord @AlCzervik
                        last edited by muldjord

                        @AlCzervik What happens if you do telnet www.screenscraper.fr 443 and then type test and press enter? That will connect to the server on port 443 and send testto it, which should result in a 400 Bad Request reply.

                        A 1 Reply Last reply Reply Quote 0
                        • A
                          AlCzervik @muldjord
                          last edited by

                          @muldjord telnet command not found

                          muldjordM 1 Reply Last reply Reply Quote 0
                          • muldjordM
                            muldjord @AlCzervik
                            last edited by

                            @AlCzervik Then you should be able to do sudo apt install telnet

                            A 1 Reply Last reply Reply Quote 0
                            • A
                              AlCzervik @muldjord
                              last edited by

                              @muldjord Done. Sorry, was doing that too. Okay, I got the 400 Bad Request reply once I successfully installed telnet

                              muldjordM 1 Reply Last reply Reply Quote 0
                              • muldjordM
                                muldjord @AlCzervik
                                last edited by muldjord

                                @AlCzervik I am very puzzled now. Then you have access to the server over port 443 (https) which means the connection works. But for some reason it always responds to you with an empty reply. Which it doesn't do for me here.

                                A 1 Reply Last reply Reply Quote 0
                                • A
                                  AlCzervik @muldjord
                                  last edited by

                                  @muldjord Could it be my version of retro pie or some other inconsistency I have installed with your latest skyscraper version?

                                  muldjordM 1 Reply Last reply Reply Quote 0
                                  • muldjordM
                                    muldjord @AlCzervik
                                    last edited by

                                    @AlCzervik I can't come up with anything that would cause this. What happens if you remove the credentials entirely from config.ini? Do you get the service closed for unregistered users reply when scraping games?

                                    A 1 Reply Last reply Reply Quote 0
                                    • A
                                      AlCzervik @muldjord
                                      last edited by

                                      @muldjord Good idea. Here's the screenshot: IMG_0254.jpeg

                                      muldjordM 1 Reply Last reply Reply Quote 0
                                      • muldjordM
                                        muldjord @AlCzervik
                                        last edited by

                                        @AlCzervik Well, at least that leads us to conclude that this is not an issue with the login. It is a general problem on your machine. Can you scrape any games with -s thegamesdb --refresh? Or does that also not work?

                                        A 1 Reply Last reply Reply Quote 0
                                        • A
                                          AlCzervik @muldjord
                                          last edited by

                                          @muldjord I used Skyscraper along with ArcadeDB and it worked like a charm. Just tried it again and it worked great (and fast!!)

                                          muldjordM 1 Reply Last reply Reply Quote 0
                                          • muldjordM
                                            muldjord @AlCzervik
                                            last edited by

                                            @AlCzervik Also when adding --refresh? Otherwise it will just read it from the cache instead of connecting to the service.

                                            A 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.