RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    EmulationStation Scraper NOT Working

    Scheduled Pinned Locked Moved Help and Support
    scraperemulstationnot working
    114 Posts 25 Posters 89.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      BufferOverFlow @mitu
      last edited by

      @mitu currently im running an older build for windows, tried multiple builds each had its issues, those who had the scrapper working would scrap the info save it but the xml file (gameslist) keeps getting overwritten not showing the scraped info/images.

      my work around was to download nginx and use it as a proxy_pass from thegamesdb.net to legacy.thegamesdb.net.

      now the old scraper works fine.

      if anyone is interested i can make a short "how to" on my work around.

      mituM C 3 Replies Last reply Reply Quote 0
      • mituM
        mitu Global Moderator @BufferOverFlow
        last edited by

        @bufferoverflow said in EmulationStation Scraper NOT Working:

        @mitu currently im running an older build for windows, tried multiple builds each had its issues, those who had the scrapper working would scrap the info save it but the xml file (gameslist) keeps getting overwritten not showing the scraped info/images.

        Use the latest build for Windows and it should be fine, no shenanigans needed. @jdrassa kindly provides up to date Windows builds on his github page - https://github.com/jrassa/EmulationStation/releases.

        B 1 Reply Last reply Reply Quote 0
        • B
          BufferOverFlow @mitu
          last edited by

          @mitu the build "Continuous build (continuous-master)" has some weird thing going on, i already tried it, while scrapping it randomly decides to overwrite the gameslist xml file and not append to it causing the scrap from some games not to show on emulation station knowing that the images and the content do exist in the correct folders.

          other builds has the scrapper not working at all, te bug with the gameslist xml file was the main reason im running an older emulation station build and resort to the dirty work around i did.

          1 Reply Last reply Reply Quote 0
          • C
            Cambruto @BufferOverFlow
            last edited by

            @bufferoverflow said in EmulationStation Scraper NOT Working:

            @mitu currently im running an older build for windows, tried multiple builds each had its issues, those who had the scrapper working would scrap the info save it but the xml file (gameslist) keeps getting overwritten not showing the scraped info/images.

            my work around was to download nginx and use it as a proxy_pass from thegamesdb.net to legacy.thegamesdb.net.

            now the old scraper works fine.

            if anyone is interested i can make a short "how to" on my work around.

            Hi men, how to do change the thegamesdb.net to legacy.thegamesdb.net. I search a GamesDBScraper but i dont know here is.

            Can you Help me?

            TY

            1 Reply Last reply Reply Quote 0
            • C
              Cambruto @BufferOverFlow
              last edited by

              @bufferoverflow All ready i can.

              TY

              B 1 Reply Last reply Reply Quote 0
              • B
                BufferOverFlow @Cambruto
                last edited by BufferOverFlow

                @cambruto
                its 3 steps:
                1- add the following line to windows hosts file located at "C:\Windows\System32\drivers\etc\hosts"

                127.0.0.1 thegamesdb.net

                you need to open notepad as administrator then open the file from notepad menu, otherwise you can not edit the file.

                2- download nginx for windows
                http://nginx.org/download/nginx-1.14.0.zip

                you can extract it anywhere

                3- open nginx.conf in notepad located inside the "conf" folder of nginx, delete all the text in it and replace it with the text in https://pastebin.com/x02tUtr4.

                just run nginx as admin and it should proxy pass.

                to make sure it works open http://thegamesdb.net in your browser and you should see the content of legacy.thegamesdb.net

                the scraper should work then.

                if you no longer need this or you want to access the actual thegamesdb.net just remove the line you added to the hosts file.

                1 Reply Last reply Reply Quote 0
                • stoney66S
                  stoney66
                  last edited by stoney66

                  Does ES currently use the legacy gamesdb site or the new one? Reason I ask is I added some games to the new site but they do not show up when scraping, legacy is read only it seems so I can't add there.

                  1 Reply Last reply Reply Quote 0
                  • srfive3S
                    srfive3
                    last edited by

                    Tracking. Wish I had consulted these forums before attempting a novel(novice/noob) idea of a possible fix.

                    1 Reply Last reply Reply Quote 0
                    • micro-beeM
                      micro-bee
                      last edited by

                      I'd really like if there was a menu setting for hiding the inbuilt ES scrapper. As there are many better scalpers such as the Universal XML Scapper.

                      mediamogulM 1 Reply Last reply Reply Quote 0
                      • mediamogulM
                        mediamogul Global Moderator @micro-bee
                        last edited by mediamogul

                        @micro-bee said in EmulationStation Scraper NOT Working:

                        I'd really like if there was a menu setting for hiding the inbuilt ES scrapper. As there are many better scalpers such as the Universal XML Scapper.

                        Having an interface option for every possible scenario ends up having the adverse effect of adding clutter in the long run. You have to admit that adding an interface option that some people won't use to remove an interface option that some people won't use might not be the best use of space. Plus, despite the scrapers that better handle bulk, it's always nice to have the ES scraper handy to pick up the games that are missed elsewhere.

                        RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                        micro-beeM 1 Reply Last reply Reply Quote 0
                        • micro-beeM
                          micro-bee @mediamogul
                          last edited by micro-bee

                          @mediamogul, I see what your saying. I am not one for taking on custom add-ons and all that. I'll just wait and see.

                          1 Reply Last reply Reply Quote 0
                          • B
                            BufferOverFlow
                            last edited by

                            Can anyone who managed through building EmulationStation on windows lately please guide me or provide a detailed guide on how to compile it, getting loads of errors when trying it on visual studio 2015, all the tutorials i find are outdated and not working.

                            mituM 1 Reply Last reply Reply Quote 0
                            • mituM
                              mitu Global Moderator @BufferOverFlow
                              last edited by

                              @bufferoverflow If you're just trying to get the latest version for the scraper fix, then use @jdrassa's continuous build ES, it's compiled and ready to download - https://github.com/jrassa/EmulationStation/releases.

                              B 1 Reply Last reply Reply Quote 0
                              • D
                                DarishZone Banned
                                last edited by

                                Seems RetroPie scraper not working anymore - again - any tips?

                                mituM 1 Reply Last reply Reply Quote 0
                                • mituM
                                  mitu Global Moderator @DarishZone
                                  last edited by

                                  @darishzone said in EmulationStation Scraper NOT Working:

                                  Seems RetroPie scraper not working anymore - again - any tips?

                                  What's the error ?

                                  1 Reply Last reply Reply Quote 0
                                  • D
                                    DarishZone Banned
                                    last edited by DarishZone

                                    Nevermind, turns out only one of my images get the issue, permissions denied probably.

                                    Edit: I've forgot to update ES, i'm an idiot :p

                                    1 Reply Last reply Reply Quote 0
                                    • B
                                      BufferOverFlow @mitu
                                      last edited by

                                      @mitu its not only the scrapper, i want to edit few things and make mode some commands, maybe enable some extra features, want to get to an advanced level with C++ and i think working on something that i use is better than writing/coding/editing apps that i have no interest in will be a better thing to do and advance faster.

                                      1 Reply Last reply Reply Quote 0
                                      • N
                                        nwsw
                                        last edited by

                                        @mitu is there a similar build for PI? I'm not using Windows, but my ES Scraper still isn't working.

                                        mituM 1 Reply Last reply Reply Quote 0
                                        • mituM
                                          mitu Global Moderator @nwsw
                                          last edited by

                                          @nwsw Please open a new topic with your problem and provide the information requested in https://retropie.org.uk/forum/topic/3/read-this-first. If you have an updated Emulationstation station you should not have this problem.

                                          N 1 Reply Last reply Reply Quote 0
                                          • N
                                            nwsw @mitu
                                            last edited by

                                            @mitu thanks for the help, I updated my es core and the scraper is now working.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.