RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    scraper

    Scheduled Pinned Locked Moved Help and Support
    scraperscraper errorthegamedb
    15 Posts 6 Posters 817 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Naters CNFN
      Naters CNF
      last edited by

      I was trying to scrape my game collection and it doesn't seem to find any of the games though the titles and everything are spelt correctly
      I'm using THEGAMESDB to do so
      anyone know why it isn't working?

      muldjordM 1 Reply Last reply Reply Quote 0
      • muldjordM
        muldjord @Naters CNF
        last edited by

        @Naters-CNF Please provide more info. What are you scraping with? What platform? How are you scraping? Please spend more time describing your issue.

        Also please read this thoroughly. It describes to different scrapers you can use. The most important thing to remember is that the scraping sources, such as ScreenScraper, needs user credentials to work properly. So go to their site and register a user. You can then gain additional threads by supporting them by adding missing data to their database or by supporting them otherwise.

        For Skyscraper, when you have registered your user, you can use the credentials by editing /home/pi/.skyscraper/config.ini and adding the following:

        [screenscraper]
        userCreds="user:pass"
        

        Just put in your user and pass there.

        1 Reply Last reply Reply Quote 0
        • Naters CNFN
          Naters CNF
          last edited by Naters CNF

          @muldjord said in scraper:

          .skyscraper/config.ini

          I'm just scraping from the menu of retropie.
          I'm scraping a couple hundred games from different consoles just for the metadata.
          And I'm accessing the pi's files over the network

          muldjordM 1 Reply Last reply Reply Quote 0
          • muldjordM
            muldjord @Naters CNF
            last edited by muldjord

            @Naters-CNF said in scraper:

            I'm just scraping from the menu of retropie.

            Ok. So the menu has two scrapers. SSelph's scraper and Skyscraper (as is described in the link I gave you). Which one? And how have you set it up? What did you do to scrape? What particular platform isn't scraping correctly? What errors does it give you? You are being very vague. Please be a lot more descriptive, otherwise it's impossible to help you.

            Naters CNFN 1 Reply Last reply Reply Quote 0
            • Naters CNFN
              Naters CNF @muldjord
              last edited by

              @muldjord
              I'm sorry, I'm just not quite sure how to describe it. When I'm in the main menu just by pressing the start button, I go to the first option (which is scraper) and then press scrape now. After I select a console (for example the n64) then set it to filter all games then press start

              after doing this a different screen comes up that says the title of the first game and it says no games found, even though it's just donkey kong 64

              Is that good?

              muldjordM 1 Reply Last reply Reply Quote 0
              • muldjordM
                muldjord @Naters CNF
                last edited by muldjord

                @Naters-CNF That provided some useful information. :) You're not scraping from the retropie menu then. You are scraping from the EmulationStation menu using the built-in scraper. I am not sure how it fares with TheGamesDb.

                I would recommend using one of the scrapers from the retropie menu instead. I recommend reading the link I provided at the top. It will describe it all in detail and if you do it correctly, it will help you populate your games with metadata quite easily. Please read my Skyscraper comment at the top as well if you choose to use that.

                1 Reply Last reply Reply Quote 0
                • S
                  StigNasty
                  last edited by

                  yeah, looks like the scrapers are down again. I tried both screenscraper and gamesdb. to the OP, it has happened before. it's not just on your end.

                  Naters CNFN 1 Reply Last reply Reply Quote 0
                  • Naters CNFN
                    Naters CNF @StigNasty
                    last edited by

                    @StigNasty
                    So to clarify does this mean that I can't currently scrape games?

                    1 Reply Last reply Reply Quote 0
                    • Naters CNFN
                      Naters CNF
                      last edited by

                      I have now learned there are 2 scrapers.
                      Steven Selph's and skyscraper
                      which do you recomend?

                      Mr. BerlinM 1 Reply Last reply Reply Quote 0
                      • Mr. BerlinM
                        Mr. Berlin @Naters CNF
                        last edited by

                        @Naters-CNF the two is great and works so it's just a matter of what suits you best

                        Naters CNFN 1 Reply Last reply Reply Quote 0
                        • Naters CNFN
                          Naters CNF @Mr. Berlin
                          last edited by

                          @Mr-Berlin
                          ok thanks alot for the help

                          1 Reply Last reply Reply Quote 0
                          • Naters CNFN
                            Naters CNF
                            last edited by

                            So I actually tried both scrapers and neither actually worked
                            Now I definetly don't know what to do

                            ExarKunIvE 1 Reply Last reply Reply Quote 0
                            • ExarKunIvE
                              ExarKunIv @Naters CNF
                              last edited by

                              @Naters-CNF its not you, the servers are overloaded right now.
                              nothing im using is working right now either.
                              you just have to try them off and on through out the day to see if you can get through.

                              RPi3B+ / 200GB/ RetroPie v4.5.14, RPi4 Model B 4gb / 256gb / RetroPie 4.8.2
                              RPi5 4gb / 512gb / RetroPie 4.8.9 -Basic
                              Maintainer of RetroPie-Extra .

                              1 Reply Last reply Reply Quote 0
                              • Naters CNFN
                                Naters CNF
                                last edited by

                                Okay
                                thanks

                                1 Reply Last reply Reply Quote 0
                                • F
                                  froccoar
                                  last edited by

                                  I use openretro for images, and screenscraper for info. Then execute de "generate game list"

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post

                                  Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                  Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.