RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    I need some help scraping ROM data

    Scheduled Pinned Locked Moved Help and Support
    datascrapingscraper
    14 Posts 5 Posters 1.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      bfollowell
      last edited by

      I verified against No-Intro dat files from DAT-o-MATIC

      1 Reply Last reply Reply Quote 0
      • ClydeC
        Clyde
        last edited by

        What did Selph's Scraper say exactly when it didn't find the roms? Were the hashes unknown or couldn't it connect to the chosen online database?

        Additionally, you could try Selph's own guide about when Scraper can't find a game?

        1 Reply Last reply Reply Quote 0
        • B
          bfollowell
          last edited by

          Most of the text rolled by so quickly, I couldn't tell you what any of them said. I'll try again this evening and see what they say.

          I do know that most of them, especially the whole systems that are missing, seemed to go through just fine, with almost no missing or skipped ROMs. It's just that, when I went back into Emulation Station, nothing was there, as far as images and descriptions go.

          I may install skraper and try that this evening.

          M 1 Reply Last reply Reply Quote 0
          • M
            MetalManTN @bfollowell
            last edited by

            @bfollowell I could be wrong about this, but I'm thinking you have to reboot the Pi (or at least restart EmulationStation) before the scraped images and metadata will be saved and also appear on screen. You may have been doing this anyway, but since you didn't mention it I thought I would throw that out there.

            ClydeC 1 Reply Last reply Reply Quote 2
            • IanDaemonI
              IanDaemon
              last edited by IanDaemon

              In addition to restarting ES, Skyscraper worked well for me. You can find it under the "experimental" section in the RetroPie
              menus.

              • 5 Favorite Arcade Games in MAME
              • Cocktail Cabinet Games
              • Check out the MAME RoW
              1 Reply Last reply Reply Quote 0
              • ClydeC
                Clyde @MetalManTN
                last edited by Clyde

                @MetalManTN A reboot isn't necessary, just a restart of Emulation Station. That said, Selph's Scraper will refuse to scrape if ES is still running, because ES will overwrite the gamelist.xml on exiting, thus reversing any changes the scraper would make. So, you'll have to stop and restart it after scraping anyway.

                @bfollowell Try removing or renaming the gamelist.xml in every rom directory in question. The scraper should rebuild it, so look for (and into) a new one after scraping. There should be entries for the artwork and information for every game then.

                Skyscraper also worked well for me, but as I said, so did Selph's Scraper.

                1 Reply Last reply Reply Quote 0
                • B
                  bfollowell
                  last edited by

                  Thanks for everyone's help. I tried everything you guys suggested and, unfortunately, none of your suggestions helped at all in my case. I have no idea why neither the built-in nor the Selph's Scraper seemed to work for me. I downloaded Skraper and it is working like a charm. I'm scraping on my PC and then copying the files over my network to my Pi and everything is working perfectly. It's working easily enough, and well enough, that I really have no desire to find out why the other ways weren't working from my Pi any longer. I'm pretty sure I've found out how I will do all of my scraping moving forward.

                  I do appreciate everyone trying to help me though. Thank you!

                  ClydeC 1 Reply Last reply Reply Quote 0
                  • SingingCoyote13S
                    SingingCoyote13 @bfollowell
                    last edited by SingingCoyote13

                    @bfollowell as far as i know of, you can best use skyscraper to do this, and do not forget to build the entire gameslists afterwards. You might want to set the scraping to thegamesdb if the title contains a ´[!]´ or like ´[ ´ ´]´ with those brackets, and to no-intro if the title lacks the brackets´ [´ ´]´ but has these ( ) like (English) or (US).

                    1 Reply Last reply Reply Quote 0
                    • ClydeC
                      Clyde @bfollowell
                      last edited by

                      @bfollowell Whatever works for you is fine, have fun!

                      IanDaemonI 1 Reply Last reply Reply Quote 0
                      • IanDaemonI
                        IanDaemon @Clyde
                        last edited by

                        @Clyde https://media.discordapp.net/attachments/400348842832429066/616284091616329728/i84d7bl4c5x01.png

                        • 5 Favorite Arcade Games in MAME
                        • Cocktail Cabinet Games
                        • Check out the MAME RoW
                        ClydeC 1 Reply Last reply Reply Quote 1
                        • ClydeC
                          Clyde @IanDaemon
                          last edited by

                          @IanDaemon I think the „playing“ part is much too big in this diagram. 😉

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post

                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.