RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraper accuracy?

    Scheduled Pinned Locked Moved
    Help and Support
    scraper scraper error gamesdb
    3
    12
    1.4k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • MisterMintsM
      MisterMints
      last edited by

      After a bit of a disaster I've had to rebuild my pi system from scratch (yep, I know - backup, backup backup) and now I've got it setup and all my ROMs transferred I need to scrape the titles, art work etc.

      When I did this before I used the default gamesdb scraper in Emulation Station but remember it taking forever and being largely inaccurate. For example, it classified ALL of my Genesis/MegaDrive Sonic the Hedgehog main series games as "Sonic the Hedgehog 2" so it looked like I had multiple copies of games.

      I'm keen to avoid manually editing 5000+ ROMs again so trying to work out how accurate Stephen Selpher's scraper is before I just let it get on with doing all systems and all games by itself.

      Any thoughts or experience to share?

      Thanks

      mituM 1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator @MisterMints
        last edited by

        @MisterMints Both scraper and skyscraper can use the ROM file checksum to search, instead of using only the name only. For the scraping sources that support this (ScreenScraper), it should yield pretty accurate results if you're using a well known ROM collection set.

        MisterMintsM 1 Reply Last reply Reply Quote 0
        • MisterMintsM
          MisterMints @mitu
          last edited by

          @mitu said in Scraper accuracy?:

          @MisterMints Both scraper and skyscraper can use the ROM file checksum to search, instead of using only the name only. For the scraping sources that support this (ScreenScraper), it should yield pretty accurate results if you're using a well known ROM collection set.

          Cheers @mitu

          I've ended up using a bit of a combination of both of those suggestions. The sselph scraper was having problems finding my PS1 games, but was mostly OK with everything else, by Skyscraper found all missing items.

          GamesDB however wouldn't find anything and just kept saying "no game found"

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @MisterMints
            last edited by

            @MisterMints said in Scraper accuracy?:

            GamesDB however wouldn't find anything and just kept saying "no game found"

            For all games or just for the particular games ? Did you use Skyscraper from the RetroPie menu or installed it standalone ?

            MisterMintsM 1 Reply Last reply Reply Quote 0
            • MisterMintsM
              MisterMints @mitu
              last edited by

              @mitu said in Scraper accuracy?:

              @MisterMints said in Scraper accuracy?:

              GamesDB however wouldn't find anything and just kept saying "no game found"

              For all games or just for the particular games ? Did you use Skyscraper from the RetroPie menu or installed it standalone ?

              GamesDB wouldn't find any games at all. I was testing it out on systems I have fewer games on to start with (e.g. 32x I have something like 15 games, GBA about 20) and just wouldn't find anything.

              I also couldn't find Skyscraper anywhere in the RetroPie menu. I went through the command prompt to get to the manage/install packages section, but it wasn't there. In the end I installed it manually following the guide on muldjord's GitHub pages for it.

              mituM 1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator @MisterMints
                last edited by

                @MisterMints You have an outdated RetroPie installation. Probably that's why Emulationstation doesn't work to scrape from TheGamesDB.

                MisterMintsM 1 Reply Last reply Reply Quote 0
                • MisterMintsM
                  MisterMints @mitu
                  last edited by MisterMints

                  @mitu said in Scraper accuracy?:

                  @MisterMints You have an outdated RetroPie installation. Probably that's why Emulationstation doesn't work to scrape from TheGamesDB.

                  Can't be outdated. I only downloaded it and installed it a couple of days ago direct from the RP website. I'm running 4.4. Built the system from scratch after messing up my old build.

                  mituM 1 Reply Last reply Reply Quote 0
                  • mituM
                    mitu Global Moderator @MisterMints
                    last edited by

                    @MisterMints Did you update you RetroPie script and the installed packages, after you installed the image ? What version shows up when you start the RetroPie-Setup script ?

                    MisterMintsM 1 Reply Last reply Reply Quote 0
                    • MisterMintsM
                      MisterMints @mitu
                      last edited by

                      @mitu said in Scraper accuracy?:

                      @MisterMints Did you update you RetroPie script and the installed packages, after you installed the image ? What version shows up when you start the RetroPie-Setup script ?

                      9c54ef8b

                      mituM 1 Reply Last reply Reply Quote 0
                      • mituM
                        mitu Global Moderator @MisterMints
                        last edited by

                        @MisterMints This corresponds to 4.4.4 - you should have skyscraper as a module in the experimental packages section. Did you also update the packages ?

                        MisterMintsM 1 Reply Last reply Reply Quote 0
                        • R
                          Revenged
                          last edited by

                          I highly recommend using the tool "Skraper". It's a Windows application where you just configure the ROM path for your Retropie (via network), choose your preferred scraping settings, pick the system and go. It's extremely accurate. For example, I just scraped the whole 1G1R No-Intro set of Game Boy Color and there were only 2 games that were not found (some obscure Japanese test ROMs or something).

                          1 Reply Last reply Reply Quote 0
                          • MisterMintsM
                            MisterMints @mitu
                            last edited by

                            @mitu said in Scraper accuracy?:

                            @MisterMints This corresponds to 4.4.4 - you should have skyscraper as a module in the experimental packages section. Did you also update the packages ?

                            I did, but still "no game found"

                            This happens whether I go via the scraper option from pressing start and doing it on a system by system basis, or edit this games meta data on individual ROMs.

                            I have go sselph and skyscraper working now so it's no big issue and they both seem to be very accurate so far

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post

                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.