RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping no longer working due to old api

    Scheduled Pinned Locked Moved Help and Support
    retropiescraperthegamesdbapidevelopment
    90 Posts 21 Posters 27.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • BuZzB
      BuZz administrators @mediamogul
      last edited by

      @mediamogul I'm planning to resync stable with the dev branch so it should include that.

      To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

      1 Reply Last reply Reply Quote 1
      • N
        naddel81
        last edited by

        Please tell us when you are ready so we can update our pi devices. Thanks.

        1 Reply Last reply Reply Quote 0
        • ColBojankC
          ColBojank @ByteThis
          last edited by

          @ByteThis

          Skyscraper can pull from different sources. I use both thegamesdb and screenscraper.

          It has a bit of learning curve if you really want to get it all right, but it's great once you figure it out.

          mituM ByteThisB 2 Replies Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @ColBojank
            last edited by

            @ColBojank This topic is about the Emulationstation's internal scraper, not Skyscraper or Steven Selph's scraper.

            1 Reply Last reply Reply Quote 0
            • ByteThisB
              ByteThis @ColBojank
              last edited by

              @ColBojank I have been using Skyscraper but there are some titles that are missing at times. As I mentioned, the internal scraper helps to fill in the missing blanks.

              1 Reply Last reply Reply Quote 0
              • N
                naddel81
                last edited by

                internal scraper is on its way to old glory! not quite there, yet.

                1 Reply Last reply Reply Quote 0
                • A Bored NinjaA
                  A Bored Ninja
                  last edited by A Bored Ninja

                  Very much looking forward to the fix! Skyscraper has been great, but it hates a handful of my PSX titles. It'll be great to fill in the gaps.

                  N 1 Reply Last reply Reply Quote 0
                  • N
                    naddel81 @A Bored Ninja
                    last edited by

                    @A-Bored-Ninja same here! can't wait! :)

                    1 Reply Last reply Reply Quote 1
                    • N
                      naddel81
                      last edited by

                      sorry to be the one, but has it been updated, yet?

                      quicksilverQ 1 Reply Last reply Reply Quote -1
                      • quicksilverQ
                        quicksilver @naddel81
                        last edited by quicksilver

                        @naddel81 "a watched pot never boils" seems to apply here. You'll just have to be patient.

                        1 Reply Last reply Reply Quote 0
                        • quicksilverQ
                          quicksilver
                          last edited by

                          Looks like the internal scraper is functional again. Although using screenscraper as a source only returns the same result no matter which game I'm scraping. Also after updating emulationstation all of my scraped images disappeared. Had to change games list view style from automatic to detailed to get them to appear again.

                          mituM N 2 Replies Last reply Reply Quote 0
                          • mituM
                            mitu Global Moderator @quicksilver
                            last edited by mitu

                            @quicksilver Yes, the dev branch made it to stable, so now there's 2 internal scrapers.

                            EDIT: can you give me some examples of Roms that are not scraping correctly with SS (name/system) ?

                            quicksilverQ 1 Reply Last reply Reply Quote 0
                            • quicksilverQ
                              quicksilver @mitu
                              last edited by

                              @mitu if I scrape any game in my arcade folder it returns "landstalker" for Sega Genesis.

                              If I scrape any game for atari2600 I get "the revenge of shinobi" for Sega Genesis

                              Scraping any game for neogeo returns "landstalker"

                              Scraping any game for NES returns "alien storm" for Genesis.

                              It may be like this for every system but these were the ones I tested

                              mituM 1 Reply Last reply Reply Quote 0
                              • R
                                retrogamer0897
                                last edited by

                                Hello,

                                Looks like the scraper is working great with the source set to TheGamesDB. Thanks for the hard work on this, I think plenty of people will be happy with this!

                                I did experience the issue as quicksilver mentioned, with the images now showing in Emulationstation until until switching the view to "detailed". A big thanks to Quicksilver, because I don't think I was going to figure out changing the view right away, so you saved me a headache!

                                For Screenscraper, an example would be that I am attempting to scrape missing NES games and no matter what title is entered in the search, Alien Storm for Sega Genesis is showing up. The same thing happens if you go to "input" and manually enter a search. And in fact, it doesn't seem to matter if you type a legitimate title in the search or not.

                                BUT, TheGamesDB source is working as it should, and this is a huge help and gives users an option. Thanks again for the hard work!

                                1 Reply Last reply Reply Quote 0
                                • mituM
                                  mitu Global Moderator @quicksilver
                                  last edited by

                                  @quicksilver Yes, I tested also and it seems there's something weird coming back from the API (same results as yours).

                                  quicksilverQ 1 Reply Last reply Reply Quote 0
                                  • quicksilverQ
                                    quicksilver @mitu
                                    last edited by quicksilver

                                    @mitu is it possible the API is using subliminal messaging in an attempt to get us to play more Sega games? ;)

                                    mituM 1 Reply Last reply Reply Quote 0
                                    • mituM
                                      mitu Global Moderator @quicksilver
                                      last edited by mitu

                                      @quicksilver No, it's something on the API server I think - right now it doesn't return anything, whereas 10 min ago was returning the wrong game.

                                      quicksilverQ 1 Reply Last reply Reply Quote 0
                                      • quicksilverQ
                                        quicksilver @mitu
                                        last edited by

                                        @mitu I was making a joke :)

                                        In all seriousness though thank you for looking into it. Appreciate all the hard work you guys put into getting this operational again.

                                        mituM 1 Reply Last reply Reply Quote 0
                                        • mituM
                                          mitu Global Moderator @quicksilver
                                          last edited by

                                          @quicksilver Something definitely changed on the API side, I've sent an inquiry to their forums and I have a fixed version that I'm testing.

                                          1 Reply Last reply Reply Quote 0
                                          • mituM
                                            mitu Global Moderator
                                            last edited by

                                            I've added a fix and - it seems - the API code was also fixed for an error. It's not in the stable branch, yet.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.