• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

Scraping no longer working due to old api

Scheduled Pinned Locked Moved Help and Support
retropiescraperthegamesdbapidevelopment
90 Posts 21 Posters 27.1k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • B
    BuZz administrators @mediamogul
    last edited by 4 Feb 2019, 05:07

    @mediamogul I'm planning to resync stable with the dev branch so it should include that.

    To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

    1 Reply Last reply Reply Quote 1
    • N
      naddel81
      last edited by 4 Feb 2019, 08:34

      Please tell us when you are ready so we can update our pi devices. Thanks.

      1 Reply Last reply Reply Quote 0
      • C
        ColBojank @ByteThis
        last edited by 4 Feb 2019, 16:52

        @ByteThis

        Skyscraper can pull from different sources. I use both thegamesdb and screenscraper.

        It has a bit of learning curve if you really want to get it all right, but it's great once you figure it out.

        M B 2 Replies Last reply 4 Feb 2019, 16:53 Reply Quote 0
        • M
          mitu Global Moderator @ColBojank
          last edited by 4 Feb 2019, 16:53

          @ColBojank This topic is about the Emulationstation's internal scraper, not Skyscraper or Steven Selph's scraper.

          1 Reply Last reply Reply Quote 0
          • B
            ByteThis @ColBojank
            last edited by 4 Feb 2019, 17:08

            @ColBojank I have been using Skyscraper but there are some titles that are missing at times. As I mentioned, the internal scraper helps to fill in the missing blanks.

            1 Reply Last reply Reply Quote 0
            • N
              naddel81
              last edited by 4 Feb 2019, 19:40

              internal scraper is on its way to old glory! not quite there, yet.

              1 Reply Last reply Reply Quote 0
              • A
                A Bored Ninja
                last edited by A Bored Ninja 2 Jun 2019, 02:10 5 Feb 2019, 03:10

                Very much looking forward to the fix! Skyscraper has been great, but it hates a handful of my PSX titles. It'll be great to fill in the gaps.

                N 1 Reply Last reply 5 Feb 2019, 19:07 Reply Quote 0
                • N
                  naddel81 @A Bored Ninja
                  last edited by 5 Feb 2019, 19:07

                  @A-Bored-Ninja same here! can't wait! :)

                  1 Reply Last reply Reply Quote 1
                  • N
                    naddel81
                    last edited by 8 Feb 2019, 21:41

                    sorry to be the one, but has it been updated, yet?

                    Q 1 Reply Last reply 8 Feb 2019, 21:45 Reply Quote -1
                    • Q
                      quicksilver @naddel81
                      last edited by quicksilver 2 Aug 2019, 21:46 8 Feb 2019, 21:45

                      @naddel81 "a watched pot never boils" seems to apply here. You'll just have to be patient.

                      1 Reply Last reply Reply Quote 0
                      • Q
                        quicksilver
                        last edited by 10 Feb 2019, 04:54

                        Looks like the internal scraper is functional again. Although using screenscraper as a source only returns the same result no matter which game I'm scraping. Also after updating emulationstation all of my scraped images disappeared. Had to change games list view style from automatic to detailed to get them to appear again.

                        M N 2 Replies Last reply 10 Feb 2019, 05:28 Reply Quote 0
                        • M
                          mitu Global Moderator @quicksilver
                          last edited by mitu 2 Oct 2019, 05:42 10 Feb 2019, 05:28

                          @quicksilver Yes, the dev branch made it to stable, so now there's 2 internal scrapers.

                          EDIT: can you give me some examples of Roms that are not scraping correctly with SS (name/system) ?

                          Q 1 Reply Last reply 10 Feb 2019, 06:04 Reply Quote 0
                          • Q
                            quicksilver @mitu
                            last edited by 10 Feb 2019, 06:04

                            @mitu if I scrape any game in my arcade folder it returns "landstalker" for Sega Genesis.

                            If I scrape any game for atari2600 I get "the revenge of shinobi" for Sega Genesis

                            Scraping any game for neogeo returns "landstalker"

                            Scraping any game for NES returns "alien storm" for Genesis.

                            It may be like this for every system but these were the ones I tested

                            M 1 Reply Last reply 10 Feb 2019, 06:07 Reply Quote 0
                            • R
                              retrogamer0897
                              last edited by 10 Feb 2019, 06:06

                              Hello,

                              Looks like the scraper is working great with the source set to TheGamesDB. Thanks for the hard work on this, I think plenty of people will be happy with this!

                              I did experience the issue as quicksilver mentioned, with the images now showing in Emulationstation until until switching the view to "detailed". A big thanks to Quicksilver, because I don't think I was going to figure out changing the view right away, so you saved me a headache!

                              For Screenscraper, an example would be that I am attempting to scrape missing NES games and no matter what title is entered in the search, Alien Storm for Sega Genesis is showing up. The same thing happens if you go to "input" and manually enter a search. And in fact, it doesn't seem to matter if you type a legitimate title in the search or not.

                              BUT, TheGamesDB source is working as it should, and this is a huge help and gives users an option. Thanks again for the hard work!

                              1 Reply Last reply Reply Quote 0
                              • M
                                mitu Global Moderator @quicksilver
                                last edited by 10 Feb 2019, 06:07

                                @quicksilver Yes, I tested also and it seems there's something weird coming back from the API (same results as yours).

                                Q 1 Reply Last reply 10 Feb 2019, 06:08 Reply Quote 0
                                • Q
                                  quicksilver @mitu
                                  last edited by quicksilver 2 Oct 2019, 06:08 10 Feb 2019, 06:08

                                  @mitu is it possible the API is using subliminal messaging in an attempt to get us to play more Sega games? ;)

                                  M 1 Reply Last reply 10 Feb 2019, 06:14 Reply Quote 0
                                  • M
                                    mitu Global Moderator @quicksilver
                                    last edited by mitu 2 Oct 2019, 06:15 10 Feb 2019, 06:14

                                    @quicksilver No, it's something on the API server I think - right now it doesn't return anything, whereas 10 min ago was returning the wrong game.

                                    Q 1 Reply Last reply 10 Feb 2019, 06:16 Reply Quote 0
                                    • Q
                                      quicksilver @mitu
                                      last edited by 10 Feb 2019, 06:16

                                      @mitu I was making a joke :)

                                      In all seriousness though thank you for looking into it. Appreciate all the hard work you guys put into getting this operational again.

                                      M 1 Reply Last reply 10 Feb 2019, 08:02 Reply Quote 0
                                      • M
                                        mitu Global Moderator @quicksilver
                                        last edited by 10 Feb 2019, 08:02

                                        @quicksilver Something definitely changed on the API side, I've sent an inquiry to their forums and I have a fixed version that I'm testing.

                                        1 Reply Last reply Reply Quote 0
                                        • M
                                          mitu Global Moderator
                                          last edited by 10 Feb 2019, 17:40

                                          I've added a fix and - it seems - the API code was also fixed for an error. It's not in the stable branch, yet.

                                          1 Reply Last reply Reply Quote 0
                                          53 out of 90
                                          • First post
                                            53/90
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received