• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

Scraping no longer working due to old api

Scheduled Pinned Locked Moved Help and Support
retropiescraperthegamesdbapidevelopment
90 Posts 21 Posters 27.1k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • O
    omen_peter @Nikorasu081
    last edited by 5 Jan 2019, 19:39

    @Nikorasu081 just look at the help and support section. Every other post today has been about scraping - in summary the in-built scraper isn't currently working, other alternatives are available, and there is a will it/won't it be fixed debate.

    Personally, I'm surprised I've not seen it called "scrapping" today. Always laugh when I see that someone has tried to "scrap" games. At the end of the day fighting never solved anything.

    Raspberry Pi3 Model B V1.2
    16 GB Micro SD Card (OS), 4TB WD Elements Portable HDD (Roms)
    5V 3.0A Power Supply
    RetroPie V4.7.7, EmulationStation V2.9.6RP, RetroArch V1.8.8
    1 x Sonnics i8 Mini Keyboard (Wireless), 4 x Wii U Pro Controllers (Bluetooth)

    N 1 Reply Last reply 5 Jan 2019, 20:12 Reply Quote 0
    • N
      Nikorasu081 Banned @omen_peter
      last edited by 5 Jan 2019, 20:12

      @omen_peter As you can see in my above post nothing worked for me.

      1 Reply Last reply Reply Quote 0
      • N
        naddel81
        last edited by 5 Jan 2019, 21:12

        we have to wait for @mitu to fix the scraper. really looking forward to it.

        S 1 Reply Last reply 6 Jan 2019, 00:46 Reply Quote 0
        • S
          Smeltie @naddel81
          last edited by 6 Jan 2019, 00:46

          This post is deleted!
          1 Reply Last reply Reply Quote 0
          • R
            retrogamer0897
            last edited by 11 Jan 2019, 20:38

            As simple mortal end user, I just wanted to add my 2 cents in and say that the work of developers is much appreciated!

            I also wanted to chime in and say that I also appreciate the built-in scraper for being able to manually search and add individual games. I usually use the Selph scraper to take care of the bulk, then manually add the ones it doesn't find.

            Thank you!

            1 Reply Last reply Reply Quote 0
            • T
              TPR @BuZz
              last edited by 15 Jan 2019, 22:53

              @BuZz While I understand that the internal scraper may be far from the best tool, it is the only one that I've found that works (worked) fantastic for scraping just a single ROM that I've added to my list. As someone who is a bit less on the technical side, having this tool has been a great help in many situations. Even if it is not high on the priority list to fix, I for one would be greatly appreciative of it was somewhere on the list down the road. Thanks for all the time and hard work put into this!

              Q 1 Reply Last reply 16 Jan 2019, 13:04 Reply Quote 1
              • Q
                quicksilver @TPR
                last edited by 16 Jan 2019, 13:04

                Since there seem to be a lot of people interested in this feature I would suggest waiting to see what mitu is able to come up with. He stated he is working on a fix to have the internal scraper switched to a different website. If that fix doesn't come then those that want it should probably consider putting together a bounty to get it fixed. This is a good way for those of us with no coding skills to motivate those who have the skills.

                M 1 Reply Last reply 16 Jan 2019, 16:49 Reply Quote 0
                • M
                  mitu Global Moderator @quicksilver
                  last edited by mitu 16 Jan 2019, 16:49

                  @quicksilver For now, I don't think a bounty is needed. A couple of patches have been posted on the ES RetroPie repository to enable scraping again - one of them is mine -, they're just waiting for review and merge. I avoided adding an update on the forum so that the github page wouldn't be paged with unnecessary 'please fix/me too' messages.

                  Q R 2 Replies Last reply 16 Jan 2019, 18:03 Reply Quote 7
                  • Q
                    quicksilver @mitu
                    last edited by 16 Jan 2019, 18:03

                    @mitu That is awesome! Thanks for your hard work on this and all your troubleshooting support as well!

                    1 Reply Last reply Reply Quote 0
                    • R
                      retrogamer0897 @mitu
                      last edited by 17 Jan 2019, 01:44

                      @mitu Thanks for the update! The hard work is definitely appreciated. The internal scraper is far from useless, as some has said, and definitely has its place on the RetroPie system.

                      1 Reply Last reply Reply Quote 0
                      • M
                        MetalManTN
                        last edited by 21 Jan 2019, 00:00

                        I would also like to join the list of those who would like to see the internal scraper updated to use the new api for thegamesdb. I do not want to sound ungrateful to all the other efforts going on, and I do hope those efforts continue and are successful. However, I would personally prefer to continue being able to scrape from thegamesdb and not some other site. Thanks for everything!

                        1 Reply Last reply Reply Quote 0
                        • S
                          skhull2
                          last edited by 27 Jan 2019, 17:44

                          After spending 4-6 hours trying everything, I found this. Thanks a TON for working on a fix for Scraping. Can't wait for the update to be available.

                          B 1 Reply Last reply 27 Jan 2019, 18:44 Reply Quote 1
                          • B
                            BuZz administrators @skhull2
                            last edited by 27 Jan 2019, 18:44

                            @skhull2 if you install emulationstation-dev you can test it now. From experimental section.

                            To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                            S 1 Reply Last reply 1 Feb 2019, 01:36 Reply Quote 1
                            • Z
                              zefolhadela
                              last edited by 27 Jan 2019, 19:09

                              i which i know more to fix it man. skyscrapper method is good but not so good as the built in one, lets say you had 10 games i prefere just scrape them individualy in the built in one cause it is more practical and if you make sure you have the right info for the right rom. unfortunaly recently i had a bunch of sega cd, pc engine cd, amiga and msdos games and not get lucky to scrape them. i get comitted to scrape them manually

                              1 Reply Last reply Reply Quote 0
                              • S
                                skhull2 @BuZz
                                last edited by 1 Feb 2019, 01:36

                                @BuZz AWESOME!!! Got Screenscaper going right now! AWESOME job Buzz, AWESOME!!!!

                                B 1 Reply Last reply 1 Feb 2019, 02:15 Reply Quote 0
                                • B
                                  BuZz administrators @skhull2
                                  last edited by BuZz 2 Jan 2019, 02:18 1 Feb 2019, 02:15

                                  @skhull2 Glad it's working. I did very little btw. @mitu did the work. :-)

                                  (Edit) accidentally tagged muldjord first time as I got confused with skyscraper. Which @mitu integrated into retropie-setup also (an excellent scraper written by @muldjord)

                                  To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                                  B 1 Reply Last reply 3 Feb 2019, 03:01 Reply Quote 0
                                  • B
                                    ByteThis @BuZz
                                    last edited by ByteThis 2 Mar 2019, 03:04 3 Feb 2019, 03:01

                                    @BuZz Thanks for deciding on a different internal scraper source. Skyscraper is great but misses a few titles and this one fills the blanks. And also @mitu for your hard work ! Works fantastic ! Is this the beta or final version ?

                                    B C 2 Replies Last reply 3 Feb 2019, 03:06 Reply Quote 1
                                    • B
                                      BuZz administrators @ByteThis
                                      last edited by 3 Feb 2019, 03:06

                                      @ByteThis there's another patch coming to put gamesdb back in also. Not from me - just to clarify I'm not the one doing the work in this case. I will push out a new stable Emulation Station soon. Thanks!

                                      To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                                      B M 2 Replies Last reply 3 Feb 2019, 03:32 Reply Quote 3
                                      • B
                                        ByteThis @BuZz
                                        last edited by 3 Feb 2019, 03:32

                                        @BuZz Is all good ! So are we going to acquire ScreenScraper as well as TheGamesDB for internal scrapers ? Teamwork man. You guys are great.

                                        B 1 Reply Last reply 3 Feb 2019, 04:02 Reply Quote 1
                                        • B
                                          BuZz administrators @ByteThis
                                          last edited by 3 Feb 2019, 04:02

                                          @ByteThis that's the plan :-)

                                          To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                                          1 Reply Last reply Reply Quote 1
                                          41 out of 90
                                          • First post
                                            41/90
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received