RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping no longer working due to old api

    Scheduled Pinned Locked Moved Help and Support
    retropiescraperthegamesdbapidevelopment
    90 Posts 21 Posters 27.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mituM
      mitu Global Moderator
      last edited by mitu

      https://retropie.org.uk/forum/topic/20613/emulationstation-internal-scraper-problems - it's the first post in the Help & Support forum.

      SmeltieS 1 Reply Last reply Reply Quote 1
      • SmeltieS
        Smeltie @mitu
        last edited by

        @mitu thanks for sharing, altho i thought i’d still make this with the question if this is going to get patched, or updated. Since i have had issues with those other scrapers before.

        BuZzB 1 Reply Last reply Reply Quote 0
        • BuZzB
          BuZz administrators @Smeltie
          last edited by

          @Smeltie I don't know anyone working on it. I'm more inclined to just remove the scraping from ES.

          To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

          SmeltieS quicksilverQ TPRT 3 Replies Last reply Reply Quote 2
          • SmeltieS
            Smeltie @BuZz
            last edited by

            @BuZz
            Oh, uhh you mean all scraping or just the built in one?

            M BuZzB 2 Replies Last reply Reply Quote 0
            • M
              MosaicDragon @Smeltie
              last edited by MosaicDragon

              @Smeltie I'd hope(and presume) he's just refering to the built in scraper - which is pretty useless tbh.
              I got skyscraper working it's a little effort but it's definitely more than adequate

              SmeltieS 1 Reply Last reply Reply Quote 0
              • BuZzB
                BuZz administrators @Smeltie
                last edited by

                @Smeltie the built in one. Why would I remove the working ones? :-)

                To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                1 Reply Last reply Reply Quote 1
                • quicksilverQ
                  quicksilver @BuZz
                  last edited by

                  @BuZz that would be a shame. It was useful for scraping individual games or ones that don't match a specific list (dos games).

                  BuZzB 1 Reply Last reply Reply Quote 1
                  • BuZzB
                    BuZz administrators @quicksilver
                    last edited by BuZz

                    @quicksilver I have zero interest in fixing it. Never used it. Patches welcome if you want to update it to use the new API.

                    To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                    quicksilverQ mituM 2 Replies Last reply Reply Quote 1
                    • quicksilverQ
                      quicksilver @BuZz
                      last edited by

                      @BuZz sorry I wasn't trying to come across demanding or anything. I appreciate all you do to let us end users enjoy retropie.

                      1 Reply Last reply Reply Quote 1
                      • mituM
                        mitu Global Moderator @BuZz
                        last edited by

                        @BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.

                        N BuZzB 2 Replies Last reply Reply Quote 5
                        • N
                          naddel81
                          last edited by

                          being able to scrape games manually is crucial for the roms that have translations etc. and are not found through automatic scraping. I am currently missing several covers due to this on every system. would really appreciate the inbuilt scraper to be working again for its manual approach! that would be awesome!

                          1 Reply Last reply Reply Quote 1
                          • SmeltieS
                            Smeltie @MosaicDragon
                            last edited by

                            @MosaicDragon i tried skyscraper but no matter what i try the output keeps outputting a compiled image consisting of the cover, screenshot and the wheel.
                            I have tried the different included xml files but those all give error’s so i don’t know what now 😅.
                            I’d just like to have covers only just like the built in scraper.

                            mituM 1 Reply Last reply Reply Quote 0
                            • mituM
                              mitu Global Moderator @Smeltie
                              last edited by

                              @Smeltie You could have asked in the Skyscraper topic and I'm sure somebody would have helped. Have you looked in the documentation to see how the artwork.xml works ?

                              SmeltieS 1 Reply Last reply Reply Quote 0
                              • SmeltieS
                                Smeltie @mitu
                                last edited by

                                @mitu have tried.
                                To anyone still looking i tried a tool called "Skraper"
                                And it works phenominally.
                                it can really do it all, from combined art, to video's to 2d boxart it does it all.
                                i highly reccomend everyone try it.
                                i found it to work best when running on a windows computer with the configs and roms folders shared and added as drives under windows 10.

                                1 Reply Last reply Reply Quote 1
                                • N
                                  naddel81
                                  last edited by naddel81

                                  but skraper can't do it manually for missing games. :(

                                  1 Reply Last reply Reply Quote 0
                                  • N
                                    naddel81 @mitu
                                    last edited by

                                    @mitu said in Scraping no longer working due to old api:

                                    @BuZz I have something working with screenscraper.fr. Their API is a bit similar to the TheGamesDB's API, so it's simple to re-use the existing code and add a new scraper. It just needs more testing and I can submit a PR for review.

                                    that would be awesome!

                                    1 Reply Last reply Reply Quote 0
                                    • BuZzB
                                      BuZz administrators @mitu
                                      last edited by

                                      @mitu sounds great thanks. I think recalbox includes support for screenscraper.fr in their ES fork - might be useful for reference.

                                      To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                                      1 Reply Last reply Reply Quote 1
                                      • F
                                        Failrunner
                                        last edited by

                                        Sweet it will be harder to use now. I haven't cursed at this os enough. I need to blow my voice screaming! 🤒

                                        N 1 Reply Last reply Reply Quote 0
                                        • N
                                          naddel81 @Failrunner
                                          last edited by

                                          @Failrunner it will soon work again and maybe better than before with gamesDB.

                                          1 Reply Last reply Reply Quote 0
                                          • N
                                            Nikorasu081 Banned
                                            last edited by Nikorasu081

                                            Can someone please make instructions on how to get the internal scraper "THEGAMEDB" working again? I have one game I need to scrape and I tried Skyscraper and Steven Selph's Scraper and it just didn't work out for me. I kept getting a bash error in the terminal with Skyscaper. With Steven Selph's Scraper I kept getting "It appears that thegamesdb.net isn't up. If your are sure it is use -skip_check to bypass this error. No sources available

                                            O 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.