RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Versatile C++ game scraper: Skyscraper

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscrapergamelist.xmlscrapinggithub
    1.6k Posts 113 Posters 1.6m Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • muldjordM
      muldjord
      last edited by

      Skyscraper 3.3.6 released: https://github.com/muldjord/skyscraper

      • Skipped file now includes platform in the filename (Thanks to 'parker-hemphill' for suggesting this)
      • Now handles the '****' error message from ScreenScraper (Thank you to 'GiulioCentorame' for reporting this)
      • Updated 'thegamesdb' to include the 'v1' prefix (Thank you to 'Clyde' for letting me know)

      This release fixes the 'thegamesdb' module, but be aware that their database is currently running on an old backup due to the December server shutdown. Thank you to @Clyde for letting me know about the 'v1' prefix. In other words: Updating to this release will make 'thegamesdb' work with Skyscraper again, but with old data. They are planning to get back to a more recent version soon, but it will still require the v1 prefix as I understand it, so it will work regardless.

      S 1 Reply Last reply Reply Quote 1
      • S
        steptoe @muldjord
        last edited by

        @muldjord said in Versatile C++ game scraper: Skyscraper:

        Skyscraper 3.3.6 released: https://github.com/muldjord/skyscraper

        • Skipped file now includes platform in the filename (Thanks to 'parker-hemphill' for suggesting this)
        • Now handles the '****' error message from ScreenScraper (Thank you to 'GiulioCentorame' for reporting this)
        • Updated 'thegamesdb' to include the 'v1' prefix (Thank you to 'Clyde' for letting me know)

        This release fixes the 'thegamesdb' module, but be aware that their database is currently running on an old backup due to the December server shutdown. Thank you to @Clyde for letting me know about the 'v1' prefix. In other words: Updating to this release will make 'thegamesdb' work with Skyscraper again, but with old data. They are planning to get back to a more recent version soon, but it will still require the v1 prefix as I understand it, so it will work regardless.

        Your unofficial Windows version is on 3.30. I'm trying to compile the latest versions but not 100% what I need to compile. You give basic compile instructions for OSX and Linux but not Windows so can't really try SkyScraper fully on the PC. Thanks

        muldjordM 1 Reply Last reply Reply Quote 0
        • muldjordM
          muldjord @steptoe
          last edited by muldjord

          @steptoe It's not unofficial, it's just not officially supported (I don't use Windows). I know it's old, for that very reason. If I get the time today, I will create a 3.3.7 version of the Windows version.

          EDIT: Windows version now updated to 3.3.7. Get it here

          S 1 Reply Last reply Reply Quote 0
          • o0alucard0oO
            o0alucard0o @muldjord
            last edited by

            @muldjord

            Thanks so much for this fantastic scraper ;-)

            I'm trying to scrape igdb, but with no results

            For example

            Skyscraper -p steam -i /Volumes/Games/Roms/Steam -g "/Volumes/Games/Attract-Mode/romlists_b" -o "/Volumes/Games/Attract-Mode/scraper/Steam_b" -f attractmode -e "/Users/matteo/Games/skyscript-nuc-one/Steam.cfg" --addext "*.bat" --nosubdirs --nobrackets --unattendskip -s igdb -u IGDBKEY --pretend --verbosity 3
            

            --- The following is a list of skipped games ---
            'Cuphead', No returned matches
            'GRIS', No returned matches
            'Hollow Knight', No returned matches
            'Monster Boy And The Cursed Kingdom', No returned matches
            'My Friend Pedro', No returned matches
            'Neon Chrome', No returned matches
            'Nex Machina', No returned matches
            'Ori and the Blind Forest Definitive Edition', No returned matches
            'PinballArcade', No returned matches
            'TrackMania Nations Forever', No returned matches

            I'm able to find game through web interface

            (sorry for my english)

            muldjordM 1 Reply Last reply Reply Quote 0
            • muldjordM
              muldjord @o0alucard0o
              last edited by muldjord

              @o0alucard0o I just tried with "My Friend Is Pedro" and indeed something seems to be wrong... I'll look into it, stay tuned.

              o0alucard0oO 1 Reply Last reply Reply Quote 0
              • o0alucard0oO
                o0alucard0o @muldjord
                last edited by

                @muldjord Unfortunately I get the same result with "pc".

                muldjordM 1 Reply Last reply Reply Quote 0
                • muldjordM
                  muldjord @o0alucard0o
                  last edited by muldjord

                  @o0alucard0o I've found the error, I'll release 3.3.8 with this fixed in a minute.

                  EDIT: 3.3.8 now released, please update and try again.

                  o0alucard0oO 1 Reply Last reply Reply Quote 1
                  • o0alucard0oO
                    o0alucard0o @muldjord
                    last edited by

                    @muldjord now works! thank you :-)

                    muldjordM 1 Reply Last reply Reply Quote 1
                    • muldjordM
                      muldjord @o0alucard0o
                      last edited by

                      @o0alucard0o And thank you for reporting it! :)

                      1 Reply Last reply Reply Quote 0
                      • S
                        steptoe @muldjord
                        last edited by steptoe

                        @muldjord said in Versatile C++ game scraper: Skyscraper:

                        @steptoe It's not unofficial, it's just not officially supported (I don't use Windows). I know it's old, for that very reason. If I get the time today, I will create a 3.3.7 version of the Windows version.

                        EDIT: Windows version now updated to 3.3.7. Get it here

                        Any chance of explaining briefly how you compiled it, if you don't use windows, that way you don't have to compile a version for us windows users for every release. Now you are on 3.3.8 already

                        Thanks for the quick response and 'unofficial' windows version

                        muldjordM 1 Reply Last reply Reply Quote 0
                        • muldjordM
                          muldjord @steptoe
                          last edited by muldjord

                          @steptoe It's way too much to cover I'm afraid. On Linux and macOS it's quite simple due to their relatively standardized nature. Not so much for Windows. I will try to update it semi-regularly though. 3.3.8 is on there now.

                          S 1 Reply Last reply Reply Quote 0
                          • J
                            jrbbib
                            last edited by jrbbib

                            i have a question as to the location of all the stored files. would it be possible to be able to move it to where the roms ,bios, and themes folders are? when i connect to pi with windows pc this folder is what i can access. so when i make a backup it would be right there with the main files and would make transfer easier.

                            mituM muldjordM 2 Replies Last reply Reply Quote 0
                            • mituM
                              mitu Global Moderator @jrbbib
                              last edited by

                              @jrbbib The cache should be in the \\retropie\configs\all\skyscraper folder, which is accessible via file shares if you want to make a backup from your PC.

                              J 1 Reply Last reply Reply Quote 0
                              • J
                                jrbbib @mitu
                                last edited by

                                @mitu ok thank you! i kept getting lost with the tree list. when i use file browser i put in IP of pie, there are only a few dir i can see(bios, configs, roms, and splashscreens). i missed the config when i saw where they said files go in this discussion. thank you again

                                1 Reply Last reply Reply Quote 0
                                • muldjordM
                                  muldjord @jrbbib
                                  last edited by

                                  @jrbbib What stored files are you referring to? The Skyscraper resource cache or the exported media? Both can be changed in the Skyscraper configuration. Please check the documentation on that here. Look for the cacheFolder option and the mediaFolder option.

                                  1 Reply Last reply Reply Quote 0
                                  • S
                                    steptoe @muldjord
                                    last edited by

                                    @muldjord Thanks for the extra efforts for us windows users

                                    1 Reply Last reply Reply Quote 1
                                    • quicksilverQ
                                      quicksilver
                                      last edited by

                                      Is it possible to adjust settings in the artwork.xml for certain systems only? For example if I wanted only screenshots displayed, but just for arcade?

                                      I searched the documentation but either couldn't find anything or missed it.

                                      muldjordM 1 Reply Last reply Reply Quote 0
                                      • muldjordM
                                        muldjord @quicksilver
                                        last edited by muldjord

                                        @quicksilver Yes, just create individual artwork.xml files for the platforms and enter them into the config.ini's platform sections. For instance like so:

                                        [amiga]
                                        artworkXml="artwork-amiga.xml"
                                        

                                        You can also do it similarly for different frontends like so:

                                        [pegasus]
                                        artworkXml="artwork-pegasus.xml"
                                        

                                        It's documented here

                                        quicksilverQ 2 Replies Last reply Reply Quote 1
                                        • quicksilverQ
                                          quicksilver @muldjord
                                          last edited by

                                          @muldjord thank you so much, knew it had to be there somewhere. Skyscraper can do it all!

                                          1 Reply Last reply Reply Quote 1
                                          • quicksilverQ
                                            quicksilver @muldjord
                                            last edited by quicksilver

                                            @muldjord Sorry to bug you again, but what I am trying to accomplish is to have the marquees show up in a specific area in the theme I am using but not composited with the rest of the artwork. I can get the marquees to show up in the theme but it also shows up in the composite image too. How can get the marquee to show up in the correct place in the theme but not also display in the artwork composite?

                                            EDIT: I figured it out. I added <output type="marquee" resource="marquee"/> to the .xml

                                            sorry for pinging you!

                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.