RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Versatile C++ game scraper: Skyscraper

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscrapergamelist.xmlscrapinggithub
    1.6k Posts 113 Posters 1.7m Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • muldjordM
      muldjord @BladeHunter
      last edited by

      @BladeHunter I prefer just to have it on here, so I can check it when I have the time. I have a million projects going on at the same time, and having private messages popup between them sortof muddles my workflow. :D Unfortunately I don't see any private messaging functionality on these forums.

      BladeHunterB 1 Reply Last reply Reply Quote 0
      • BladeHunterB
        BladeHunter @muldjord
        last edited by BladeHunter

        @muldjord yeah I'm surprised there is no pm function. I really don't want to post my comment on here (you will understand why when I talk to you) can you drop me a line at please? I don't need anything from you but I have a comment which will help you :) if you want me to post my comment here I will but I'm not overly comfortable with it.

        muldjordM Used2BeRXU 2 Replies Last reply Reply Quote 0
        • muldjordM
          muldjord @BladeHunter
          last edited by muldjord

          @bladehunter said in Versatile C++ game scraper: Skyscraper:

          ****@gmail.com

          I've "PM'ed" you.

          1 Reply Last reply Reply Quote 0
          • Used2BeRXU
            Used2BeRX @BladeHunter
            last edited by

            @bladehunter said in Versatile C++ game scraper: Skyscraper:

            ...can you drop me a line at ****@.com please?

            Man... take that down lol. 8 hours of bots just got your email. I hope it was a junk account.

            I second the motion to have a PM feature on this board. That would be pretty sweet. I thought there might have been one but I just hadn't figured out how to use it yet. :)

            herb_fargusH BladeHunterB 2 Replies Last reply Reply Quote 0
            • herb_fargusH
              herb_fargus administrators @Used2BeRX
              last edited by

              @used2berx there will never be a PM feature on this forum. All it would end up being is people sharing romsites.

              If you read the documentation it will answer 99% of your questions: https://retropie.org.uk/docs/

              Also if you want a solution to your problems read this first: https://retropie.org.uk/forum/topic/3/read-this-first

              Used2BeRXU 1 Reply Last reply Reply Quote 3
              • Used2BeRXU
                Used2BeRX @herb_fargus
                last edited by

                @herb_fargus Yeah. You're probably right. ;)

                Kind of sucks that it's hard to collaborate with people you meet here on things without putting your email address up for the world to see though.

                Too bad there isn't an in-between solution. Unless there is? Do you have any suggestions on that?

                1 Reply Last reply Reply Quote 0
                • herb_fargusH
                  herb_fargus administrators
                  last edited by

                  @used2berx collaboration on code is best done on github imo

                  If you read the documentation it will answer 99% of your questions: https://retropie.org.uk/docs/

                  Also if you want a solution to your problems read this first: https://retropie.org.uk/forum/topic/3/read-this-first

                  Used2BeRXU 1 Reply Last reply Reply Quote 1
                  • Used2BeRXU
                    Used2BeRX @herb_fargus
                    last edited by

                    @herb_fargus Cool. I have an account there but haven't looked into it much. Thanks.

                    1 Reply Last reply Reply Quote 0
                    • BladeHunterB
                      BladeHunter @Used2BeRX
                      last edited by

                      @used2berx said in Versatile C++ game scraper: Skyscraper:

                      @bladehunter said in Versatile C++ game scraper: Skyscraper:

                      ...can you drop me a line at ****@.com please?

                      Man... take that down lol. 8 hours of bots just got your email. I hope it was a junk account.

                      I second the motion to have a PM feature on this board. That would be pretty sweet. I thought there might have been one but I just hadn't figured out how to use it yet. :)

                      Hehehe it's my junk account :). I have taken mine out but it's still quoted in muldjords post, it's not a big issue for me :).

                      muldjordM 1 Reply Last reply Reply Quote 0
                      • muldjordM
                        muldjord @BladeHunter
                        last edited by

                        @BladeHunter Censored :)

                        1 Reply Last reply Reply Quote 0
                        • H
                          hi-ban
                          last edited by hi-ban

                          @muldjord is there any option to scrape the box art image without adding any effect?

                          I mean, without any drop shadows or effects. Without creating any kind of composition of box+screenshot. Just the raw image as it comes from the source.

                          muldjordM 1 Reply Last reply Reply Quote 0
                          • P
                            Panther7
                            last edited by

                            If you need any legal help (based on prior posts), feel free to PM me. I am a lawyer and would be willing to help you out.

                            1 Reply Last reply Reply Quote 0
                            • muldjordM
                              muldjord @hi-ban
                              last edited by

                              @hi-ban Yes, please read the readme at github, it's all in there.

                              @Panther7, Thank you, appeciate the sentiment. No need though, and there's no need for further elaboration on that point. I was simply asked to take out support for certain web sources and I complied promptly.

                              The new version 2.0.0 only has support for modules I have acquired permission to use.

                              At the end of the day, we're all here to support retro gaming. Some do it by creating game databases, some do it by creating emulator capable distributions and frontends. And some of us write tools to ease the flow and usage of game information to make it all a little bit more enjoyable.

                              Skyscraper is free and open source and was developed in my spare time to help fellow retro'ers. This still holds true for the new version.

                              H 1 Reply Last reply Reply Quote 1
                              • H
                                hi-ban @muldjord
                                last edited by hi-ban

                                @muldjord i already read the readme. It just shows how to load a config ini files, but it does not explain what the parameters from the config ini files exactly do.
                                Also, there is no config or parameter for "dont-modify-image-at-all".
                                And if you dont load any config at all, then the scraper applies the "small boxart and big screenshot" parameters as default.
                                I cannot seem to find any way to make the scraper just take the raw image file without autto-editing it or processing it at all.

                                By the way, the screenscraper.fr scraper is grabbing the wrong boxart images. Instead of grabbing the "Case: front" images, it's grabbing the "Case: texture" images instead.

                                muldjordM 1 Reply Last reply Reply Quote 0
                                • P
                                  Panther7
                                  last edited by

                                  Had a chance to toy with it. Seems really powerful, but it could REALLY use some sort of interface. It would do it wonders for usability.

                                  muldjordM 1 Reply Last reply Reply Quote 0
                                  • muldjordM
                                    muldjord @hi-ban
                                    last edited by

                                    @hi-ban The screenscraper has been fixed in the version I am working on. The boxart image will always be modified in some way to resize it to fit EmulationStation or whatever frontend you are using. But you can set the size of it using the ini parameters, just do like this:
                                    finalImageWidth="281"
                                    finalImageHeight="375"
                                    coverWidth="281"
                                    coverHeight="375"
                                    coverX="0"
                                    coverY="0"
                                    coverShadowEnabled="false"
                                    screenshotEnabled="false"

                                    Set the widths and heights to whatever you want the cover size to be. There's no way of telling Skyscraper to not manipulate it somehow. But by using the above config, you can sortof trick it into doing so.

                                    1 Reply Last reply Reply Quote 0
                                    • muldjordM
                                      muldjord @Panther7
                                      last edited by

                                      @Panther7 I completely agree. I'd like to create a gui for it, but it won't be anytime soon.

                                      1 Reply Last reply Reply Quote 0
                                      • H
                                        hi-ban
                                        last edited by

                                        @muldjord thanks for the tips.

                                        It would be great if your scraper had the option to choose from different "possible" matches when the scraper is unable to find the correct match for the rom name, much like the default scraper from emulationstation does.

                                        1 Reply Last reply Reply Quote 0
                                        • muldjordM
                                          muldjord @incunabula
                                          last edited by

                                          This post is deleted!
                                          1 Reply Last reply Reply Quote 0
                                          • muldjordM
                                            muldjord
                                            last edited by

                                            Skyscraper 2.0.1 released: https://github.com/muldjord/skyscraper

                                            • Slightly changed help text for scraping modules
                                            • 'thegamesdb' now properly uses Qt's XML parser
                                            • 'screenscraper' now properly uses Qt's XML parser
                                            • Started implementing region and lang support for 'screenscraper', but still not enabled

                                            Not the most interesting release from a user perspective. I am basically rewriting some stuff to make it work more standardized. But hey, it's still quite important work, so here it is! :D

                                            screechS 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.