RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Versatile C++ game scraper: Skyscraper

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscrapergamelist.xmlscrapinggithub
    1.6k Posts 113 Posters 1.6m Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mituM
      mitu Global Moderator @RDBowers
      last edited by

      @RDBowers You can add your own image (a cabinet instead of a box) in the artwork.xml file and have it part of the final image. Is that what you're trying to do ?

      R 1 Reply Last reply Reply Quote 0
      • R
        RDBowers @mitu
        last edited by

        @mitu That is what I am trying to do.

        My question is, can Skyscraper pull cabinet images from online sources, save them as part of the LocalDB, making them available as a resource (just like a screenshot, cover, wheel or marquee) to be referenced in the artwork.xml?

        mituM 1 Reply Last reply Reply Quote 0
        • mituM
          mitu Global Moderator @RDBowers
          last edited by

          @RDBowers I don't think it's supported right now. Can you give more details about where these images can be downloaded (site/source), maybe an example of such image associated with an arcade game ?

          R 1 Reply Last reply Reply Quote 0
          • R
            RDBowers @mitu
            last edited by

            @mitu One source already built into Skyscraper is adb.arcadeitalia.net. For most arcade ROMs they include a cabinet image. On their Pac-man page you will find a link to this image.

            Pac-man cabinet

            Another potential source of cabinet images not built into Skyscraper is arcade-museum.com.

            They are also a great source for additional information, images and flyers. The Arcade Flyer Archive

            muldjordM 1 Reply Last reply Reply Quote 0
            • HalvhjearneH
              Halvhjearne @muldjord
              last edited by

              @muldjord

              this is awsome, it was pretty scattered before and this info clarifies things a lot.
              only thing i can think of to make it any better would be to maybe add the equivalent option for config.ini to next to the command line option.

              1 Reply Last reply Reply Quote 0
              • S
                sglavach
                last edited by

                I have Skyscraper (SS) installed and running on my local machine, I have a number of SBC's (RPi, Odroid, etc..) running and connected to network as well. I can point to the Rom path on each SBC using the -i parameter and it will use the localdb on my local machine and it will scan the corresponding SBC Rom path and create the media correctly on each SBC. My challenge is with Videos since they take up a lot of space. I would rather not copy my videos (already on the SBC's) to the import directory on my local machine and then import them prior to scraping, I would like to point to a non-default import path for my videos (same way I point to a non-default Rom path with -i)... import them from there and then scrape. Is this possible? am I missing a way to accomplish this? In fact having a way to point/configure a path for any non-local import resource would be helpful. Thanks!

                muldjordM 1 Reply Last reply Reply Quote 0
                • R
                  raspy+
                  last edited by

                  @muldjord

                  Wow so much reading and I still can't find the answer to a simple question unless I missed it and fell asleep at the keyboard LOL...

                  Q: What does each color represent when Skyscraper is collecting data?

                  (green number) / (yellow number) / (blue number)

                  Green number = how many roms it checked?
                  Yellow number = how many roms it skipped?
                  Blue number = how many confirmed roms matched?

                  Just a guess on my part or did I just answer my own question?

                  Q2: If Skyscraper can't find a game while scraping, does that mean it can't find a match from "screenscraper.fr"?

                  muldjordM 1 Reply Last reply Reply Quote 0
                  • S
                    Silent
                    last edited by

                    Just a thought I had due to my invalid bug report (which I have now closed):

                    A lot of games have region tags, like (E), [U] in their filenames. Could Skyscraper optionally infer region to use when scraping a ROM from this data? This way it would try to collect data matching what you actually see in the game (example: Star Fox vs Star Wing) without the user having to tailor that manually on per-ROM basis.

                    muldjordM 1 Reply Last reply Reply Quote 0
                    • muldjordM
                      muldjord @Silent
                      last edited by

                      @Silent said in Versatile C++ game scraper: Skyscraper:

                      Just a thought I had due to my invalid bug report (which I have now closed):

                      A lot of games have region tags, like (E), [U] in their filenames. Could Skyscraper optionally infer region to use when scraping a ROM from this data? This way it would try to collect data matching what you actually see in the game (example: Star Fox vs Star Wing) without the user having to tailor that manually on per-ROM basis.

                      I already do this for (Europe) and others. I will include the ones you suggest aswell.

                      1 Reply Last reply Reply Quote 0
                      • muldjordM
                        muldjord @raspy+
                        last edited by muldjord

                        @raspy

                        Q1: found/skipped/total

                        Q2: Depends on what scraping module you are scraping with. But yes, if it's not found, that means it's not found at the source using the rom information available to Skyscraper.

                        1 Reply Last reply Reply Quote 0
                        • muldjordM
                          muldjord @sglavach
                          last edited by

                          @sglavach You can set a non-default import folder in config.ini with importFolder="[folder]"

                          1 Reply Last reply Reply Quote 0
                          • muldjordM
                            muldjord @RDBowers
                            last edited by

                            @RDBowers Skyscraper currently supports cover, screenshot, wheel and marquee resources. If you wish to use other more niche resources, I suggest using the import functionality to get them. Then you can import them as "marquee" resources for instance, and use them in the artwork.xml for the arcade platforms.

                            HalvhjearneH 1 Reply Last reply Reply Quote 0
                            • HalvhjearneH
                              Halvhjearne @muldjord
                              last edited by

                              @muldjord

                              lets say i scrape fba once with screenscraper without videos and then later decides that i actually also wanted the videos, is there a way to make it download the videos without refreshing everything?

                              and does this means it does not check already scraped games for missing info/images either?

                              muldjordM 1 Reply Last reply Reply Quote 0
                              • muldjordM
                                muldjord @Halvhjearne
                                last edited by muldjord

                                @Halvhjearne You need to refresh everything, there is no way to only refresh one resource from a source. So just enable videos and use --refresh.

                                I don't understand your second question.

                                HalvhjearneH 1 Reply Last reply Reply Quote 0
                                • HalvhjearneH
                                  Halvhjearne @muldjord
                                  last edited by

                                  @muldjord

                                  you basicly answered both.

                                  would be nice to be able to refresh only one resource like covers or videos tho tho or maby an option to refresh missing resources.

                                  muldjordM 1 Reply Last reply Reply Quote 0
                                  • muldjordM
                                    muldjord @Halvhjearne
                                    last edited by muldjord

                                    @Halvhjearne It's been requested before, but I don't really see why it would be useful (and it's quite a huge task to code). The data retrieved from the source is the same no matter how much of it Skyscraper decides to use. So it's not relevant for optimization reasons.

                                    HalvhjearneH 2 Replies Last reply Reply Quote 1
                                    • HalvhjearneH
                                      Halvhjearne @muldjord
                                      last edited by

                                      @muldjord

                                      ahh i see, i thought maybe it would put less strain on the servers.

                                      1 Reply Last reply Reply Quote 1
                                      • R
                                        raspy+
                                        last edited by

                                        Thanks for the reply to my questions muldjord!

                                        1 Reply Last reply Reply Quote 1
                                        • S
                                          Slow1 @muldjord
                                          last edited by

                                          @muldjord thanks a bunch for doing that! :D

                                          1 Reply Last reply Reply Quote 0
                                          • HalvhjearneH
                                            Halvhjearne @muldjord
                                            last edited by

                                            @muldjord

                                            i noticed that it does not scrape scummvm games correctly, perhaps course of the wierd filenames?
                                            the actual name of the game is actually listet inside the .svm files if that helps any.
                                            i also noticed the alias.csv (or whatever its called) file to change the output name, but is there a way to tell skyscraper what name it should search for instead of the filename?

                                            muldjordM 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.