• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login

Versatile C++ game scraper: Skyscraper

Scheduled Pinned Locked Moved Ideas and Development
skyscraperscrapergamelist.xmlscrapinggithub
1.6k Posts 113 Posters 1.6m Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • D
    dylosaur @muldjord
    last edited by dylosaur 21 Dec 2017, 18:44

    @muldjord Thanks man. One more question: I want to just scrape screenshots with no drop shadow added. Am I correct in saying that if my config file just says the following, then I'll just get a centered, 500 x 375 screenshot? Not really sure what the X/Y tags are for, is that for position? Just want to make sure it's centered in the box.

    [artwork]
    screenshotEnabled="true"
    screenshotWidth="500"
    screenshotHeight="375"
    screenshotX="47"
    screenshotY="0"
    

    EDIT: Just scanned through this thread and saw your response to somebody else regarding this. Having some trouble getting the import system to work. If I just do screenshots, it seems to work just fine, but when I add textual data on top of that, it no longer works for either the screenshot or the text data. Any solutions here?

    1 Reply Last reply Reply Quote 0
    • D
      dylosaur
      last edited by dylosaur 22 Dec 2017, 19:06

      @muldjord Here's what my text file looks like for MegaMania - A Space Nightmare:

      <game>
      <description>Megamania is an arcade action game with gameplay similar to Space Invaders. You control a spaceship at the bottom of the screen and need to defend yourself from numerous waves of attackers. But in Megamania, the attackers much more bizarre than invading aliens. There are hamburgers, diamonds, steam irons, bow ties, space dice, and more! You need to earn points by destroying as many of these strange attackers as you can before your energy supply becomes depleted.</description>
      <developer>Activision</developer>
      <publisher>Activision</publisher>
      <players>1-2</players>
      <genre>Action</genre>
      <releasedate>1982</releasedate>
      </game>
      

      And the definitions file:

      <game>
        <description>###DESCRIPTION###</description>
        <developer>###DEVELOPER###</developer>
        <publisher>###PUBLISHER###</publisher>
        <players>###PLAYERS###</players>
        <rating>###RATING###</rating>
        <genre>###TAGS###</genre>
        <releasedate>###RELEASEDATE###</releasedate>
      </game>
      

      Actually, I just did some tinkering around, and it seems it can't do pictures and text at the same time. Once I separated them it started working. Just wanted to point that out to you.

      M 1 Reply Last reply 23 Dec 2017, 00:13 Reply Quote 1
      • M
        muldjord @dylosaur
        last edited by 23 Dec 2017, 00:13

        @dylosaur That is actually a bug, and I think I've found the culprit. I'll try and fix it in a quick release as soon as I get the time. Thank you for notifying me about this.

        D 1 Reply Last reply 23 Dec 2017, 01:01 Reply Quote 1
        • M
          muldjord
          last edited by muldjord 23 Dec 2017, 00:58

          Skyscraper 2.0.5c released. Last Skyscraper release of 2017. Just a quick bugfix release: https://github.com/muldjord/skyscraper

          • Fixed a bug where the import module wouldn't look for all resource types during the same run. Thank you to 'dylosaur' for notifying me about this.

          Merry christmas everyone, and happy new year!

          1 Reply Last reply Reply Quote 2
          • D
            dylosaur @muldjord
            last edited by 23 Dec 2017, 01:01

            @muldjord No problem ! I love your scraper. Wish I could use it with some of the unsupported systems because it makes changing the sizes of my screenshots a breeze. Keep it up.

            M 1 Reply Last reply 23 Dec 2017, 01:03 Reply Quote 0
            • M
              muldjord @dylosaur
              last edited by 23 Dec 2017, 01:03

              @dylosaur Let me know which ones you'd like me to include. Adding more systems is quite easy in Skyscraper, as long as the sources I currently support also support the platforms.

              D 1 Reply Last reply 23 Dec 2017, 01:08 Reply Quote 0
              • D
                dylosaur @muldjord
                last edited by dylosaur 23 Dec 2017, 01:08

                @muldjord Oh, cool. That would be great. I'm working on it for a gift.

                Right now, the ones I'm looking to add that you don't support are:

                • Atari Lynx
                • GCE Vextrex
                • NeoGeo Pocket Color
                • Sega 32x

                Was also looking to add, but might not get to (because of time):

                • Virtual Boy
                • Magnavox-Odyssey2
                • TurboGrafx16

                How do I update the scraper, by the way? Just follow the install steps again?

                M 1 Reply Last reply 23 Dec 2017, 02:03 Reply Quote 1
                • M
                  muldjord
                  last edited by 23 Dec 2017, 02:02

                  Skyscraper 2.0.6 released!

                  Ok, so THIS is the last Skyscraper release of 2017 (except bug fixes if something major pops up). Added a bunch of platforms: https://github.com/muldjord/skyscraper

                  • Added support for atarilynx, vectrex, ngpc (Neo Geo Pocket Color), sega32x, virtualboy and videopac platforms.

                  Merry christmas everyone, and happy new year!

                  1 Reply Last reply Reply Quote 3
                  • M
                    muldjord @dylosaur
                    last edited by muldjord 23 Dec 2017, 02:03

                    @dylosaur I've added the platforms you've requested. Pc-Engine was already in there. Let me know if any of them don't work. I haven't tested them, just implemented them.

                    Yes, to get the newest release, just follow the steps again, that's the easiest way to do it. :)

                    D 1 Reply Last reply 23 Dec 2017, 03:05 Reply Quote 0
                    • D
                      dylosaur @muldjord
                      last edited by 23 Dec 2017, 03:05

                      @muldjord I just did the Lynx, Vectrex, NGPC, and Sega32x and can confirm they all work perfectly. This will make finishing this gift so much easier. I'll try the others tomorrow and let you know. Thanks so much!

                      1 Reply Last reply Reply Quote 0
                      • M
                        muldjord
                        last edited by 23 Dec 2017, 10:29

                        Just started working on the new 'scripting' mode ('scripter' branch on github). This will be easier to implement than I initially thought. Might even be out before new year! We'll see. :)

                        Anyways, I am off for the holidays, have fun everyone!

                        R 1 Reply Last reply 23 Dec 2017, 11:26 Reply Quote 0
                        • R
                          Rion @muldjord
                          last edited by 23 Dec 2017, 11:26

                          @muldjord God Jul/Glædelig Jul/ Merry Christmas

                          FBNeo rom filtering
                          Mame2003 Arcade Bezels
                          Fba Arcade Bezels
                          Fba NeoGeo Bezels

                          M 1 Reply Last reply 25 Dec 2017, 17:32 Reply Quote 3
                          • M
                            muldjord @Rion
                            last edited by 25 Dec 2017, 17:32

                            @rion Lige over / right back at ya'!

                            A 1 Reply Last reply 25 Dec 2017, 19:50 Reply Quote 0
                            • A
                              AnalogHero @muldjord
                              last edited by 25 Dec 2017, 19:50

                              @muldjord Tried the new version with Atari7800 and it worked fine! Thanks again for this tool and Merry Christmas to all reading :)

                              M 1 Reply Last reply 25 Dec 2017, 20:30 Reply Quote 1
                              • M
                                muldjord @AnalogHero
                                last edited by muldjord 25 Dec 2017, 20:30

                                @analoghero Thank you, glad it works!

                                1 Reply Last reply Reply Quote 0
                                • M
                                  muldjord
                                  last edited by 26 Dec 2017, 13:32

                                  Skyscraper 2.1.0 released! https://github.com/muldjord/skyscraper

                                  • Added 'simple mode'
                                  • Refactored and cleaned up all emulation platform specific code

                                  'Simple mode' works by simply typing 'Skyscraper' after you've installed it. It will ask you a bunch of questions. Based on your answers it will generate a script and run it (if you allow it). When the script is done, you will have the optimal result for the chosen platform. This should help a lot of the newcomers to get the best results from the get-go. It basically does multiple scraping runs using the supported scraping modules for the selected platform, and finishes the job by scraping with 'localdb' to bind it all together.

                                  Please try it out and let me know if you have any feedback or discover bugs. I've tested it a bit myself, but I've refactored a lot of code, so bugs can have snuck in through the process.

                                  Happy scraping! And happy new year everyone!

                                  1 Reply Last reply Reply Quote 3
                                  • A
                                    AnalogHero
                                    last edited by 27 Dec 2017, 06:19

                                    @muldjord Was about to test simple mode with the beta but then 2.1.0 was released and i updated to it.
                                    It worked fine for me with sega32x. It did 2 web runs and the a localdb run.

                                    1 Reply Last reply Reply Quote 1
                                    • M
                                      muldjord
                                      last edited by muldjord 27 Dec 2017, 15:21

                                      Skyscraper 2.1.1 released: https://github.com/muldjord/skyscraper

                                      • Added support for '3do', 'amstradcpc', 'coco', 'daphne', 'dragon32', 'dreamcast', 'fds', 'gameandwatch', 'intellivision', 'ngp', 'oric', 'pc88', 'pcfx', 'saturn', 'sg-1000', 'trs-80' and 'zmachine' platforms
                                      • Added 'forcefilename' option which forces the file name to be used in the frontend instead of the one returned by the scraping module
                                      • Changed 'gamelist.xml' to 'game list' in 'simple mode' question

                                      Be sure to also check the notes for 2.1.0 if you haven't already (there's some cool new stuff in that one). Happy scraping!

                                      S 1 Reply Last reply 28 Dec 2017, 11:25 Reply Quote 2
                                      • S
                                        SammyBoy @muldjord
                                        last edited by 28 Dec 2017, 11:25

                                        @muldjord Are you planning to add Fb Alpha as well allow ROM Hacks to be scraped in the future. Because I've got a lot of FB Alpha ROMS and one final question are the thumbnails/artworks that are scraped good quality because I know Steven Selph Scraper isn't in good quality. Sorry for the long message.

                                        R M 2 Replies Last reply 28 Dec 2017, 11:37 Reply Quote 0
                                        • R
                                          Rion @SammyBoy
                                          last edited by 28 Dec 2017, 11:37

                                          @sammyboy I think you can already scrape fba roms using the Arcade parameter because it's already incorporated by using adb.arcadeitalia.net?

                                          FBNeo rom filtering
                                          Mame2003 Arcade Bezels
                                          Fba Arcade Bezels
                                          Fba NeoGeo Bezels

                                          1 Reply Last reply Reply Quote 1
                                          278 out of 1594
                                          • First post
                                            278/1594
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received