• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login

Versatile C++ game scraper: Skyscraper

Scheduled Pinned Locked Moved Ideas and Development
skyscraperscrapergamelist.xmlscrapinggithub
1.6k Posts 113 Posters 1.6m Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • P
    peligwe @muldjord
    last edited by 18 Jun 2020, 19:15

    @muldjord So the problem not my height but the width.. How much width is there available?

    M 1 Reply Last reply 18 Jun 2020, 20:08 Reply Quote 0
    • M
      muldjord @peligwe
      last edited by muldjord 18 Jun 2020, 20:08

      @peligwe As much as you want (depending on ram of course) :)

      1 Reply Last reply Reply Quote 0
      • S
        stevas
        last edited by 3 Jul 2020, 01:57

        @muldjord
        I'm trying to get skyscraper to import already existing media, and it just gets right through it and says it's skipped them all?
        It's megadrive, I've set up the symbolic link, the media is in:
        /Import/videos/megadrive
        /Import/screenshots/megadrive
        And I'm using:
        Skyscraper -p megadrive -s import --flags video

        Have I missed something in the ini file or...?

        M M 2 Replies Last reply 3 Jul 2020, 02:46 Reply Quote 0
        • M
          mitu Global Moderator @stevas
          last edited by 3 Jul 2020, 02:46

          @stevas said in Versatile C++ game scraper: Skyscraper:

          Have I missed something in the ini file or...?

          Post your .ini file (or the relevant config related to the import module).

          1 Reply Last reply Reply Quote 0
          • S
            stevas
            last edited by 3 Jul 2020, 14:57

            Do you mean config.ini? I'm not aware of anything specific to import, but I've actually commented literally everything out of config.ini except for my screensaver login (which, incidentally, also doesn't work - and I know it's valid, as it works in Skraper).

            1 Reply Last reply Reply Quote 0
            • S
              stevas
              last edited by 3 Jul 2020, 15:12

              Erm... Okay.

              I thought I was meant to be able to use subdirs with import?

              It works as long as I have them in:
              /Import/videos
              /Import/screenshots

              1 Reply Last reply Reply Quote 0
              • M
                muldjord @stevas
                last edited by muldjord 7 Apr 2020, 15:36 4 Jul 2020, 14:34

                @stevas You have them backwards. It should be:

                /home/USER/.skyscraper/import/megadrive/videos
                /home/USER/.skyscraper/import/megadrive/screenshots
                

                That's why :)

                And concerning your ScreenScraper login, it has to look exactly like this:

                [screenscraper]
                userCreds="USER:PASS"
                

                If you type it in correctly with a : between the username and password, it will work. :)

                S 1 Reply Last reply 5 Jul 2020, 22:55 Reply Quote 2
                • P
                  peligwe
                  last edited by 5 Jul 2020, 14:32

                  Trying to scrape Philip's CD-l. Would I need to under mame?

                  M 1 Reply Last reply 5 Jul 2020, 17:09 Reply Quote 0
                  • M
                    muldjord @peligwe
                    last edited by 5 Jul 2020, 17:09

                    @peligwe I'm not too knowledgable about that platform. But it seems to be lr-mess, which uses the mame naming convention I think. So maybe. :)

                    S 1 Reply Last reply 5 Jul 2020, 23:37 Reply Quote 0
                    • S
                      stevas @muldjord
                      last edited by 5 Jul 2020, 22:55

                      @muldjord

                      Gaaaaaaaaaaaah! Thanks, I did see what I'd done wrong once I dug into the config.ini!

                      As for the password, I do have the : in there, yeah. But it still seemed to be giving me messages at the start about it being an anonymous account. Lemme try it again this week sometime...

                      1 Reply Last reply Reply Quote 0
                      • S
                        stevas @muldjord
                        last edited by 5 Jul 2020, 23:37

                        @muldjord

                        Actually, I will do that now.

                        So, it looks like I had:
                        UserCreds="me:pass"

                        Which is really easy to miss (for me anyway), i.e. I had the first letter capitalised. Doh again.

                        Seems to be working as I have more than the 10000 limit now...

                        Much obliged, outstanding work!

                        1 Reply Last reply Reply Quote 1
                        • P
                          peligwe
                          last edited by 18 Jul 2020, 18:53

                          I think this question may have been asked before but, is there a way to make skyscraper use the downloaded screenshot in place of the video snap when creating a gamelist?

                          M 1 Reply Last reply 19 Jul 2020, 12:34 Reply Quote 0
                          • M
                            mitu Global Moderator @peligwe
                            last edited by 19 Jul 2020, 12:34

                            @peligwe Just disable videos when generating the gamelist and videos will not be added to it.

                            1 Reply Last reply Reply Quote 1
                            • M
                              muldjord
                              last edited by 29 Jul 2020, 20:29

                              Hi guys, I'm just about ready to release Skyscraper 3.5.6 with the promised Pegasus game list parser. Currently awaiting some testing by users.

                              Another user requested --flags onlymissing to be added to the RetroPie Skyscraper script. @mitu I've added it in my fork. Let me know if you want me to PR it. I've tested it and it works without issue. Basically just added the option to the gather options menu.

                              M 1 Reply Last reply 29 Jul 2020, 20:36 Reply Quote 2
                              • M
                                mitu Global Moderator @muldjord
                                last edited by 29 Jul 2020, 20:36

                                @muldjord said in Versatile C++ game scraper: Skyscraper:

                                @mitu I've added it in my fork. Let me know if you want me to PR it

                                Nice, that's a good addition. You can send a PR if it's not too much trouble - I'll give it a test and maybe add the info to the wiki.

                                M 1 Reply Last reply 29 Jul 2020, 20:39 Reply Quote 1
                                • M
                                  muldjord @mitu
                                  last edited by 29 Jul 2020, 20:39

                                  @mitu No problem at all. I've created a PR for it.

                                  1 Reply Last reply Reply Quote 1
                                  • M
                                    muldjord
                                    last edited by 30 Jul 2020, 20:39

                                    Skyscraper 3.5.6 released: https://github.com/muldjord/skyscraper

                                    • Added 'neogeocd' platform (Thank you to 'igno2k' and 'meveric' for suggesting it)
                                    • 'screenscraper' module now supports region for screenshots (Thank you to 'cameronhimself' for pointing this out)
                                    • Low disk space check for cache is now calculated from cache folder location
                                    • Skyscraper initial output now shows frontend and extras when generating game lists
                                    • Changed 'gamelistFolder' config.ini option to 'gameListFolder' but kept old variable name for backwards compatibility
                                    • Added 'gameListBackup' config.ini option to allow for game list backups being created on each run (Thank you to 'igno2k' for suggesting it)
                                    • Attract-Mode now recognizes '$HOME' in emulator file
                                    • Refactored Attract-Mode media folder getters
                                    • Fixed rare faulty matches from 'esgamelist' module in cases where last part of 'path' was a match with filename (Thank you to 'akamming' for reporting this)
                                    • Exporting for Pegasus frontend now supports preservation of old game list key-value pairs (Thank you to user 'HugLifeTiZ' for suggesting this)
                                    • '--cache report' now also adheres so excludeFiles and includeFiles (Thank you to user 'spilinek' for pointing this out)

                                    Skyscraper 3.5.6 is finally here! It contains the promised Pegasus metadata preservation parser. Basically it means that if you add custom fields to your metadata.pegasus.txt files in either the header or game entries, they will be preserved when regenerating the gamelist using Skyscraper.

                                    A lot of other stuff has made it into the release. Some minor fixes to a bunch of stuff, and a new config.ini option that enables game list backup. Set gameListBackup="true" in the [main] or a [FRONTEND] section and instead of overwriting the game lists, it will add a timestamp to the current one before exporting the new one.

                                    I've tested it of course, but please let me know if you run into issues with the new additions / changes.

                                    Happy scraping!

                                    1 Reply Last reply Reply Quote 2
                                    • M
                                      muldjord
                                      last edited by muldjord 31 Jul 2020, 10:48

                                      Just added a frontend overview, better explaining how frontend game list generation works in Skyscraper. Check it out here!.

                                      S 1 Reply Last reply 1 Aug 2020, 07:54 Reply Quote 0
                                      • ClydeC
                                        Clyde
                                        last edited by 31 Jul 2020, 11:03

                                        A great update with many useful additions! My personal favorites are the neogeocd support and the game list backup option.

                                        That said, what is the difference of the latter's location in [main] or [FRONTEND]?

                                        M 1 Reply Last reply 31 Jul 2020, 19:43 Reply Quote 1
                                        • M
                                          muldjord @Clyde
                                          last edited by muldjord 31 Jul 2020, 19:43

                                          @Clyde It's simply a matter of when it's used (this is true for many options by the way, it's all described here). You might only want game list backup to be enabled for certain frontends. In that case you can add the option under the desired frontend section like so:

                                          [pegasus]
                                          gameListBackup="true"
                                          

                                          But if you prefer Skyscraper to create a backup no matter what frontend you are currently generating game lists for, you simply add it to the main section instead like so:

                                          [main]
                                          gameListBackup="true"
                                          
                                          1 Reply Last reply Reply Quote 1
                                          • First post
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received