RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Skyscraper now officially part of RetroPie, please test

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscraperretropie-setupoptionalexperimental
    275 Posts 28 Posters 110.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ohmycommodoreO
      ohmycommodore
      last edited by

      Thanks, was just wondering whether there's a different command for running it, vs installing it. I already have it installed from a while back. Perhaps it's the same command and that's just not stated up there.

      mituM 1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator @ohmycommodore
        last edited by

        @ohmycommodore said in Skyscraper now officially part of RetroPie, please test:

        Perhaps it's the same command and that's just not stated up there.

        "Up there" - where ?

        ohmycommodoreO 1 Reply Last reply Reply Quote 0
        • ohmycommodoreO
          ohmycommodore @mitu
          last edited by

          @mitu Ah sorry, first post, up at the top I meant.

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @ohmycommodore
            last edited by

            @ohmycommodore Did you read the Wiki page ? It's stated in there:

            If you wish to run it from the command line, for more advanced options and parameters, you can find it installed in /opt/retropie/supplementary/skyscraper/Skyscraper.

            1 Reply Last reply Reply Quote 0
            • ohmycommodoreO
              ohmycommodore
              last edited by ohmycommodore

              Of course, was just looking for clarification as I don't terminal too much, and there's a warning about mixing methods of running this thing. I also haven't used it since early on, and there were recent changes. Thanks.

              goobatroopaG mituM 2 Replies Last reply Reply Quote 0
              • goobatroopaG
                goobatroopa @ohmycommodore
                last edited by

                @ohmycommodore I ran it from the terminal after exiting ES. I know it can be installed whilst ES is running but I think you have to scrape without ES running.

                1 Reply Last reply Reply Quote 0
                • mituM
                  mitu Global Moderator @ohmycommodore
                  last edited by

                  @ohmycommodore I don't understand - you can run it through the GUI, which ultimately runs the CLI with some parameters pre-set. Each setting in the GUI has a Help option which shows which CLI parameter is used for that option. So ultimately running it through the GUI is the same think as running it from the command line - as stated, the command line has more options than what is exposed through the GUI.
                  If you're not comfortable with the CLI, then I suggest you use the GUI and give it a try.

                  1 Reply Last reply Reply Quote 0
                  • R
                    Ronoh55
                    last edited by

                    Working great for me so far. I did have a small issue where I had games in folders and it found them but refused to write a gameslist.xml. It was easily fixed for me because ES has the functionality now that made me use folders to begin with (genre filtering) and I just removed everything from folders.

                    One thing I'd like to see in the GUI though is scraping images by region. Default seems to be EU and I'd love to scrape US without going to command line.
                    Or did I miss a setting?

                    mituM 1 Reply Last reply Reply Quote 0
                    • mituM
                      mitu Global Moderator @Ronoh55
                      last edited by

                      @Ronoh55 There is no default for region set from the GUI, however you can edit the .ini file and set your preferred region there.

                      1 Reply Last reply Reply Quote 1
                      • muldjordM
                        muldjord
                        last edited by

                        @mitu An issue has been reported at the Skyscraper github which relates to the script and not Skyscraper itself. If a user has all of their files in subfolders inside a platform folder such as /home/pi/RetroPie/roms/mame-libretro/subfolder/[all files here] the script exits without scraping the subfolder. To make this work the user had to have at least one file in the /home/pi/RetroPie/roms/mame-libretro folder for the script to run Skyscraper.

                        mituM 1 Reply Last reply Reply Quote 1
                        • R
                          Ronoh55
                          last edited by

                          MobyGames is not in the gui but is on the Github as an option to scrape from. It is still an option correct? Only through CLI for now?

                          mituM 1 Reply Last reply Reply Quote 0
                          • mituM
                            mitu Global Moderator @muldjord
                            last edited by

                            @muldjord I'll take a look, looks like a script issue.

                            1 Reply Last reply Reply Quote 0
                            • mituM
                              mitu Global Moderator @Ronoh55
                              last edited by

                              @Ronoh55 Yes, it's not in the GUI, since it's not suitable for bulk scraping due to the low number of allowed scrapes (25 I think).

                              1 Reply Last reply Reply Quote 0
                              • R
                                Ronoh55
                                last edited by

                                Ah, that makes sense. Didn't know it has such a small limit

                                muldjordM 1 Reply Last reply Reply Quote 0
                                • muldjordM
                                  muldjord @Ronoh55
                                  last edited by

                                  @Ronoh55 Yes, the mobygames module is very limited and should only ever be used to scrape single roms. So that makes it unusable in the GUI. That's the reason for the removal. It can still be used on command line though and works well.

                                  1 Reply Last reply Reply Quote 1
                                  • mituM
                                    mitu Global Moderator @muldjord
                                    last edited by mitu

                                    @muldjord Here's a draft for the new UI. I removed the Localdb as a scraping source and added the new ESGamelist local source.

                                    66a6bd3a-4dfe-437b-8f06-feb272275cad-image.png

                                    There is now an explicit option to generate the gamelist(s) from the menu

                                    28a049e7-03e0-4be4-83ad-387f7c0a807b-image.png

                                    When chosen, you'll be asked to choose which systems you want to include in the gamelist generation (similar to 'Scrape chosen systems'). I'm not so sure about renaming 'Scrape' to 'Gather', and 'Download' doesn't seem appropriate (it's not only downloading artwork, it's also information retrieval). I'm open to ideas :).

                                    I think I'll re-arrange the menu, so that any configuration options are below the actions (Scrape/Scrape/Generate and then the rest of the options).

                                    muldjordM 1 Reply Last reply Reply Quote 2
                                    • S
                                      Silent
                                      last edited by

                                      Since artwork.xml and config.ini can be edited from the GUI already, how about also allowing to edit aliasMap.csv? For completeness.

                                      mituM 1 Reply Last reply Reply Quote 1
                                      • muldjordM
                                        muldjord @mitu
                                        last edited by

                                        @mitu Looks good! One note: The "Gather resources from X" should not include the name since it should be initiated from within the menu. It's not an option, just a submenu. And I think it makes sense to call it "Gather and cache resources" for instance. That's more specific and descriptive.

                                        So you'd enter that menu and choose any of the scraping modules from inside it and it would do 1 run gathering resources from that 1 module, then return to the menu. Then go back to the main menu and choose "Generate ES game list(s) from cache".

                                        mituM 1 Reply Last reply Reply Quote 0
                                        • mituM
                                          mitu Global Moderator @muldjord
                                          last edited by mitu

                                          @muldjord said in Skyscraper now officially part of RetroPie, please test:

                                          @mitu Looks good! One note: The "Gather resources from X" should not include the name since it should be initiated from within the menu. It's not an option, just a submenu. And I think it makes sense to call it "Gather and cache resources" for instance. That's more specific and descriptive.

                                          I don't understand :). The first 2 choices initiate a scrape (gather), the 4th option is just a configuration toggle. So we would rename the entries

                                          • Gather and cache resources for all systems - runs the scrape for all systems, with the source from 4.
                                          • Gather and cache resources for chosen systems - runs the scrape for selected systems, with the source from 4.

                                          Is that what you meant ?

                                          EDIT: something like

                                          88169611-b9d8-4d74-8cd1-4499e1088a8b-image.png

                                          muldjordM 1 Reply Last reply Reply Quote 0
                                          • mituM
                                            mitu Global Moderator @Silent
                                            last edited by

                                            @Silent That would be a good candidate; while an 'advanced' feature, it doesn't require any other CLI operations the user must perform.
                                            I see there is a sample (empty one) provided, I'll have to check during the install to not overwrite it. Right now, I think you may be the only user that is using this feature :).

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.