RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Skyscraper now officially part of RetroPie, please test

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscraperretropie-setupoptionalexperimental
    275 Posts 28 Posters 115.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mituM
      mitu Global Moderator @muldjord
      last edited by

      @muldjord Yes, the spelling is in the message shown after gathering chosen systems. I'll fix this.

      For the other part, I'll do some more test runs, but it sounds similar to the old buffering problem (which was fixed and the fix is still in). I ran a few test (gather and generate) and it doesn't seem to be a difference between the scriptmodule command and a manual (CLI) run.

      muldjordM 1 Reply Last reply Reply Quote 1
      • muldjordM
        muldjord @mitu
        last edited by

        @mitu Awesome, that's what I would have guessed. Thanks.

        1 Reply Last reply Reply Quote 0
        • B
          bleuge @muldjord
          last edited by

          @muldjord Thanks for confirmation,

          I guess I'll write a script for importing all those images for every platform, I'll do this:

          Thumbnail folder - Skyscraper import
          named_boxarts -> /import/covers
          named_snaps -> /import/screenshots
          named_titles -> import/wheels?

          Let's see how it works...

          Thanks for 3.0!!

          1 Reply Last reply Reply Quote 1
          • muldjordM
            muldjord
            last edited by muldjord

            @mitu A user reports:

            I tried to update from source and got the following error:
            Could not successfully install Scraper for EmulationStation by Lars Muldjord (/home/pi/RetroPie-Setup/tmp/build/skyscraper/ARTWORK.md not found)
            I've never mucked directly with that folder, so I'm not sure why the file would be missing? I'll give it another go and see if I can get it
            [EDIT] Crashed the 2nd time as well, but the package says 3.0.0 when I load it up now... Weird

            I then asked if he updated the script prior to updating Skyscraper. He then proceeded to uninstall Skyscraper, update the script, and then reinstall Skyscraper from source, but still get this error. I'm thinking maybe it's because some of the files inside of the skyscraper.pro file have changed location?

            mituM 1 Reply Last reply Reply Quote 0
            • mituM
              mitu Global Moderator @muldjord
              last edited by mitu

              @muldjord I've seen that. The error is from using an older version of the script - should have updated first. In the new version, ARTWORK.md is no longer checked by the install script. First thing I've done is update from the GUI with the new option and didn't get any errors :).

              EDIT: fixed the spelling in the latest version. I still don't see a difference between scraping from the GUI and from the CLI in my tests - maybe there is a difference with the 2.x version that the user is actually seeing. I'll keep poking around.

              muldjordM 1 Reply Last reply Reply Quote 0
              • muldjordM
                muldjord @mitu
                last edited by muldjord

                @mitu said in Skyscraper now officially part of RetroPie, please test:

                @muldjord I've seen that. The error is from using an older version of the script - should have updated first. In the new version, ARTWORK.md is no longer checked by the install script. First thing I've done is update from the GUI with the new option and didn't get any errors :).

                Good to know, thanks.

                1 Reply Last reply Reply Quote 0
                • S
                  Stuffu
                  last edited by Stuffu

                  First off, I’ve tried skyscraper before without success.

                  Gave it a new try today and amiga section went flawlessly, awesome!

                  Now where I’m stuck. I was scraping c64 with screenscraper, everything as expected. When doing the same with thegamesdb, it just quits immediately with “forcing thread x to stop”.

                  Edit: screenscraper left out a lot, but I noticed that thegamesdb starts with 0 requests remaining, which it shouldn’t be.

                  Any suggestions here?

                  And thanks for a great scraper!

                  mituM 1 Reply Last reply Reply Quote 0
                  • mituM
                    mitu Global Moderator @Stuffu
                    last edited by mitu

                    @Stuffu TheGamesDB module has a limit on the # of individual requests per month (1500 I think). Did you already scrape using this source ? Maybe you've went over the limit - Skyscraper would tell you how many requests you have left - if it's 0, then your consumed your quota.

                    S 1 Reply Last reply Reply Quote 0
                    • S
                      Stuffu @mitu
                      last edited by

                      @mitu

                      Yup, scraped 1300 games and now additional 500 ish. Is there a time limit?

                      Must be it, thanks.

                      mituM 1 Reply Last reply Reply Quote 0
                      • mituM
                        mitu Global Moderator @Stuffu
                        last edited by

                        @Stuffu said in Skyscraper now officially part of RetroPie, please test:

                        Yup, scraped 1300 games and now additional 500 ish. Is there a time limit?

                        Yes, it's a monthly quota.

                        S 1 Reply Last reply Reply Quote 0
                        • S
                          Stuffu @mitu
                          last edited by

                          @mitu

                          Crap, but thanks!

                          muldjordM 1 Reply Last reply Reply Quote 0
                          • muldjordM
                            muldjord @Stuffu
                            last edited by muldjord

                            @Stuffu Just to be clear. This quota is in the thegamesdb API to make sure users don't strain their servers too much. It's 2000 requests per month per IP (so basically per Skyscraper user). And 1 game takes up about 2 requests (one for the game search, and one for grabbing the data).

                            S 1 Reply Last reply Reply Quote 0
                            • S
                              Stuffu @muldjord
                              last edited by

                              @muldjord

                              Well, I just have to wait for the games not listed on screenscraper, it's not a big deal. Thanks for clarifying though!

                              Another thing I haven't been able to find an answer to, if you have scraped with ES built in non-working tgdb scraper before and you have a lot of results already How do you append screenscraper result to the existing db? In my case, I have ONE rom for a system that is missing metadata... Extremely annoying... If I scrape with screenscraper, all roms not detected by screenscraper is then without info in ES.

                              Also, the media and gamelist.xml is not in the same location as the current in /opt/.../... Is there a reason for this?

                              muldjordM 1 Reply Last reply Reply Quote 0
                              • muldjordM
                                muldjord @Stuffu
                                last edited by

                                @Stuffu Check the option for where you want the gamelist exported to. It's in the script. Basically there are two places you can export game lists to. The one you refer to, and inside the roms/<PLATFORM> folder. Skyscraper exports to the latter by default. But as I said you can change that easily from the script options or by using the -g cli option.

                                Data you've scraped with the internal scraper can be imported into Skyscraper with the esgamelist scraping module. Read about it here.

                                S 1 Reply Last reply Reply Quote 0
                                • S
                                  Stuffu @muldjord
                                  last edited by

                                  @muldjord

                                  Cool, worked very well, thanks!

                                  1 Reply Last reply Reply Quote 1
                                  • IanDaemonI
                                    IanDaemon
                                    last edited by

                                    Tried Skyscraper last night and, wow, it's much cooler than the built-in scraper (which is the only one I had experience with).

                                    • 5 Favorite Arcade Games in MAME
                                    • Cocktail Cabinet Games
                                    • Check out the MAME RoW
                                    1 Reply Last reply Reply Quote 1
                                    • G
                                      Gunner14 @muldjord
                                      last edited by

                                      @muldjord hi man,great work on your scraper,really is awesome.im having a bit of a problem with it however.i had issues with my retropie system.ive reflashed my card and went to install your skyscraper again but keep getting the message that it could not fully install as artwork.md wasnt found.im not a code jedi or anything so dont know what to do with it.ive managed to scrape still but nothing shows when i go into the game list on emulationstation.Psx is what im trying to scrape properly.i have all other systems done prior to the probs ive had.thanks in advance

                                      mituM 1 Reply Last reply Reply Quote 0
                                      • mituM
                                        mitu Global Moderator @Gunner14
                                        last edited by

                                        @Gunner14 Update your RetroPie-Setup script and re-try.

                                        G 1 Reply Last reply Reply Quote 1
                                        • G
                                          Gunner14 @mitu
                                          last edited by

                                          @mitu

                                          Have done mate, multiple times.Still a no go

                                          mituM 1 Reply Last reply Reply Quote 0
                                          • mituM
                                            mitu Global Moderator @Gunner14
                                            last edited by

                                            @Gunner14 What's the version of your RetroPie-Setup script ? It should be shown at the top of the main script menu when first starting the script.

                                            G 2 Replies Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.