RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Versatile C++ game scraper: Skyscraper

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscrapergamelist.xmlscrapinggithub
    1.6k Posts 113 Posters 1.6m Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • muldjordM
      muldjord
      last edited by

      Ah, I know why... It's because the files are using several dots in the name, which makes it look for the file Lotus3_v1.mp4 instead of Lotus3_v1.6_0217.mp4. I'll make it use the full basename instead.

      1 Reply Last reply Reply Quote 0
      • muldjordM
        muldjord
        last edited by

        2.4.2 out, please test.

        AnalogHeroA 2 Replies Last reply Reply Quote 0
        • AnalogHeroA
          AnalogHero @muldjord
          last edited by

          @muldjord Tested, and it works now as it should. Youre amazing. :)

          muldjordM 1 Reply Last reply Reply Quote 1
          • AnalogHeroA
            AnalogHero @muldjord
            last edited by

            @muldjord Hmm just scraped amiga with localdb and now it skipped Lotus 3.

            muldjordM 1 Reply Last reply Reply Quote 0
            • muldjordM
              muldjord @AnalogHero
              last edited by

              This post is deleted!
              1 Reply Last reply Reply Quote 0
              • muldjordM
                muldjord @AnalogHero
                last edited by muldjord

                @analoghero Does that here aswell, looking into it...

                EDIT: Found the problem, fixing...

                1 Reply Last reply Reply Quote 1
                • B
                  bleuge
                  last edited by

                  @muldjord Thanks very much for the fixes, going to update and test again.
                  @AnalogHero How do you capture your output? with all the colors and so? xD

                  Also, I want to share this:
                  https://twitter.com/WhaddupNico/status/976887812959195136

                  This guy has done fantastic logos for lots of games, for SNES, GBA, N64, DC, and PS1. He share the packs in mega. Logos are in vector format and in transparent PNG. Vectors are great because as you already know we can scale up to 4k or whatever.
                  These logos are not in any online db, but could be used with local data import of Skyscraper. Remember to rename the file as the rom you want to use it.

                  I still not tried the graphic composer but will have a look...

                  I am downloading all the packs now.

                  1 Reply Last reply Reply Quote 0
                  • muldjordM
                    muldjord
                    last edited by muldjord

                    2.4.3 out, please test... I really need to figure out a better way to put out test releases, this is getting silly. :)

                    EDIT: @bleuge, those logos are pretty amazing. Guy's doing a fantastic job!

                    EDIT2: Just updated 2.4.3 code again. Hope you didn't update in the meantime. Found a flaw with the fix I just made... And fixed the fix. Meta!

                    1 Reply Last reply Reply Quote 0
                    • muldjordM
                      muldjord
                      last edited by

                      I think I'll create rcX releases from now on. Releasing 2.4.x releases seems silly to me when new issues keep popping up.

                      Thank you for your help with testing @AnalogHero I appreciate it a lot.

                      AnalogHeroA 2 Replies Last reply Reply Quote 0
                      • AnalogHeroA
                        AnalogHero @muldjord
                        last edited by AnalogHero

                        @muldjord Compiling right now. Will test when done. Maybe you can do test updates in a seperate git branch, compiled with an argument of update_skyscraper.sh.

                        @bleuge Three ` will display a code block. View http://commonmark.org/help/ for more information.

                        Edit: Looks like it worked now. Glad that i could help. Someone has to test it all out.

                        1 Reply Last reply Reply Quote 1
                        • AnalogHeroA
                          AnalogHero @muldjord
                          last edited by

                          @muldjord If i swap out my amiga collection with .lha files, will skyscraper recognise them as the same game? For example i delete Agony.uae and replace it with Agony_v1.3_0960.lha, will skyscrape use the avaiable local data from the dbs?

                          muldjordM 1 Reply Last reply Reply Quote 0
                          • muldjordM
                            muldjord @AnalogHero
                            last edited by muldjord

                            @analoghero No, it will differ. If you switch to LHA's completely I would recommend deleting the entire amiga db folder as the cached resources would be of no use anymore. Skyscraper detects games from their sha1 checksums. In cases where it is a script (such as .uae) it will sha1 the filename instead of the file contents, since .uae's might change contents.

                            EDIT: Actually that is an interesting observation. If you change/delete your romset completely or partly, you would probably want to purge localdb of all resources not related to your roms. So in a future update, when I've had a few days for R&R, I will add the option of purging the cache of resources not related to the current roms you have in your input folder.

                            AnalogHeroA 1 Reply Last reply Reply Quote 2
                            • AnalogHeroA
                              AnalogHero @muldjord
                              last edited by

                              @muldjord Hmm. Its a lot of work then, because i manually renamed the videos to match my .uae collection, now i have to do it again to match the .lhas. Good that i picked only the games i really like to play, and not just the entire collection.

                              muldjordM 1 Reply Last reply Reply Quote 0
                              • muldjordM
                                muldjord @AnalogHero
                                last edited by

                                @analoghero Yeah, not much to do about that I'm afraid. Hopefully the LHA collection will be quite stable in its contents so it won't be necessary to do it again in the future.

                                1 Reply Last reply Reply Quote 0
                                • B
                                  bleuge
                                  last edited by

                                  @AnalogHero Amiga newbie here, as i read, i assume the way to go in Amiga for Raspberry is lha?
                                  Also I think if i want to mount an Amiga project, Amiberry is the best? Any tips building an image for Amiga?
                                  Sorry the offtopic :D

                                  @muldjord updated to latest, rerun my script, it seems it's working, sometimes it does very long pauses with no output, but for now it's running

                                  AnalogHeroA muldjordM 2 Replies Last reply Reply Quote 0
                                  • AnalogHeroA
                                    AnalogHero @bleuge
                                    last edited by

                                    @bleuge I would recommend to wait a bit longer as RetroPie-setup hasnt updated yet to support the latest amiberry version. In the very near future it should be as easy as copying the games (in .lha format) to the /roms/amiga folder.

                                    1 Reply Last reply Reply Quote 0
                                    • muldjordM
                                      muldjord @bleuge
                                      last edited by

                                      @bleuge The long pauses are expected, that's because the threads run in parallel and sometimes sync up which gives those pauses in-between results. ;)

                                      1 Reply Last reply Reply Quote 0
                                      • J
                                        jlfernandez
                                        last edited by

                                        Sorry if this has already been answered (I couldn't find a reply) but how can I get just a simple cover instead of any fancy artwork? I use videos whenever available so I don't need a screenshot or a rotated box or anything else. Just a simple 2D cover will do.

                                        Thanks!

                                        muldjordM 1 Reply Last reply Reply Quote 0
                                        • muldjordM
                                          muldjord @jlfernandez
                                          last edited by muldjord

                                          @jlfernandez Artwork documentation is here: https://github.com/muldjord/skyscraper/blob/master/ARTWORK.md

                                          Basically what you want is for Skyscraper to export a screenshot that uses the cover as a layer.

                                          So you'd create a '[homedir]/.skyscraper/artwork.xml' something like this:

                                          <?xml version="1.0" encoding="UTF-8"?>
                                          <artwork>
                                            <output type="screenshot" width="640" height="480">
                                              <layer resource="cover" height="480" align="center" valign="middle"/>
                                            </output>
                                          </artwork>
                                          

                                          Alternatively, if you want it exported directly as the cover, then just use the following:

                                          <?xml version="1.0" encoding="UTF-8"?>
                                          <artwork>
                                            <output type="cover" height="480"/>
                                          </artwork>
                                          

                                          That will export the cover (as a cover) with a height of 480 pixels and width relative to that.

                                          That should get you started. :)

                                          1 Reply Last reply Reply Quote 2
                                          • B
                                            bleuge
                                            last edited by

                                            Skyscraper is so flexible i think many users don't use to its fully potential xD

                                            I think this is correct: if i have already scraped my sets, my localdb is around 15-16GB. And i want to do things like this, export only the cover, re-build a graphic composition, etc... I just need to modify the artwork.xml file and do a -s localdb rescrape, am i right? Graphics will be rebuild and overwritten in the media folders?

                                            Thanks

                                            AnalogHeroA 1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.