RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Versatile C++ game scraper: Skyscraper

    Scheduled Pinned Locked Moved Ideas and Development
    skyscraperscrapergamelist.xmlscrapinggithub
    1.6k Posts 113 Posters 1.5m Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      SammyBoy
      last edited by

      @muldjord I think that Skyscraper isn't properly scraping some platforms from screenscraper.fr because I was scraping roms from the famicom disk system and none of them had a marquee however on the website there was a marquee and no games get scraped on arcade, fba, ect but I think this is due to having multiple arcade categories. Do you think you can fix it? Because I find it really annoying having to scrape from import because it is quite time consuming. Thank you

      muldjordM 1 Reply Last reply Reply Quote 0
      • muldjordM
        muldjord @SammyBoy
        last edited by muldjord

        @sammyboy Just add '--region jp' to the command line. The famicom disk system was only released in japan, and I don't check for those by default.

        EDIT: I'll add it as one of the regions it tries automatically by default to 2.3.0. But please use '--region jp' until then. Version 2.3.0 won't be released for another week or so.

        EDIT2: You mention 'arcade' and 'fba' aswell. Please be more specific about what you are trying to do. Give me an example filename from the platform that isn't working, so I have a chance of reproducing it.

        S 1 Reply Last reply Reply Quote 0
        • S
          SammyBoy @muldjord
          last edited by

          @muldjord any arcade rom for example the last blade 2

          muldjordM 1 Reply Last reply Reply Quote 0
          • muldjordM
            muldjord @SammyBoy
            last edited by

            @sammyboy Last Blade 2 scrapes just fine with the default 'arcadedb' module here.

            S 1 Reply Last reply Reply Quote 0
            • S
              SammyBoy @muldjord
              last edited by

              @muldjord but not with screenscraper.fr and I don't think arcade db has wheel art

              muldjordM 1 Reply Last reply Reply Quote 0
              • muldjordM
                muldjord @SammyBoy
                last edited by

                @sammyboy Then it's because screenscraper doesn't have the sha1 summed file in their database. It checksums the file, for instance "lastbld2.zip" and asks for it at screenscraper. It doesn't provide a result so it probablt doesn't exist for the arcade platform on screepscraper. If there's another platform it DOES exist for on screepscraper, please provide the platform. Then I can add it as a alias which should make it work.

                S 1 Reply Last reply Reply Quote 1
                • S
                  SammyBoy @muldjord
                  last edited by

                  @muldjord Do you think it's anything to do with the way screenscraper.fr has categorised the arcade metadata for example instead of one big arcade section it is built up of cps3, Konami, ect

                  muldjordM 1 Reply Last reply Reply Quote 0
                  • S
                    SammyBoy
                    last edited by

                    And @muldjord it scrapes from neogeo which is where I tried to scrape from but it didn't work

                    1 Reply Last reply Reply Quote 0
                    • muldjordM
                      muldjord @SammyBoy
                      last edited by

                      @sammyboy Yes, that is the reason. I just found the list myself, and I will add all of them as aliases in 2.3.0. But please be patient, 2.3.0 is not going to be released just yet.

                      S 1 Reply Last reply Reply Quote 1
                      • S
                        SammyBoy @muldjord
                        last edited by

                        @muldjord OK thank you so much. And can you also find out why some marquees are not found when scraping from screenscraper.fr? Sorry to be such a bother

                        muldjordM 1 Reply Last reply Reply Quote 0
                        • muldjordM
                          muldjord @SammyBoy
                          last edited by

                          @sammyboy Please read the message further up. I already answered that. It's because fds is 'jp' region only. This is also fixed in 2.3.0 but you can remedy it already by adding '--region jp' to the command line.

                          S 1 Reply Last reply Reply Quote 1
                          • S
                            SammyBoy @muldjord
                            last edited by

                            @muldjord OK thanks

                            1 Reply Last reply Reply Quote 0
                            • muldjordM
                              muldjord
                              last edited by muldjord

                              The new compositor is largely done now, and it's pretty damn cool! I need to add further effects (stroke, colorize, brightness?, contrast?, 3dbox effect?, rounded corners?) and refactor a bunch of stuff after the coding marathon I've been on for the past few days. I will be back with some examples of what it will allow you to do when I get the time. I'm pretty stoked for this! Glossy round frames to frame your cover? No problem. Rounded edges on your screenshot? You betcha. I feel like I'm implementing Gimp here, haha! :D But yes, it'll allow you to do some pretty awesome stuff using just one simple xml file.

                              AnalogHeroA 1 Reply Last reply Reply Quote 1
                              • AnalogHeroA
                                AnalogHero @muldjord
                                last edited by

                                @muldjord Sounds cool. I guess the artwork.xml is getting really complex now...

                                muldjordM 1 Reply Last reply Reply Quote 0
                                • muldjordM
                                  muldjord @AnalogHero
                                  last edited by

                                  @analoghero It can be if you want it to. The format is the same as before, it just allows you to do things like nested layers where each layer is anchored to the previous layer, which makes it really easy to center a 'wheel' inside a 'cover' for instance. I'll provide some nifty examples once I get it all sorted out. :)

                                  1 Reply Last reply Reply Quote 1
                                  • muldjordM
                                    muldjord
                                    last edited by muldjord

                                    Just a quick video to show you the progress. In this video you see me live-editing the artwork.xml file, while the result is being rendered in an image on the right side. This is a demonstration of the effects I've included so far.

                                    I forgot to demonstrate the stroke effect which outlines a layer. But it's in there aswell. :)

                                    1 Reply Last reply Reply Quote 3
                                    • S
                                      SammyBoy
                                      last edited by

                                      @muldjord In Skyscraper 2.3.0 will you also be adding blur, colorize and stroke effects (I'm pretty sure you've already planned to add stroke anyway )?

                                      muldjordM 1 Reply Last reply Reply Quote 0
                                      • muldjordM
                                        muldjord @SammyBoy
                                        last edited by muldjord

                                        @sammyboy Yes, stroke is in there as I also note below the video. Colorize is in there but called 'balance' which is 'color balance' where you can adjust red, green and blue value of the layer. Blur is not implemented yet, but will be before I release it.

                                        S 1 Reply Last reply Reply Quote 1
                                        • S
                                          SammyBoy @muldjord
                                          last edited by SammyBoy

                                          @muldjord One last question are you planning to add 3D boxart in a later version of Skyscraper (not 2.3.0)?

                                          EDIT: Sorry I have another question regarding the screenscraper.fr region problem and that's that SNK VS. Capcom isn't getting scraped from screenscraper.fr whatsoever even though the game is from America I'll check tomorrow and see if it's the because of the filename.

                                          muldjordM 1 Reply Last reply Reply Quote 0
                                          • muldjordM
                                            muldjord @SammyBoy
                                            last edited by

                                            @sammyboy I will be looking into this yes. But it won't be the boxard from screenscraper, rather I'll render a 3d box myself from the wheel and cover photo. It won't be in 2.3.0 though.

                                            Concerning your other question, it might be because '-m' isn't set. Try setting it ti '-m 0'. This has also been fixed in 2.3.0 together with the region problem.

                                            S 1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.