RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Skyscraper Mimic Built In Scraper Settings Possible?

    Scheduled Pinned Locked Moved Help and Support
    scrapeskyscraperamiga
    12 Posts 3 Posters 883 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • George SpiggottG
      George Spiggott
      last edited by George Spiggott

      I have noticed that I can scrape some Amiga games using the built in scraper on Retropie that I cannot get to scrape with Skyscraper. Both scrapers are using Screenscraper as a source.

      Some examples are:

      Gloom Deluxe (filename: Gloom_Deluxe.adf)
      Alien Breed 3D (filename: AlienBreed3D_v1.2_CD32.lha)
      Pinball Fantasies (filename: PinballFantasies_v2.7_CD32.lha)

      Is there a way to get Skyscraper to mimic whatever settings the built in scraper is using in Skyscraper?

      Also when Skyscraper scrapes a file with .bin/.cue files which file is it using to search?

      Thanks

      Currently running:
      Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
      ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

      1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator
        last edited by mitu

        @George-Spiggott said in Skyscraper Mimic Built In Scraper Settings Possible?:

        Is there a way to get Skyscraper to mimic whatever settings the built in scraper is using in Skyscraper?

        You can use the --query parameter and scrape using romnom option, so that it scrapes using the name of the game, instead of using the checksum of the file.

        /opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query romnom=Alien+Breed+3d AlienBreed3D_v1.2_CD32.lha
        
        ....
        #1/1 (T1) Pass 1 ---- Game 'AlienBreed3D_v1.2_CD32' found! :) ----
        Scraper:        screenscraper
        From cache:     NO
        Search match:   100 %
        Compare title:  'Alien Breed 3D'
        Result title:   'Alien Breed 3d' ()
        Platform:       'Amiga CD32' ()
        Release Date:   '1995-01-01' ()
        Developer:      'Team 17' ()
        Publisher:      'Team 17' ()
        Players:        '2' ()
        Ages:           '' ()
        Tags:           'Shooter' ()
        Rating (0-1):   '' ()
        Cover:          YES ()
        Screenshot:     YES ()
        Wheel:          YES ()
        Marquee:        NO ()
        

        Also when Skyscraper scrapes a file with .bin/.cue files which file is it using to search?

        It depends on what Skyscraper considers as a ROM file, if both extensions are registered, it will try to find a match for each file. You can override this I think in the configuration.

        1 Reply Last reply Reply Quote 2
        • George SpiggottG
          George Spiggott
          last edited by

          Thanks. It took a bit of doing but I got most of them. I've created a script file to take the hassle out of this if I have to do it again.

          The only game I couldn't get to work was Xenon 2 Megablast CDTV (filename: Xenon_2_Megablast_CD32.cue) I'm not sure if the filename is throwing it off but labelling the .cue as "_CD32" is the only way I can get it to boot on Amiberry.

          Currently running:
          Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
          ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

          muldjordM 1 Reply Last reply Reply Quote 0
          • muldjordM
            muldjord @George Spiggott
            last edited by muldjord

            @George-Spiggott You can also consider trying with some of the other sources in Skyscraper. openretro is an Amiga-centric database (and really good, even with the lha files), and mobygames is also very good for Amiga games. thegamesdb probably also.

            George SpiggottG 1 Reply Last reply Reply Quote 2
            • George SpiggottG
              George Spiggott @muldjord
              last edited by

              @muldjord Thanks I will look. Xenon 2 Megablast CDTV is definitely on Screenscraper though. I've tried every possible name combination I can think of.

              https://www.screenscraper.fr/rechercheroms.php?numpage=0&action=newrecherche

              Currently running:
              Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
              ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

              1 Reply Last reply Reply Quote 0
              • George SpiggottG
                George Spiggott
                last edited by

                Now I'm really confused:

                This will not scrape: /opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query romnom=xenon+2 Xenon_2_Megablast_CD32.cue

                This will: /opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query romnom=xenon+2 Xenon2_v1.7_CDTV.lha

                Only the filename is changed, everything else is the same. Can anyone shed light on this please?

                Currently running:
                Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
                ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

                1 Reply Last reply Reply Quote 0
                • mituM
                  mitu Global Moderator
                  last edited by

                  @George-Spiggott said in Skyscraper Mimic Built In Scraper Settings Possible?:

                  This will: /opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query romnom=xenon+2 Xenon2_v1.7_CDTV.lha

                  Works for me:

                  #1/1 (T1) Pass 1 ---- Game 'Xenon2_v1.7_CDTV' found! :) ----
                  Scraper:        screenscraper
                  From cache:     NO
                  Search match:   100 %
                  Compare title:  'Xenon 2'
                  Result title:   'Xenon 2 - Megablast' ()
                  Platform:       'Amiga CDTV' ()
                  Release Date:   '' ()
                  Developer:      'Bitmap Brothers' ()
                  Publisher:      'Image Works' ()
                  Players:        '2' ()
                  Ages:           '' ()
                  Tags:           'Shooter' ()
                  Rating (0-1):   '0.6' ()
                  Cover:          YES ()
                  Screenshot:     YES ()
                  Wheel:          YES ()
                  Marquee:        NO ()
                  
                  Description: ()
                  'Xenon 2: Megablast i[...]
                  
                  'screenscraper' requests remaining: 1993
                  
                  1 Reply Last reply Reply Quote 0
                  • George SpiggottG
                    George Spiggott
                    last edited by

                    @mitu Yes for me too but the first entry (the .cue file) does not.

                    Currently running:
                    Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
                    ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

                    muldjordM 1 Reply Last reply Reply Quote 0
                    • muldjordM
                      muldjord @George Spiggott
                      last edited by muldjord

                      @George-Spiggott Always remember to quote your queries if there's spaces in the name:

                      /opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query "romnom=xenon+2 Xenon_2_Megablast_CD32.cue"
                      
                      1 Reply Last reply Reply Quote 1
                      • George SpiggottG
                        George Spiggott
                        last edited by

                        @muldjord I copy pasted that entry into Putty and got the following error from Skyscraper

                        '--query' was set but more than one filename was provided on command line or using the '--fromfile' option. Please provide only a single rom file name you wish to scrape using the query, now quitting...

                        Currently running:
                        Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
                        ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

                        muldjordM 1 Reply Last reply Reply Quote 0
                        • muldjordM
                          muldjord @George Spiggott
                          last edited by muldjord

                          @George-Spiggott Yeah sorry, I misread your post. But you do need those quotes in case you want to use spaces in the romnom name. In this case you used a + instead. You should use %20 which is an url encoded space. It should be:

                          /opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query "romnom=xenon%202" Xenon_2_Megablast_CD32.cue
                          

                          But "romnom=xenon%202" is not a good match for the ScreenScraper romnom query. I suggest using --query sha1=SHA1SUM instead where you substitute SHA1SUM with a rom's sha1 sum that you have found for the correct game on their website.

                          1 Reply Last reply Reply Quote 1
                          • George SpiggottG
                            George Spiggott
                            last edited by George Spiggott

                            Thanks @muldjord The "xenon+2" bit works because "/opt/retropie/supplementary/skyscraper/Skyscraper -p amiga -s screenscraper --query romnom=xenon+2 Xenon2_v1.7_CDTV.lha" scrapes no problem. I have the scraped image now from that file/scrape. My plan is to get Skyscraper use a local image now I have it.

                            I tried sha1 and crc, neither of them work. For some reason it just doesn't like my .cue/.iso copy of Xenon 2 CDTV.

                            Scraping for Amiga can be a bit tricky especially if, like me, you're determined to use specific roms rather than common ones.

                            Currently running:
                            Retropie 4.8.9 on a Pi Zero 2W (Overclock Settings: CPU 1400Mhz)
                            ES-DE on a GMKtec K6 (Windows 11, 32GB RAM)

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post

                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.