Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

Versatile C++ game scraper: Skyscraper



  • Ok, thegamesdb should provide more results for the steamplatform now. But I had to add aliases for the xbone and ps4 for it. It rarely returns PC results it seems, which is really odd. But not something I can change. Re-released 3.1.2 again... Please re-update.



  • I love this tool, thanks for making it. Really does wonders for scraping roms.



  • Would appreciate a tiny bit of help. I've read the documentation and various threads but yet to find an answer. So far doing really well with Skyscraper. It's amazing! But I'm having an issue with one or two games that share a name with each other and it's driving me crazy!

    Particularly, there's a MAME title called Badlands. Then there's a MAME title called Bad Lands. It's always selecting the default incorrect one for my needs and I don't know how to get it to offer me a choice between them. I thought the --interactive option would help but it didn't seem to make any difference. How can I select the correct one? For info I am using Skyscraper on my PC running Manjaro Linux. It's otherwise perfect.

    Any help with this very much appreciated. :-)



  • @Ranma which source is returning the wrong result? And have you tried a different source?



  • @quicksilver
    I'm using Screenscraper. I know they have the proper one I'm after because if I scrape from a Recalbox install I can select the correct one. Unfortunately the art style it uses doesn't fit what I want, and I don't know how to tailor it in Recalbox, so I'm using my desktop to scrape. It's quicker anyway.


  • Global Moderator

    @Ranma Try using the --query option and select the right CRC for the ROM, as it's shown on the Screenscraper site. This will create the proper association between ROM and scrape source.



  • Thanks for replying but it's a loss as I can't search the Screenscraper site to find the damn info! Tbh I think the site is struggling at the moment. I'm getting an error when I try to use Recalbox to scrape too. Keeps saying disc full, but I know the SD card has loads of space.

    EDIT: Ah looks like I'm right. Getting the output below using the --query flag you recommended.

    The screenscraper service is currently too busy to handle requests from unregistered users. Sign up for an account at https://www.screenscraper.fr and support them to gain more threads. Then use the credentials with Skyscraper using the '-u [user:password]' command line option or by setting 'userCreds=[user:password]' in '~/.skyscraper/config.ini'.
    

    I'll try it later. Thanks for the help though!



  • @Ranma registration is free and is easy to add your credentials to skyscraper



  • Still not working even after registering. Driving me crackers!

    Skyscraper -p mame-libretro -s screenscraper -u xxxxxxxx:xxxxxxxxxxxx --query "md5=[dfd57074a033d47df8e68d4c7b08013c]" /home/me/Downloads/mame-libretro/mame-libretro/badlands.zip
    
    First 256 characters of answer was:
    Champ crc, md5 ou sha1 erroné  
    #1/1 (T1) Pass 1 ---- Game 'badlands' not found :( ----
    

    But it's there! See? Same md5 and everything!



  • @Ranma said in Versatile C++ game scraper: Skyscraper:

    Still not working even after registering. Driving me crackers!

    Skyscraper -p mame-libretro -s screenscraper -u xxxxxxxx:xxxxxxxxxxxx --query "md5=[dfd57074a033d47df8e68d4c7b08013c]" /home/me/Downloads/mame-libretro/mame-libretro/badlands.zip
    
    First 256 characters of answer was:
    Champ crc, md5 ou sha1 erroné  
    #1/1 (T1) Pass 1 ---- Game 'badlands' not found :( ----
    

    But it's there! See? Same md5 and everything!

    Why are you adding square brackets to the query? Remove those.

    EDIT: Oh, you saw those in the docs and thought you needed to apply them. The square brackets are only there to show that it is a variable. I've changed them to < and > now. Maybe more people will understand that.



  • @muldjord
    Ah I see! I've been using Linux for many years and everyone's approach to the syntax is always different from the last person's. If it's printed in the tutorial, I'll type it! Thanks for the heads up. :-)

    EDIT: Finally, it worked! Many thanks.



  • @Ranma said in Versatile C++ game scraper: Skyscraper:

    Ah I see! I've been using Linux for many years and everyone's approach to the syntax is always different from the last person's.

    Agreed. I've recently changed all [ and ] to < and >. But you're right, it's hard to find concensus.

    EDIT: Finally, it worked! Many thanks.

    Awesome! :)



  • @muldjord Omg. That clears up my recent problems with md5 and skyscraper. Somehow i put the md5 in square brackets. I thought this is the way it always was... LOL



  • @frezeen
    Just moving the discussion of the unsupported Windows version here instead. The other thread is for the RetroPie script.

    I've updated the Windows version to 3.1.5 (development code), and it works well with screenscraper on my install. Remember to follow the README included in the zip completely to the point.



  • continue not work, anyways new 3.1.5 is not 3.1.5 but when launch it:
    Running Skyscraper v3.1.1 by Lars Muldjord
    .....
    .....
    i dont know if missmatch is normal or not.
    i follow the readme, arcadedb module work perfect, screenscraper got error with my credential too.
    its useless continue to hit wall with head... the hint is: no support for windows , and without a debug mode its hard to fix.
    i surrend, installed virtual machine with linux and work, slow but work.
    i never stop to repeat thank you for your work and for support it



  • @frezeen said in Versatile C++ game scraper: Skyscraper:

    continue not work, anyways new 3.1.5 is not 3.1.5 but when launch it:
    Running Skyscraper v3.1.1 by Lars Muldjord
    .....
    .....
    i dont know if missmatch is normal or not.

    That's because I forgot to "make clean" before recompiling it. It is 3.1.5 even if it doesn't say so.
    I might be able to try it on a different Windows machine at work tomorrow. It might be a dll problem.

    EDIT: Just updated the zip again. It will now read "3.1.5" as it's supposed to. But it's the same executable other than that.

    Did you remember to follow the installation instructions in the README included in the zip file? There's some important stuff in there.



  • readme warning are to copy 2 dirs in /user/myuser/ and dont launch it from powershell but from old cmd.
    i try it with cmd (admin privile and not) and with cmder.exe (look great, its linux terminal emulator with colours too)
    arcadedb module work with no problems and its really fast.
    same romset (2850 mame roms) from arcadedb: 13 mins on windows. 28 min in virtual linux machine, about 40 mins on rpi. with 1000mbits connection
    its normal arcadedb module work but not screenscraper?

    anyways, really, im scraping my 16000 roms collection with virtual machine... i dont want to stolen more time from you with this windows questions. sorry



  • @frezeen No idea then. Works fine with screenscraper when running it in cmd.exe here.



  • ok, i found the best solution for me.
    https://www.howtogeek.com/249966/how-to-install-and-use-the-linux-bash-shell-on-windows-10/
    than install debian from windows 10 market.
    debian linux bash shell work like a charm, its not emulated , its very fast with all my windows drive mounted already. i install with apt-get all request packages than compile skyscraper and wow... all work perfect , fast and great.... you are my hero :) im very happy. with this solution windows user dont need a windows version :)

    edit: im surprised about this new windows 10 function. this shell work like a real debian machine... ill try to install retropie too... want to see if i can control skyscraper from retropie script.



  • Hi,

    I installed Retropie on Lubuntu (latest version and up to date).

    When I try to scrape, it says that it cannot create cache folders because of permission.

    I’m not highly skilled in Linux. I’ve read about the chmod stuff but I would like to make sure I don’t mess permission for the whole computer haha

    May I ask for some help to allow skyscraper to work. I have no issue on my RPi 3b+ so I’m sure it’s folder permission issues on my Linux machine, as the attached picture shows.!
    B1D13B05-5773-4D8F-B77A-2FA800297EA4.jpeg



Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.