RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Skyscraper, just scrape roms missing videos?

    Scheduled Pinned Locked Moved Help and Support
    skyscraper
    3 Posts 2 Posters 969 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      Stuffu
      last edited by Stuffu

      Tried to read into skyscraper options but don’t find an answer to what I’m looking for.

      I just want to scrape roms that have missing videos and add the video to existing scraped data. Is that possible?

      If that can’t be done, another option is to purge the scraped data on those roms missing videos and then do a new scrape on the now non scraped roms. Is that something that can be done without having to remove individual data for reach rom?

      1 Reply Last reply Reply Quote 0
      • S
        sleve_mcdichael
        last edited by

        Skyscraper CLI (command-line interface) help: https://github.com/muldjord/skyscraper/blob/master/docs/CLIHELP.md

        NOTE! If you've installed Skyscraper through the RetroPie-Setup script, it is recommended to create a symbolic link to the executable. Do this by running sudo ln -s /opt/retropie/supplementary/skyscraper/Skyscraper /usr/local/bin/Skyscraper. This will allow you to just type Skyscraper when running it from command line.

        See also: https://github.com/muldjord/skyscraper/blob/master/docs/CONFIGINI.md - frequently-used options can be defined in config.ini to avoid typing them on command-line every time.

        By default, Skyscraper will skip processing of already-scraped roms. To force processing you can use one of --cache refresh, name files on command-line, or read files from a file ("cache refresh" is assumed in these latter two cases, so you don't need it explicit.)

        Skyscraper -p snes -s screenscraper --flags videos --cache refresh
        # will re-scrape all titles for the chosen platform
        
        Skyscraper -p snes -s screenscraper --flags videos "path/to/Some Game.zip" "/path/to/Another Game.zip"
        # scrapes just the chosen roms
        # paths can be relative or /absolute
        
        Skyscraper -p snes --cache report:missing=video
        Skyscraper -p snes -s screenscraper --flags videos --includefrom ~/.skyscraper/reports/report-snes-missing_video-20220206.txt
        # generates report of roms missing "video" resource
        # then scrapes only roms named in the report
        

        In all cases, you will follow-up with:

        Skyscraper -p snes --flags videos,symlink
        

        ...to build the gamelist. When it asks to skip existing entries, tell it "no" (you want it to re-write those entries with the new <video> flag, so you don't want to skip them.)

        *("symlink" is optional but recommended, this will create symlinks in downloaded_media to the cached videos instead of copying them. If you have a lot of videos this can be a significant amount of data. The downside is, if the video files in Skyscraper's cache are somehow deleted, the symlinks will be broken as well. However there's little reason to delete the cache, so it is my recommendation to use the symlinks.)

        S 1 Reply Last reply Reply Quote 1
        • S
          Stuffu @sleve_mcdichael
          last edited by

          @sleve_mcdichael Thanks for the thorough description! Maybe I can use the --flags video for the individual roms. I just purged the cache so many of your suggestions is not going to work in this case... :(

          1 Reply Last reply Reply Quote 0
          • First post
            Last post

          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.