Skyscraper, just scrape roms missing videos?
-
Tried to read into skyscraper options but don’t find an answer to what I’m looking for.
I just want to scrape roms that have missing videos and add the video to existing scraped data. Is that possible?
If that can’t be done, another option is to purge the scraped data on those roms missing videos and then do a new scrape on the now non scraped roms. Is that something that can be done without having to remove individual data for reach rom?
-
Skyscraper CLI (command-line interface) help: https://github.com/muldjord/skyscraper/blob/master/docs/CLIHELP.md
NOTE! If you've installed Skyscraper through the RetroPie-Setup script, it is recommended to create a symbolic link to the executable. Do this by running
sudo ln -s /opt/retropie/supplementary/skyscraper/Skyscraper /usr/local/bin/Skyscraper
. This will allow you to just typeSkyscraper
when running it from command line.See also: https://github.com/muldjord/skyscraper/blob/master/docs/CONFIGINI.md - frequently-used options can be defined in
config.ini
to avoid typing them on command-line every time.By default, Skyscraper will skip processing of already-scraped roms. To force processing you can use one of
--cache refresh
, name files on command-line, or read files from a file ("cache refresh" is assumed in these latter two cases, so you don't need it explicit.)Skyscraper -p snes -s screenscraper --flags videos --cache refresh # will re-scrape all titles for the chosen platform Skyscraper -p snes -s screenscraper --flags videos "path/to/Some Game.zip" "/path/to/Another Game.zip" # scrapes just the chosen roms # paths can be relative or /absolute Skyscraper -p snes --cache report:missing=video Skyscraper -p snes -s screenscraper --flags videos --includefrom ~/.skyscraper/reports/report-snes-missing_video-20220206.txt # generates report of roms missing "video" resource # then scrapes only roms named in the report
In all cases, you will follow-up with:
Skyscraper -p snes --flags videos,symlink
...to build the gamelist. When it asks to skip existing entries, tell it "no" (you want it to re-write those entries with the new
<video>
flag, so you don't want to skip them.)*("symlink" is optional but recommended, this will create symlinks in
downloaded_media
to the cached videos instead of copying them. If you have a lot of videos this can be a significant amount of data. The downside is, if the video files in Skyscraper's cache are somehow deleted, the symlinks will be broken as well. However there's little reason to delete the cache, so it is my recommendation to use the symlinks.) -
@sleve_mcdichael Thanks for the thorough description! Maybe I can use the
--flags video
for the individual roms. I just purged the cache so many of your suggestions is not going to work in this case... :(
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.