The cache saving issue I believe to be a problem on your end. As mentioned I haven't touched that code, and it works fine here.
I believe the cache-saving error was closely related to the video-conversion error. The resource that couldn't be saved to the cache was the video that didn't get converted/copied. I only saw them together, and only in 3.6.8. Neither were present in 3.6.7, nor after today's 3.6.9 update, thank you!
pi@retropie:~ $ Skyscraper -p arcade -s screenscraper /home/pi/RetroPie/roms/arcade/1942.zip --verbosity 3
Running Skyscraper v3.6.9 by Lars Muldjord
Scraping module: 'screenscraper'
Input folder: '/home/pi/RetroPie/roms/arcade'
Game list folder: '/home/pi/.emulationstation/gamelists/arcade'
Covers folder: '/home/pi/.emulationstation/downloaded_media/arcade/covers'
Screenshots folder: '/home/pi/.emulationstation/downloaded_media/arcade/screenshots'
Wheels folder: '/home/pi/.emulationstation/downloaded_media/arcade/wheels'
Marquees folder: '/home/pi/.emulationstation/downloaded_media/arcade/marquees'
Videos folder: '/home/pi/.emulationstation/downloaded_media/arcade/videos'
Cache folder: 'cache/arcade'
DID YOU KNOW: With the '--cache show' command line option, you can check the status of the resources that are cached for the platform you are scraping.
Fetching limits for user 'REDACTED', just a sec...
Setting threads to 2 as allowed for the supplied user credentials.
Reading and parsing quick id xml, please wait... Done!
Reading and parsing resource cache, please wait... Done!
Successfully parsed 1700 resources!
Resource cache stats for selected platform:
Titles : 72
Platforms : 72
Descriptions : 72
Publishers : 72
Developers : 71
Ages : 0
Tags : 72
Ratings : 71
ReleaseDates : 72
Covers : 0
Screenshots : 0
Wheels : 0
Marquees : 0
Videos : 0
Titles : 0
Platforms : 7
Descriptions : 0
Publishers : 0
Developers : 0
Ages : 0
Tags : 0
Ratings : 0
ReleaseDates : 0
Covers : 3
Screenshots : 3
Wheels : 3
Marquees : 2
Videos : 7
Titles : 73
Platforms : 73
Descriptions : 73
Publishers : 73
Developers : 72
Ages : 11
Tags : 73
Ratings : 72
ReleaseDates : 73
Covers : 72
Screenshots : 73
Wheels : 73
Marquees : 73
Videos : 72
Looking for optional 'priorities.xml' file in cache folder... Found!
Priorities loaded successfully!
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/fbneo'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/memcard'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/nvram'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/ctrlr'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/hi'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/diff'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/comment'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/ini'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/input'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/image'
Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/cfg'
Trying to parse and load existing game list metadata... Success!
Starting scraping run on 1 files using 2 threads.
Sit back, relax and let me do the work! :)
cover: '2149208' > '323270', choosing resize for optimal result!
marquee: '158970' > '107347', choosing resize for optimal result!
#1/1 (T1) Pass 1 ---- Game '1942' found! :) ----
From cache: NO
Search match: 100 %
Compare title: '1942'
Result title: '1942' ()
Platform: 'Capcom Classics' ()
Release Date: '1984-01-01' ()
Developer: 'Capcom' ()
Publisher: 'Capcom' ()
Players: '2' ()
Ages: '1+' ()
Tags: 'Shoot'em Up, Shoot'em up / Vertical' ()
Rating (0-1): '0.7' ()
Cover: YES ()
Screenshot: YES ()
Wheel: YES ()
Marquee: YES ()
Video: YES ()
'"1942" is a vertically-scrolling shoot-em-up set in the Pacific theatre during World War II, in which the goal is to reach Tokyo and destroy the entire Japanese air fleet.
The player pilots a plane dubbed the "Super Ace" (its appearance is that of a Lockheed P-38 Lightning) and has to shoot down waves of enemy planes while avoiding incoming enemy fire. The 'Super Ace' can perform a limited number of rolls or 'loop-the-loops' to evade enemy planes and shots.
During the game, waves of red enemy planes periodically appear. If the player manages to destroy a red wave, a power-up, in the form of a 'POW' symbol, will be dropped and can be picked up. The power-up will award either increased fire-power (doubling the player's guns from two to four), a smart bomb that destroys all on-screen enemy planes the instant it's collected, two wingmen planes that flank the Super Ace and increase fire power, or simply extra points.
At the end of each stage the 'Super Ace' lands on an aircraft carrier and bonus points are awarded based on player performance. "1942" differs from other games in that its levels are numbered in reverse order, so the game begins at stage 32 and ends at stage 1.'
Running command: 'videoconvert.sh /opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4 /opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/tmpfile_769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4'
Video is in correct 420p format. Copying as is...
Tried with: 'crc=F52D7D3C&md5=89625F073887A5915C3CE2E2E4DA8875&sha1=BF332AC22C7FDB5470AFF4172A9051555E6E1266&romnom=1942.zip&romtaille=106788'
Elapsed time : 00:00:11
Est. time left : 00:00:00
---- Resource gathering run completed! YAY! ----
Writing quick id xml, please wait... Done!
Writing 1700 (0 new) resources to cache, please wait... Done!
---- And here are some neat stats :) ----
Total completion time: 00:00:11
Average search match: 100%
Average entry completeness: 100%
Total number of games: 1
Successfully processed games: 1
Skipped games: 0 (Filenames saved to '/home/USER/.skyscraper/skipped-arcade-screenscraper.txt')
You've already enabled OMX player, right? First guess then would be the videos have downloaded, but are in another format like yuv444p while they need to be in yuv420p (or at least that is one that is known to work.) If so, there's a simple script that can convert them for you when downloaded.
Check first: locate a game that doesn't show a video. Navigate to where the video should be, at:
Edit your /home/pi/.skyscraper/config.ini to include the line:
videoConvertCommand="videoconvert.sh %i %o"
Script provided by jgcobra on the GitHub thread:
echo Converting video...
echo Source: $1
echo Dest: $2
# Check if the video is already in 420p format
c=$(ffprobe "$1" 2>&1 | grep -c yuv420p)
if [ "$c" -eq 0 ]
echo Incorrect source video format detected. Converting video to 420p format...
ffmpeg -i "$1" -y -pix_fmt yuv420p -acodec copy -strict experimental "$2"
echo Video is in correct 420p format. Copying as is...
cp "$1" "$2"
Place the script in your system path or in /home/pi/.skyscraper and make it executable with chmod +x videoconvert.sh. If you want to see the script's output when run by Skyscraper, I think you need to put verbosity="3" in your config.ini.
I think this check/conversion only happens on initial caching of the video, so re-scrape your roms with --cache refresh to force a re-download and, for maximum efficiency, you can use --flags skipexistingcovers and similar to avoid unnecessarily redownloading those media.
This solved probably 90% of my problem videos. There were a handful that didn't take and I had to do a little extra fiddling, but this should get you started.
Are you sure you're modifying the right file ? The file in the $HOME/Retropie-Setup is not used at runtime, it's just the source, when installed it's copied in /opt/retropie/supplementary/runcommand - which is used to for launching.
Aha, yes I was modifying the one in $HOME. I’ll try the one in /opt tomorrow and see if that does the trick.
Edit: I snuck a peek while closing up for the night and that was it, thanks for the tip! Now I wonder if there’s a way to get the transparent background to display as black instead of that light grey...
(Also, you MIGHT not need the trailing “nes” in the gamelist and media folders, I think it’s implied. At least it is when setting them via config.ini in the main section, but not in a platform section. If your xml shows up in “gamelists/nes/nes” go ahead and just point them at “gamelists”/“downloaded_media”; it should automatically use a “<platform>” subfolder for each different one.)
When setting them on command-line the nes part is required. :) It is similar to setting it in a [nes] section in /home/USER/.skyscraper/config.ini.
@Gorf The credentials in /home/USER/.skyscraper/config.ini will be used if they are added using this exact formar:
I would also set the following which allows you to leave out the -g and -o part of your command:
@beatbox32 Everything looks good, including your mount. Did you remember to re-generate the gamelists from the RetroPie Skyscraper script? Scraping the data simply add it to the Skyscraper cache located at /home/pi/.skyscraper/cache (which is also a symbolic link if you installed Skyscraper from the RetroPie script). But you need to re-genereate the gamelists for it to create the necessary ES gamelist.xml files and artwork files in the /home/pi/.emulationstation/downloaded_media/ platform folders.
Remember to push space for each platform when generating the gamelists to select them.
EDIT: Skyscraper also checks if gamelist.xml is writable before it starts. It won't run unless it is.
Boom! Now it's working. Many thanks for the education on how the cache system works. I think I had a few missteps along the way where I was mounting the media folders as root and not the pi user, running into write issues initially. Once I resolved that, I apparently forgot to re-generate the gamelist.
I would think there is a way to paste all the video paths to all games at once. Am I wrong? Thanks
No idea what happened on your mame-libretro folder, looks like the gamelist is correct, so I don't understand why it's now showing the artwork in EmulationStation. You can check if the paths referenced in the gamelist.xml file are correct (i.e. the video/image files are present on-disk), maybe they are missing (but you said they're present, so probably not).
@mitu. Hi, at first the omxplayer was on, as the tutorial suggested and then after reading a long winded forum about this issue, one of the things was to turn it off. So I did but still had stay issue.
I thought it could have been a bad skyscraper install, so I also uninstalled that but same issue.
So I left it a while to register on here and it wrack my brain around it.
Then, even though I did a script update and I knew I had the latest retropie installed cos I'd only just done it from the site a couple of days ago. I decided to do it again, the script took no time at all, the main update this time took 2 hours. I rebooted and for some reason it all works fine now, no freezing. So I put the omxplayer back on and it's still fine. Haven't yet re installed skyscraper but I don't know if it now works because of that or a second update after the preview videos where on.
Either way it works now.
Thanks for commenting anyway.