Skyscraper - Gamelist Assembly Hangs - No Gamelist Generated

[jollyrancher]

Hi there.

Recently ran out of space on the microSD card during a scrape using Skyscraper. To recover I moved the cache folder to the external USB (/media/usb/retropie-mount/cache/) and set in the config.ini (/home/pi/.skyscraper/config.ini, which points to /opt/retropie/configs/all/skyscraper/config/ini), which I've pasted below (after removing any # lines to save space):

[main]
inputFolder="/home/pi/RetroPie/roms"
excludePattern="*[BIOS]*"
cacheFolder="/media/usb/retropie-mount/cache"
spaceCheck="false"
[esgamelist]
cacheRefresh="true"
[import]
cacheRefresh="true"

df reveals 5GB space remains so good there.

I'm running the scrape and generate via RetroPie (F4, sudo ./retropie_setup.sh, etc..) and the cache generates properly where I would expect.

However, when I go to generate the gamelist now (with Use Rom folders for game list and media enabled, as in the past) it runs through exactly as I would expect, showing populated XML nodes flashing across the screen), but at the end I get:

Writing quick id xml, please wait!... Done!
Sorting entries.... Done!
Assembling game list...'

Here it hangs and the only way out is CTRL+c.

Launching emulationstation afterwards, or checking the gamelist in /opt/retropie/configs/all/emulationstation/gamelists/amiga/ it only has the following entry:

<?xml version="1.0"?>
<gameList>
	<game>
		<path>./+Start Amiberry.sh</path>
		<name>+Start Amiberry</name>
		<playcount>1</playcount>
		<lastplayed>20240404T074759</lastplayed>
	</game>
</gameList>

Purging the cache, which I don't think would help, shows:

Nothing to delete! No cached platforms found in /opt/retropie/configs/all/skyscraper/cache.

That would lead me to think that the cache pointer isn't working, except that generating the gamelist shows data on the screen, but just won't finish generating the file.

It's a larger collection (~3000) in sub-folders, but that hasn't been an issue before (just trying to give as much information as possible).

Any ideas? I've attached the base information requested below a well. Thanks!

Pi Model or other hardware: Raspberry Pi 4 2GB Model B with 1.5GHz 64-bit quad-core CPU (2GB RAM)
Power Supply used: CanaKit 3.5A USB-C Raspberry Pi 4 Power Supply with Noise Filter 
RetroPie Version Used: 4.8.6
Built From: pre-made image, then updated via RetroPie Setup
USB Devices connected: 0.5TB attached via retropie-mount for ROMs
Controller used: Hikig New Updated Version 2-Player LED Arcade DIY Kit - 2X Zero Delay LED USB Encoder + 2X Arcade Joystick + 20x LED Arcade Buttons for MAME, PC, Windows, Raspberry Pi, Arcade1Up (Red & Blue Kit)
Error messages received: 'Updating game list...' <-- hangs here
Verbose log (if relevant): N/A
Guide used: https://github.com/muldjord/skyscraper?tab=readme-ov-file
File: attempting to generate gamelist.xml for amiga (/opt/retropie/configs/all/emulationstation/gamelists/amiga/)
Emulator: N/A

[Lolonois]

Quick Q: Can you provide the skyscraper version (from the command line issue Skyscraper -v)?

I assume it will work when taking the scriptmodule (via retropie_setup.sh) out of the mix: Does it work when you run Skyscraper -p amiga to generate a gamelist?

If yes: Create a symbolic link to your new cache location. As user pi, e.g.

cd .skyscraper
ln -s /media/usb/retropie-mount/cache cache # move away the old ~/.skyscraper/cache folder if this command fails

Try to rerun scraping from retropie_setup.sh. Does it work now?

If no (in both cases): Something else is odd.

[jollyrancher]

@Lolonois said in Skyscraper - Gamelist Assembly Hangs - No Gamelist Generated:

Quick Q: Can you provide the skyscraper version (from the command line issue Skyscraper -v)?

v3.11.1

I assume it will work when taking the scriptmodule (via retropie_setup.sh) out of the mix: Does it work when you run Skyscraper -p amiga to generate a gamelist?

Seemed to hang in the same spot. Prior to all this I did a completely fresh install from image across the board to eliminate all the years of tinkering (such as ditching the bezel project, etc, and started from scratch). I've noticed that there are gamelist entries for the entire Amiga dataset, but starting at about 'N' I get zero data other than the name; perhaps something, perhaps not. I have the amiga files broken down into 3 sub-folders as well.

If yes: Create a symbolic link to your new cache location. As user pi, e.g.

cd .skyscraper
ln -s /media/usb/retropie-mount/cache cache # move away the old ~/.skyscraper/cache folder if this command fails

I didn't create the symbolic link for now b/c it's reading from the cache properly, just struggling on this one to write. MAYBE I'll let it sit overnight and see if it's simply b/c the number of files is too big. I'm working through testing the other emulators as well. Might uncover something. Thanks!

Try to rerun scraping from retropie_setup.sh. Does it work now?

If no (in both cases): Something else is odd.