Skyscraper not gathering [solved]

[Flexo55]

I am having an issue with Skyscraper and I am very new to all this. Here is the information about the Pi:

Pi model: Raspberry Pi 5
Power Supply used: Official Raspberry Pi 5 power supply
RetroPie Version used: 4.8.8
Built from: Official RetroPie Image, Raspberry Pi 5, Raspberry Pi OS LITE 64 bit.
USB Devices: Currently only a wireless keyboard.

This afternoon I attempted to use Skyscraper to gather resources to include video. I have a 512 GB Micro SD card with the current systems on it:

Atari 2600
Game Boy Color
Game Boy Advance
SNES
Master System

I set the scraper to gather resources on all of them, roughly 2800 roms. The scraper got through Atari 2600 and Game Boy Advance then said all resources were gathered and not to forget to generate a games list, which I did. I checked the Atari 2600 and Game Boy Advance, and both have a video preview and description. The others did not. The roms do work on the other systems.

I tried to scrape the other systems independently but when I try, it still says all resources gathered, almost immediately after it starts. Again no game description and no video preview. I tried to use "df - h" to check and see if I was out of room on the SD card but it said something like command not found. So I am not sure if its because I do not have enough room on the card or some other issue?

Something I am doing wrong? Doing to much at once? I would appreciate some guidance.

Thank you!

[Lolonois]

Hi there, thanks for being as precise in the beginning.

Let's breakdown it a bit:

1. Does df -h provide you an output on your Pi?
   No: SD card most likely full
   Yes: continue

2. Some scrapers (e.g. screenscraper) do have a limit on how many requests you can use per day (or a month in case of the games db). When scraping with screenscraper, does it report how many requests are left and is this number > 0?
   No: Wait until you get a new batch of requests assigned.
   Yes: continue

3. Do you use the default system folders for Game Boy Color (= ~/RetroPie/roms/gbc)?
   No: Do use the default system folders (see RetroPie Docs or look at the top level entries in ~/.skyscraper/peas.json for the expected folder names.
   Yes: continue

4. Scrape a single ROM for the system you are missing videos.
   e.g. Skyscraper -p gbc -s screenscraper ~/RetroPie/roms/gbc/<romfile>. Maybe you have to add the --query parameter to hint Skyscraper and the scraper to the ROM with the matching name. Use a ROM as sample which is very likely to be in the scraping DB. Check after the scraping if you have a video: Skyscraper --cache report:missing=video -p gbc. Look in ~/.skyscraper/reports/report-gbc-missing.txt if the scraping of a video was successful the romfile name should not be in the textfile.
   ROM has video in cache: continue.
   ROM has no video in cache: Maybe for that rom there is no video or there is a video but it's size is larger than videoSizeLimit (https://gemba.github.io/skyscraper/CONFIGINI#videosizelimit)

If you end up here you crossed out the main issues which may hinder you in scraping videos.

One more thing: Make sure you only have videos=true set in the [main] section of Skyscraper's config.ini.

[Flexo55]

@Lolonois Thank you for your help!

When I first tried df -h I only had one space as that is what I had read in another post. I did two spaces as your post suggested and that worked! I still have 428 GB available.

I tried to run the scraper again and video recorded it as the screen changes to quickly for me to be able to read it. Once I paused the video, I did see that I reached my limit for 24 hours. So I waited until that timer had elapsed and tried again with success!

I wouldn't have tried that without your input, thank you!

[Lolonois]

@Flexo55 Good you did find the cause. Please, as a courtesy to other users of this forum, do edit your first post and add to the subject something like [solved].