Skyscraper downloads gamelist and artwork, but does not link artwork <SOLVED>

EviLEd

Skyscraper v3.1.4 installed through retropie_setup.sh
RetroPie v4.4 (ran all updates)
Pi Model: 3b+

Similar to issues reported here and here

I have not tried v3.1.5 (In progress, unreleased) yet: https://github.com/muldjord/skyscraper

I pressed F4 to close EmulationStation before scrapping. This is a new/clean RetroPie install.

I can see all of the artwork here: /retropie/configs/all/skyscraper/cache

I created the game lists which i can see here for example: /retropie/configs/all/skyscraper/cache/atari7800/db.xml

When i look at any of the systems through EmulationStation they are all missing the metadata for the games and artwork. Is there a config file that i can check to see why the games are not linking to the artwork? Thanks.

mitu

@EviLEd said in Skyscraper downloads gamelist and artwork, but does not link artwork:

I created the game lists which i can see here for example: /retropie/configs/all/skyscraper/cache/atari7800/db.xml

That's not a gamelist, it's the internal Skyscraper cache index.
Did you run the Generate game list(s) step after scraping ?

EviLEd

@mitu said in Skyscraper downloads gamelist and artwork, but does not link artwork:

Did you run the Generate game list(s) step after scraping ?

Yes i did. Where does that game list reside?

mitu

@EviLEd It depends on what option you've chosen in Skyscraper (https://retropie.org.uk/docs/Scraper/#using-skyscraper). If you use the default option, then it's in ~/.emulationstation/gamelists/<system>, if you use the ROM folders' option, then it's in the system's ROM folder.

EviLEd

I left everything default and /retropie/configs/all/emulationstation/gamelists/atari7800 was empty. I have only seen the built-in/default scraper for RetroPie place gamelist.xml here. After running "Generate game list(s)" again, a gamelist.xml was created in this directory. I have ran Generate game list(s) many times over the past 2 days and gamelist.xml was never generated. The only difference this time, was that the collection of the artwork and creation of gamelist.xml was about 12hrs apart.

With that said it, it is now working. I tried it with another system and the artwork is showing up there too. Thank you for your help.

EviLEd

I selected 6 system to scrape (generate game lists) at once. It ran through the first 2 (Genesis/Megadrive)fine. The last 4 (NES, Ports, SegaCD and SNES) did generate a gamelist.xml, but they are mostly empty. The screen output stated the games could not be found, and the last of systems never completed. I SSH in and ran htop, but the Pi had plently of resources available. Maybe the source, ScreenScraper, only allows so much scraping within a certain time period if you don't have an account?

mitu

@EviLEd said

Maybe the source, ScreenScraper, only allows so much scraping within a certain time period if you don't have an account?

If their site is busy, un-registered users will be put on hold and scraping will return nothing. Try again later and scrape one system at a time.

EviLEd

My thoughts exactly. But when i use my credentials and try one system at a time the results are the same.

mitu

@EviLEd So, your problem is that the artwork/metadata is not found on the site or the gamelist is not generated with that data ?
Can you give an example ROM name which is not found on the scraping site (ScreenScraper) ?

EviLEd

@mitu Both the metadata and artwork are not found on ScreenScraper. Nothing was found for NES, SegaCD and SNES. Yet systems like NeoGeo, Genesis, Megadrive and Atari 7800 work fine for both metadata and artwork.

This time, I tried to scrape within RetroPie using the built-in/default scraper. I changed the option to use ScreenScraper as a source and no roms were scraped. Pressing F4 to exit EmulationStation shows an error "lv10: ScraperHttpRequest network error (status: 2) - SSL peer certificate or SSH remote key was not OK". You already responded to someone else with this issue here.

So once again i opened the terminal and tried to generate a game list for NES only. The game list would not generate but now the artwork is downloading . I will try to generate the game list again after the artwork is complete.

Forcing 1 threads as this is the anonymous limit in the ScreenScraper scraping module. Sign up for an account at https://www.screenscraper.fr and support them to gain more threads. Then use the credentials with Skyscraper using the '-u [user:password]' command line option or by setting 'userCreds=[user:password]' in '~/.skyscraper/config.ini'.

In /retropie/configs/all/skyscraper/config.ini , userCreds was commented out.

Looks like i will need to enter everything from the command line as one user suggested.

EviLEd

This appears to be working for the artwork.

If installed through RetroPie, first create symbolic link: sudo ln -s /opt/retropie/supplementary/skyscraper/Skyscraper /usr/local/bin/Skyscraper

Command line example for SNES in the USA region with use with EmulationStation: Skyscraper -p snes -s screenscraper -u username:password --unattend --nohints --region us

Command line options

/retropie/configs/all/skyscraper/config.ini

Config.ini options

Config.ini region options

EDIT: After the artwork is downloaded i was able to generate gamelist.xml.