Versatile C++ game scraper: Skyscraper

muldjord

@Clyde Probably not if it's just the old API (which I think it is). I think we'll just have to wait this out until it's back online in v2.

EDIT: After re-reading their message a couple of times I think I get it. The 'v1' will stay, even when they get a more recent backup imported. So I've added the 'v1' prefix, and release 3.3.6.

muldjord

Skyscraper 3.3.6 released: https://github.com/muldjord/skyscraper

Skipped file now includes platform in the filename (Thanks to 'parker-hemphill' for suggesting this)
Now handles the '****' error message from ScreenScraper (Thank you to 'GiulioCentorame' for reporting this)
Updated 'thegamesdb' to include the 'v1' prefix (Thank you to 'Clyde' for letting me know)

This release fixes the 'thegamesdb' module, but be aware that their database is currently running on an old backup due to the December server shutdown. Thank you to @Clyde for letting me know about the 'v1' prefix. In other words: Updating to this release will make 'thegamesdb' work with Skyscraper again, but with old data. They are planning to get back to a more recent version soon, but it will still require the v1 prefix as I understand it, so it will work regardless.

steptoe

@muldjord said in Versatile C++ game scraper: Skyscraper:

Skyscraper 3.3.6 released: https://github.com/muldjord/skyscraper

Skipped file now includes platform in the filename (Thanks to 'parker-hemphill' for suggesting this)

Now handles the '****' error message from ScreenScraper (Thank you to 'GiulioCentorame' for reporting this)

Updated 'thegamesdb' to include the 'v1' prefix (Thank you to 'Clyde' for letting me know)

This release fixes the 'thegamesdb' module, but be aware that their database is currently running on an old backup due to the December server shutdown. Thank you to @Clyde for letting me know about the 'v1' prefix. In other words: Updating to this release will make 'thegamesdb' work with Skyscraper again, but with old data. They are planning to get back to a more recent version soon, but it will still require the v1 prefix as I understand it, so it will work regardless.

Your unofficial Windows version is on 3.30. I'm trying to compile the latest versions but not 100% what I need to compile. You give basic compile instructions for OSX and Linux but not Windows so can't really try SkyScraper fully on the PC. Thanks

muldjord

@steptoe It's not unofficial, it's just not officially supported (I don't use Windows). I know it's old, for that very reason. If I get the time today, I will create a 3.3.7 version of the Windows version.

EDIT: Windows version now updated to 3.3.7. Get it here

o0alucard0o

@muldjord

Thanks so much for this fantastic scraper ;-)

I'm trying to scrape igdb, but with no results

For example

Skyscraper -p steam -i /Volumes/Games/Roms/Steam -g "/Volumes/Games/Attract-Mode/romlists_b" -o "/Volumes/Games/Attract-Mode/scraper/Steam_b" -f attractmode -e "/Users/matteo/Games/skyscript-nuc-one/Steam.cfg" --addext "*.bat" --nosubdirs --nobrackets --unattendskip -s igdb -u IGDBKEY --pretend --verbosity 3

--- The following is a list of skipped games ---
'Cuphead', No returned matches
'GRIS', No returned matches
'Hollow Knight', No returned matches
'Monster Boy And The Cursed Kingdom', No returned matches
'My Friend Pedro', No returned matches
'Neon Chrome', No returned matches
'Nex Machina', No returned matches
'Ori and the Blind Forest Definitive Edition', No returned matches
'PinballArcade', No returned matches
'TrackMania Nations Forever', No returned matches

I'm able to find game through web interface

(sorry for my english)

muldjord

@o0alucard0o I just tried with "My Friend Is Pedro" and indeed something seems to be wrong... I'll look into it, stay tuned.

o0alucard0o

@muldjord Unfortunately I get the same result with "pc".

muldjord

@o0alucard0o I've found the error, I'll release 3.3.8 with this fixed in a minute.

EDIT: 3.3.8 now released, please update and try again.

o0alucard0o

@muldjord now works! thank you :-)

muldjord

@o0alucard0o And thank you for reporting it! :)

steptoe

@muldjord said in Versatile C++ game scraper: Skyscraper:

@steptoe It's not unofficial, it's just not officially supported (I don't use Windows). I know it's old, for that very reason. If I get the time today, I will create a 3.3.7 version of the Windows version.

EDIT: Windows version now updated to 3.3.7. Get it here

Any chance of explaining briefly how you compiled it, if you don't use windows, that way you don't have to compile a version for us windows users for every release. Now you are on 3.3.8 already

Thanks for the quick response and 'unofficial' windows version

muldjord

@steptoe It's way too much to cover I'm afraid. On Linux and macOS it's quite simple due to their relatively standardized nature. Not so much for Windows. I will try to update it semi-regularly though. 3.3.8 is on there now.

jrbbib

i have a question as to the location of all the stored files. would it be possible to be able to move it to where the roms ,bios, and themes folders are? when i connect to pi with windows pc this folder is what i can access. so when i make a backup it would be right there with the main files and would make transfer easier.

mitu

@jrbbib The cache should be in the \\retropie\configs\all\skyscraper folder, which is accessible via file shares if you want to make a backup from your PC.

jrbbib

@mitu ok thank you! i kept getting lost with the tree list. when i use file browser i put in IP of pie, there are only a few dir i can see(bios, configs, roms, and splashscreens). i missed the config when i saw where they said files go in this discussion. thank you again

muldjord

@jrbbib What stored files are you referring to? The Skyscraper resource cache or the exported media? Both can be changed in the Skyscraper configuration. Please check the documentation on that here. Look for the cacheFolder option and the mediaFolder option.

steptoe

@muldjord Thanks for the extra efforts for us windows users

quicksilver

Is it possible to adjust settings in the artwork.xml for certain systems only? For example if I wanted only screenshots displayed, but just for arcade?

I searched the documentation but either couldn't find anything or missed it.

muldjord

@quicksilver Yes, just create individual artwork.xml files for the platforms and enter them into the config.ini's platform sections. For instance like so:

[amiga]
artworkXml="artwork-amiga.xml"

You can also do it similarly for different frontends like so:

[pegasus]
artworkXml="artwork-pegasus.xml"

It's documented here

quicksilver

@muldjord thank you so much, knew it had to be there somewhere. Skyscraper can do it all!