@Lolonois I now have an issue where it's scraping some systems and not others, and when I scrape individual systems, some of the scraped systems are undone.

Could this be because I moved the cache folder?

@geese-howard ok thanks, cause it's not on the webpage, but other service like retropie are in.

@Crush That is also an option, but sometimes I'd rather get everything scraped on a separate hard drive. Just makes me feel more secure in various ways. I'm probably just silly.

@zombie_ryushu said in Issues with local Screenshots and Migration:

AARM and Skraper appear to be Windows Specific Applications

Yes, but that doesn't mean they can't run on Linux. For Linux, you can try Skyscraper, has a lot more flexibility than the built-in EmulationStation scraper.

For example I only want the cover art as my image. Not a 3D-rendered box, not the composite screenshot with box and wheel art, just the flat 2D cover art. So I point my config.ini at a custom artwork-cover.xml and that looks like:

<?xml version="1.0" encoding="UTF-8"?> <artwork> <output type="screenshot" resource="cover"/> <output type="marquee" resource="wheel"/> </artwork>

Note, the output uses type="screenshot" resource="cover". This still puts the image in the "screenshots" folder; that's just how it works. Whatever you define as "screenshot," that's what gets put in the gamelist <image> tag. (Again, this for ES, I don't know how it might be different for Pegasus FE.) But I use the "cover" resource and so the image that appears in my gamelist is a picture of the cover, not a screenshot, even though it's called "screenshot."

If you want raw cover, screenshot, wheel and marquee outputs, use artwork.xml.example2:

<?xml version="1.0" encoding="UTF-8"?> <!-- This example simply exports the raw unedited versions of each artwork type coming directly from the scraping source --> <artwork> <output type="cover"/> <output type="screenshot"/> <output type="wheel"/> <output type="marquee"/> </artwork>

The default artwork.xml only outputs two images, but one of them has many layers, and between them it uses three of the four resources (the "marquee" resource is not used. Note that even in the output node called "marquee," it uses the "wheel" resource instead):

<?xml version="1.0" encoding="UTF-8"?> <!-- This is the default artwork.xml provided by Skyscraper. More examples can be found in '~/.skyscraper'. Be sure to check the full artwork documentation here: https://github.com/muldjord/skyscraper/blob/master/docs/ARTWORK.md --> <artwork> <output type="screenshot" width="640" height="480"> <layer resource="screenshot" x="20" width="520" height="390" align="center" valign="middle"> <rounded radius="10"/> <stroke width="5"/> </layer> <layer resource="cover" height="250" x="0" y="-10" valign="bottom"> <gamebox side="wheel" rotate="90"/> <shadow distance="5" softness="5" opacity="70"/> </layer> <layer resource="wheel" width="250" x="-10" align="right"> <shadow distance="5" softness="5" opacity="70"/> </layer> </output> <output type="marquee" resource="wheel"/> </artwork>

@retrotarta i made the same experience with screenscraper.
Usually he finds the metadata for a rom by the third to fith try.
I dont know why, maybe too much traffic for a small server?

@eg500 probably because you had existing gamelists in there which took priority.

@mitu I just want to confirm that everything has worked perfectly now, just some minor things that will require manual tweaking, but overall, everything worked and managed to scrape everything nicely.

Thanks mitu and sleve_mcdichael

@bpjerseyboy said in Skyscraper Stopped Passing Credentials to Screeenscraper:

@mitu Many thanks. Oddly the config file has always been this way and it has worked in the past. I will update this and report the result.

Unless it has been using a config file from somewhere else where it was entered correctly, this is impossible. It only works if entered as @mitu described. :) I should know, I wrote the software. And if a [screenscraper] section isn't found, it won't use the credentials.

@mitu Yep, same result as you. API issue. I'll wait it out. I'm sure they are trying to get their servers to behave.

------------------------------------------- Running Skyscraper v3.6.12 by Lars Muldjord ------------------------------------------- Platform: 'pcengine' Scraping module: 'screenscraper' Input folder: '/home/pi/RetroPie/roms/pcengine' Game list folder: '/home/pi/.emulationstation/gamelists/pcengine' Covers folder: '/home/pi/.emulationstation/downloaded_media/pcengine/covers' Screenshots folder: '/home/pi/.emulationstation/downloaded_media/pcengine/screenshots' Wheels folder: '/home/pi/.emulationstation/downloaded_media/pcengine/wheels' Marquees folder: '/home/pi/.emulationstation/downloaded_media/pcengine/marquees' Cache folder: 'cache/pcengine' Fetching limits for user 'devildog820', just a sec... Setting threads to 8 as allowed for the supplied user credentials. Reading and parsing quick id xml, please wait... Done! Reading and parsing resource cache, please wait... Done! Successfully parsed 0 resources! Looking for optional 'priorities.xml' file in cache folder... Found! Priorities loaded successfully! Trying to parse and load existing game list metadata... Success! Starting scraping run on 94 files using 8 threads. Sit back, relax and let me do the work! :) #12/94 (T3) Pass 1 ---- Game 'Bonk's Adventure (USA)' found! :) ---- Scraper: screenscraper From cache: NO Search match: 100 % Compare title: 'Bonk's Adventure' Result title: 'Bonk's Adventure' () Platform: 'PC Engine' () Release Date: '1990-01-01' () Developer: 'Atlus' () Publisher: 'Hudson' () Players: '1' () Ages: '' () Tags: 'Platform' () Rating (0-1): '0.8' () Cover: NO () Screenshot: NO () Wheel: NO () Marquee: NO () Description: () 'Bonk's Adventure is a prehistoric platform game where you are in control of a large bald headed caveman, guiding him through the levels taking out all manner of strange prehistoric creatures that get in your way including King Drools henchmen - all in effort to free the captured/controlled residents of Moonland (bosses) - including the Princess Za from King Drool attempted take over. The game is not unlike other platform games of the era. Though it's unique in that you can climb walls and swing on rope with your teeth and your only method of attack is head butting enemies - straight forward or dive bomb style. The game starts off with simplistic point A to point B style, but focuses more on exploration in the later stages, which include finding hidden bonus areas. The game is also known for its trademark gameplay mechanism of 'spin attack', where Bonk floats through the air if you have the turbo button on. This can be used to float around the level and reach areas for extra/hidden items, but also as a method of attack as well. The game starts you off with 3 hearts, but allows you to increase this number when you find special heart container items, allowing Bonk to take a number of hits before dying. A variety of bonus stages can be found throughout the game, which provide bonus points upon completion and thus resulting in accumulating extra lives. Enemies themselves can be 'milked' for points in that you can keep 'bonking' their dead bodies and not letting them hit the ground. Spin attack is another method for doing this.' 'screenscraper' requests remaining: 37193 #12/94, (12/0) Elapsed time : 00:00:42 Est. time left : 00:04:49

@mitu yes in this case "tweaking" does refer to uncommenting all the lines which I read was necessary when doing this. I'll re-comment them and see what happens . Thanks!

NEW Experimental PiBoy Discord!
Alright.. I've been using the Eperimental Pi PiBoy w/ various Linux distros and it feels like the developer / creator is extremely busy to help most of the time..
I created a PiBoy Experimental Discord for discussions , ideas and help.
https://discord.gg/rcQdmv6Uxr

If you have one, come join...
Cheers..

Ok so I've found out why, for anyone that could find this thread later on, with the same issue. It is far simple as Skyscrapper, at the time of this posting, does not support Famicom and Super Famicom as a platform. Maybe in a futur update? Maybe never? We'll see in time.

For now I've placed my Famicom in my NES rom and Super Famicom in my SNES folder and did the scrape. Then I moved it back to the famicom and sfc folder respectively, including the gamelist.xml and the media folder.

It's a bit of a hassle, but it get the job done.

URL to the supported Skyscrapper platform :
https://github.com/muldjord/skyscraper/blob/master/docs/PLATFORMS.md

@mitu Thank you!

@tpr glad you like it. for basic stuff it was really good.

TODAY Update from ScreenScraper.fr

RedblueflameAujourd’hui à 12:41
Hi everyone !
After a pretty long downtime (we're sorry about that), the screenscraper servers are finally back on ! To prevent our servers to melt down due to the massive influx of requests, they are running with a limited number of concurrent requests, so you may experience latency problems as the queue grows up.
We wanted to thank everyone with your kind messages sent on our discord server, and happy scrapping !
The screenscraper team

RedblueflameAujourd’hui à 15:53
Hi everyone !
Until tomorrow, the access to the website will be cut off. Until then, the website won't be available, but the api will. Your scraps should still be working.

@HipsterDuRocher Thanks for the offer. We wouldn't be able to link anything in with subscribers as I can't share any data with external sites.

Not sure what you had in mind, but even if it was possible I lack free time to do any sort of collaborative work. Sorry.

But wish you all the best with your site and thanks for your efforts.

This is undoubtedly because ScreenScraper requires the hash of the files. It take a looong time to hash those PSX files. Nothing that can be done about that. Luckily Skyscraper has a system I dubbed QuickId which saves the hashes and only rehashes when the file has changed on the disk. So for any game list regeneration it will be fast. But the first time any file is hashed, it will have to calculate it from the data inside the file.

EDIT: I spoke too quickly... My QuickId system is only used for the internal Skyscraper ID's... I should fix that, but I'm not actively developing Skyscraper right now, so you will have to live with it for PSX for the time being I'm afraid.

Optimally the Skyscraper internal ID's should use hashes. But i limited it to only hash files when they are smaller than 50 megs I think (because it would take too long for bigger files, which is also the issue here). So for anything above that, it simply hashes the filename. And it's one of those things where it could easily be made to always use hashes for the full files, but then I would break the caches of every single Skyscraper user. Can't do that... Ugh. I really should have given those ID's more thought back when I designed it two years ago. Keeps coming back to kick me in the behind. :(

@mitu

Ah, I see, maybe one for the future.
Thanks for the reply anyway.

I discovered a little workaround if anyone is interested. It works for me because I don’t use video clips on my game menus.
Simply put the video you want to act as screensaver in a folder of your choice, and link it to a game using the metadata options. Of course that video will be displayed when you scroll over the game, but it will also be picked up by the random video screensaver.