@muldjord said in Skyscraper not writing to mounted emulationstation NAS folder:

@beatbox32 Everything looks good, including your mount. Did you remember to re-generate the gamelists from the RetroPie Skyscraper script? Scraping the data simply add it to the Skyscraper cache located at /home/pi/.skyscraper/cache (which is also a symbolic link if you installed Skyscraper from the RetroPie script). But you need to re-genereate the gamelists for it to create the necessary ES gamelist.xml files and artwork files in the /home/pi/.emulationstation/downloaded_media/ platform folders.

Remember to push space for each platform when generating the gamelists to select them.

EDIT: Skyscraper also checks if gamelist.xml is writable before it starts. It won't run unless it is.

Boom! Now it's working. Many thanks for the education on how the cache system works. I think I had a few missteps along the way where I was mounting the media folders as root and not the pi user, running into write issues initially. Once I resolved that, I apparently forgot to re-generate the gamelist.

All good now. Thanks again!

-beatbox32

@cousinsfan

and now all the names are the right names - not the romnames - meaning....did it take time to "read" the names from the xml and this took time (overnight - but probably quicker of course)??

No, it's instant. Maybe you had two different gamelist.xml's and deleted one and didn't realize the other had the correct names?

forcefilename is the only thing I can think to change...would that work?

Yes. :)

@mitu Thanks, you rock!

@muldjord said in Skyscraper not gathering resources:

@tafkab76 Allow me to laugh a bit and still be glad that you solved it, however silly it was. :)

Sure!

@mitu Sorry, that's what I meant, but thank you for clarifying. I'm thinking of trying again with a single emulator and see if it works. Does that make sense?

@colombia20102018 said in Video paths not showing on Emulationstation:

I would think there is a way to paste all the video paths to all games at once. Am I wrong? Thanks

No idea what happened on your mame-libretro folder, looks like the gamelist is correct, so I don't understand why it's now showing the artwork in EmulationStation. You can check if the paths referenced in the gamelist.xml file are correct (i.e. the video/image files are present on-disk), maybe they are missing (but you said they're present, so probably not).

@mitu. Hi, at first the omxplayer was on, as the tutorial suggested and then after reading a long winded forum about this issue, one of the things was to turn it off. So I did but still had stay issue.
I thought it could have been a bad skyscraper install, so I also uninstalled that but same issue.
So I left it a while to register on here and it wrack my brain around it.
Then, even though I did a script update and I knew I had the latest retropie installed cos I'd only just done it from the site a couple of days ago. I decided to do it again, the script took no time at all, the main update this time took 2 hours. I rebooted and for some reason it all works fine now, no freezing. So I put the omxplayer back on and it's still fine. Haven't yet re installed skyscraper but I don't know if it now works because of that or a second update after the preview videos where on.
Either way it works now.
Thanks for commenting anyway.

@muldjord just want to throw out there this did not work for me, when i gather resources it says yez for every video, when i generate the gamelist it still says no for the video

@clyde his accent is surprisingly Dutch when speaking English. The r’s for example.

@muldjord
Thank you for your answer. And congratulations on your fantastic work on the Skyscraper, the best multi-platform scraping tool, in my opinion.

Actually, I'm not very comfortable with the process of adding a .m3u file to each of my 2500+ individual Amstrad CPC games (or to every game in my other retro-collections).

And, @mitu, I'm not comfortable neither with the idea of adding a non-standard extension to my games, just to have ES showing the .m3u playlists only. I understand that ".cd1", ".cd2", etc. are like a standard now in PSX multi-disc games, but I suspect a home-made ".dsm", ".disk1" or whatever I could invent in my room for Amstrad CPC/MSX/other Libretro would drive me to a lot of issues when I update/scrape/configure something in the future. The same applies to hidden folders: if I want to update the scraping info, I would have to rename the folder before, re-hide the folder after... Even the idea to manage ".disk1" or ".disk2" sounds laborious when you have hundreds of folders, thousands of files...

But, I still think one scrapped entry in ES for a multi-disc game sounds like the most elegant solution.

So, I share here the solution I took:
1- As mentioned before, I create a .m3u playlist for each multi-disc game and put all the files, including the .m3u, inside a folder with the same basename (I do this with the script in my first post)

2- As @mitu told me, I edit the Skyscraper's config.ini to add the .m3u extension at the platform I want to scrap.

3- I scrap everything. So regular files, regular files in subfolders, and .m3u files get an image+description in gamelist.xml.

4- I duplicate the information related to the .m3u files in the gamelist.xml to create new <folder> sections with the same scraped information. Here is the command lines I used to do this:

# extract the XML sections about .m3u files to a new tmp.xml file perl -ne 'BEGIN{$/="</game>\n";} print m|(<game>.*m3u.*$/)|ms' gamelist.xml >> tmp.xml # change any <game> tag to a <folder> tag sed -i .bak "s/<game>/<folder>/g" tmp.xml # change any </game> tag to a </folder> tag sed -i .bak "s/<\/game>/<\/folder>/g" tmp.xml # crop any .m3u filename to keep the path only sed -i .bak 's/\/[[:alnum:][:blank:]\.\+\&,\(\);_-]*.m3u//g' tmp.xml # delete the closing tag at the end of gamelist.xml sed -i .bak '/^<\/gameList>/d' gamelist.xml # add the content of tmp.xml to the end of gamelist.xml cat tmp.xml >> gamelist.xml # add the closing tag at the end of gamelist.xml echo "</gameList>" >> gamelist.xml

And I must say, I'm quite happy with the result : now I have in ES only one scraped entry for any mono-disc game as I have one scraped entry for any subfolder (multi-disc game). When I select a game that is a multi-disc game, It opens the sublist - that is also scraped with the same information - and I just have to select the first entry to run the game.

I hope all this sounds useful.

Ok so I've found out why, for anyone that could find this thread later on, with the same issue. It is far simple as Skyscrapper, at the time of this posting, does not support Famicom and Super Famicom as a platform. Maybe in a futur update? Maybe never? We'll see in time.

For now I've placed my Famicom in my NES rom and Super Famicom in my SNES folder and did the scrape. Then I moved it back to the famicom and sfc folder respectively, including the gamelist.xml and the media folder.

It's a bit of a hassle, but it get the job done.

URL to the supported Skyscrapper platform :
https://github.com/muldjord/skyscraper/blob/master/docs/PLATFORMS.md

@dmonlrd You need to edit your /home/pi/.skyscraper/config.ini. It's explained here

@mitu Thank you!

See https://retropie.org.uk/docs/Scraper/#where-are-my-scraped-media-and-metadata-saved.

Skyscraper cache folder is in $HOME/.skyscraper/cache, this is where downloaded media/artwork is primarily stored and used to generate the gamelists.

@muldjord Great insights, and thanks so much for everything you’ve done with Skyscraper! I really do like it a lot!

So I’m pretty sure it’s not the SD card. It was purchased brand new about a month ago and once I re-flashed from a previous back up and went back through the steps, everything seems fine now. But yea, I’m sure I must’ve done something or something else may have coincidentally been going on. Especially after reading your comments about how the tool works.

In any event, keep up the great work!!

Disregard. I figured out the issue. I originally downloaded a Romset and it had a Gamelist included. So I guess if a gamelist is already in the rom folder, it ignores the one in config.

Sorry for the inconvenience.

The lingering 20 GB won't do anything detrimental to your system. So, if you don't need the space, I would just leave them there in the case that you'll need them sometime in the (far) future.

Another reason could be that the rom name doesn't match the video name.

This is undoubtedly because ScreenScraper requires the hash of the files. It take a looong time to hash those PSX files. Nothing that can be done about that. Luckily Skyscraper has a system I dubbed QuickId which saves the hashes and only rehashes when the file has changed on the disk. So for any game list regeneration it will be fast. But the first time any file is hashed, it will have to calculate it from the data inside the file.

EDIT: I spoke too quickly... My QuickId system is only used for the internal Skyscraper ID's... I should fix that, but I'm not actively developing Skyscraper right now, so you will have to live with it for PSX for the time being I'm afraid.

Optimally the Skyscraper internal ID's should use hashes. But i limited it to only hash files when they are smaller than 50 megs I think (because it would take too long for bigger files, which is also the issue here). So for anything above that, it simply hashes the filename. And it's one of those things where it could easily be made to always use hashes for the full files, but then I would break the caches of every single Skyscraper user. Can't do that... Ugh. I really should have given those ID's more thought back when I designed it two years ago. Keeps coming back to kick me in the behind. :(

that worked. thanks both of you @mitu @muldjord