Moving Default Skyscraper to shared drive.

raulitob

I am using Skyscraper to scrape roms on a shared drive but as I did so I noticed it was maxing out my SSD card. Can I change the location of that data to my shared drive?
I did look into the config file but couldn't figure out where to do that exactly.

Thanks!

mitu

@raulitob I think the config.ini is pretty well documented - https://github.com/muldjord/skyscraper/blob/master/docs/CONFIGINI.md. What you're looking for the cacheFolder setting.

raulitob

Thanks for the reply!
so I have the config editor open and I see these 3 folders

#inputFolder="/home/pi/RetroPie/roms"
#gamelistFolder="/home/pi/RetroPie/roms"
#mediaFolder="/home/pi/RetroPie/roms"
#cacheFolder="/home/pi/.skyscraper/cache"
#importFolder="/home/pi/.skyscraper/import"

So for cacheFolder="/home/pi/.skyscraper/cache"

Do I remake that path on my shared drive? so for example

cacheFolder="//192.xxx.x.xxx/RetroPie/roms "

Thanks!

mitu

@raulitob

So for cacheFolder="/home/pi/.skyscraper/cache"
Do I remake that path on my shared drive? so for example
cacheFolder="//192.xxx.x.xxx/RetroPie/roms "

No, the path should be a normal path - Linux doesn't understand UNC paths. If you mounted your file share under the /path/to/drive folder, move the cache folder there and then set in the .ini file

cacheFolder=/path/to/drive/cache

Remove the #, since it's a comment sign - meaning anything after it (till the end of line) is not active.

raulitob

Ok got you.

So on the shared drive I need to move the contents of

"/home/pi/.skyscraper/cache"

to the shared drive

make a new folder called "/cache"

so the shared drive path should be

"/RetroPie/cache"

or should it be

"/RetroPie/pi/cache"

Or should it be

"d:/Retropie/pi/cache"

or

"xxx.xxx.x.xxx/RetroPie/pi/cache"

thanks!

raulitob

Hmm the /cache file is GIGANTIC

maybe it might be easier to delete it and then adjust the path in the config and rescrape?

Thanks!

mitu

@raulitob said in Moving Default Skyscraper to shared drive.:

maybe it might be easier to delete it and then adjust the path in the config and rescrape?

That's not what the cache is for - you should try and keep it. Please re-read my previous post the about how to move the cache. Which folder did you use to mount your file share ?

raulitob

My file share is on the d drive on my windows 8 pc.

Right now my roms folder is shared on that drive so my autostart.sh looks like

sudo mount -t cifs -o username=username,password=password //1xx.xxx.x.xxx/RetroPie/roms /home/pi/RetroPie/roms

So obviously i want skyscraper to save scrape information on that shared folder.

So your suggestion was

"move the cache folder there and then set in the .ini file"

So thats what I want to do

uncomment the "#" in front of

#cacheFolder="/home/pi/.skyscraper/cache"

Then should I just make an empty "/cache" folder on the share? so say

"/RetroPie/cache"

then change the path in the config.ini too

cacheFolder=d:/RetroPie/cache

Would that be the right path to put in the ini or should it be different?
Do I even need the d: in the path or how would the config.ini know its going to that
path on the shared drive? i think the naming of path to the shared drive is what i'm really
asking about .

Thank for your help.

mitu

You have to read more carefully:

If you mounted your file share under the /path/to/drive folder, move the cache folder there and then set in the .ini file
cacheFolder=/path/to/drive/cache

So, you mounted your file share as /home/pi/RetroPie/roms, in this case move the cache folder in /home/pi/RetroPie/roms and add the corresponding line in config.ini.

cacheFolder=/home/pi/RetroPie/roms/cache

I told you, Linux doesn't understand UNC paths (//xx.yyyzz../) and the d:/blah doesn't make sense on Linux, it's a Windows path.

raulitob

Ok so I made the cache folder in the shared drive

/RetroPie/roms/cache

I then edited the config.ini too

cacheFolder="/RetroPie/roms/cache"

I ran the scraper to scrape for atari2600

The scraper ran for a second then went back to the menu.

I then checked the folder on cache drive and nothing was populated.

So obviously I have the path wrong

Thanks!

mitu

@raulitob I'm sorry, but you're not even trying to read what I said. Can you run, from the command line

ls -l  /RetroPie/roms/cache

and post the output ?

raulitob

@mitu said in Moving Default Skyscraper to shared drive.:

ls -l /RetroPie/roms/cache

pi@retropie:~/RetroPie $ ls -l  /RetroPie/roms/cache
ls: cannot access '/RetroPie/roms/cache': No such file or directory

pi@retropie:~/RetroPie/roms $ ls -al
total 8
drwxr-xr-x 2 root root 4096 Jan 25 20:13 .
drwxr-xr-x 6 pi   pi   4096 Apr 14  2018 ..
drwxr-xr-x 2 root root    0 Jan 25 15:53 atari2600
drwxr-xr-x 2 root root    0 Jan 25 16:04 atari5200
drwxr-xr-x 2 root root    0 Jan 25 16:08 Atari800
drwxr-xr-x 2 root root    0 Jan 25 16:09 atarijaguar
drwxr-xr-x 2 root root    0 Jan 25 16:09 atarilynx
drwxr-xr-x 2 root root    0 Jan 25 20:13 cache
drwxr-xr-x 2 root root    0 Jan 25 16:06 nes
drwxr-xr-x 2 root root    0 Jan 25 16:06 snes

mitu

@raulitob You need to learn how folders and paths work in Linux. And also read carefully forum posts.
In Linux, ~ has a special meaning - it's the home folder of the logged on user and its path is /home/<username>. So you're 2nd listing shows the contents of the ~/RetroPie/roms folder (=/home/pi/RetroPie/roms) and NOT the /RetroPie/roms folder.
Please re-read by previous post on configuring the cache folder in Skyscraper's config.ini - which path did I specify ?