Scrapes in Windows but not Linux
-
Hello,
I have an issue scraping...
I don't really thing it's RetroPie related but I posted it at the Skyscraper github and muldjord told me to post this here so here goes...
So I run Skyscraper on my Windows 10 PC and it grabs the images but doesn't follow any flags I put in.
For instance, --flags forcefilenameSo I gave up and installed Ubuntu on Virtual Box and now when I try it, it won't even find the files and/or connect to the DB.
I'm using ArcadeDB.I've verified I can get to websites on the Ubuntu install.
Here's what I get in Virtual Ubutnu
But on the same laptop, in Windows, it downloads the images but ignores flags and even ignores anything I put in the config.ini
Does anyone know what could be happening with the Linux version?
Thank you!
-
Your screenshot doesn't show an error, just that the source server is busy - not really helpful.
Theforcefilename
flag is used when generating the gamelist(s), not when scraping - are you sure you're using it right ? Can you give another example of an issue - post just the command line used and the results you're expecting to get. -
@mitu said in Scrapes in Windows but not Linux:
Your screenshot doesn't show an error, just that the source server is busy - not really helpful.
Theforcefilename
flag is used when generating the gamelist(s), not when scraping - are you sure you're using it right ? Can you give another example of an issue - post just the command line used and the results you're expecting to get.Thanks for the info on the forcefilename. So there's just no way to get it to save covers as the same filename as the game? That's crazy.
As for the command...
Skyscraper -p arcade -s arcadedb -i "/home/devante/skysource/roms/missingmame/" --flags forcefilename --verbosity 3
As for the expected result... well I expect it to find the ROMs. :P'
It works on Windows 10 on the same laptop.At the end of the day, all I'm trying to do is scrape my few missing games that Skraper didn't catch.
It looks like arcadeDB fills has the images but Skyscraper is only saving the image names as random numbers/letters and I just want the actual game .zip name.Maybe something else besides Skyscraper does this?
I don't know of any other scraper that uses ArcadeDB. -
@DevanteWeary said in Scrapes in Windows but not Linux:
Thanks for the info on the forcefilename. So there's just no way to get it to save covers as the same filename as the game? That's crazy.
No, I didn't say that. Skyscraper needs 2 passes to actually generate a gamelist
- first run to do the scraping from the scraping site and save it into the cache (this is where it saves the artwork as a 'random numbers/letters' file, the cache). The
forcefilename
flag has no effect here. - 2nd run to generate the gamelist from the cache - this is where you can use
forcefilename
flag.
I suggest you take a look again at Skyscraper's docs and see how it should be used.
- first run to do the scraping from the scraping site and save it into the cache (this is where it saves the artwork as a 'random numbers/letters' file, the cache). The
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.