RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scrapes in Windows but not Linux

    Scheduled Pinned Locked Moved Help and Support
    skyscraper
    4 Posts 2 Posters 498 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      DevanteWeary
      last edited by

      Hello,

      I have an issue scraping...

      I don't really thing it's RetroPie related but I posted it at the Skyscraper github and muldjord told me to post this here so here goes...

      So I run Skyscraper on my Windows 10 PC and it grabs the images but doesn't follow any flags I put in.
      For instance, --flags forcefilename

      So I gave up and installed Ubuntu on Virtual Box and now when I try it, it won't even find the files and/or connect to the DB.
      I'm using ArcadeDB.

      I've verified I can get to websites on the Ubuntu install.

      Here's what I get in Virtual Ubutnu

      d85aeccb-e812-4abf-a6d5-da7973661745-image.png

      But on the same laptop, in Windows, it downloads the images but ignores flags and even ignores anything I put in the config.ini

      Does anyone know what could be happening with the Linux version?

      Thank you!

      1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator
        last edited by

        Your screenshot doesn't show an error, just that the source server is busy - not really helpful.
        The forcefilename flag is used when generating the gamelist(s), not when scraping - are you sure you're using it right ? Can you give another example of an issue - post just the command line used and the results you're expecting to get.

        D 1 Reply Last reply Reply Quote 0
        • D
          DevanteWeary @mitu
          last edited by

          @mitu said in Scrapes in Windows but not Linux:

          Your screenshot doesn't show an error, just that the source server is busy - not really helpful.
          The forcefilename flag is used when generating the gamelist(s), not when scraping - are you sure you're using it right ? Can you give another example of an issue - post just the command line used and the results you're expecting to get.

          Thanks for the info on the forcefilename. So there's just no way to get it to save covers as the same filename as the game? That's crazy.

          As for the command...

          Skyscraper -p arcade -s arcadedb -i "/home/devante/skysource/roms/missingmame/" --flags forcefilename --verbosity 3

          As for the expected result... well I expect it to find the ROMs. :P'
          It works on Windows 10 on the same laptop.

          At the end of the day, all I'm trying to do is scrape my few missing games that Skraper didn't catch.
          It looks like arcadeDB fills has the images but Skyscraper is only saving the image names as random numbers/letters and I just want the actual game .zip name.

          Maybe something else besides Skyscraper does this?
          I don't know of any other scraper that uses ArcadeDB.

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @DevanteWeary
            last edited by

            @DevanteWeary said in Scrapes in Windows but not Linux:

            Thanks for the info on the forcefilename. So there's just no way to get it to save covers as the same filename as the game? That's crazy.

            No, I didn't say that. Skyscraper needs 2 passes to actually generate a gamelist

            • first run to do the scraping from the scraping site and save it into the cache (this is where it saves the artwork as a 'random numbers/letters' file, the cache). The forcefilename flag has no effect here.
            • 2nd run to generate the gamelist from the cache - this is where you can use forcefilename flag.

            I suggest you take a look again at Skyscraper's docs and see how it should be used.

            1 Reply Last reply Reply Quote 0
            • First post
              Last post

            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.