RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Problem with Skyscraper, no data found or not showing up

    Scheduled Pinned Locked Moved Help and Support
    skyscraperscraping
    12 Posts 4 Posters 3.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • m2306M
      m2306 @mitu
      last edited by

      @mitu Thanks for the input. Sorry if I was not clear. I start Skyscraper by launching the setupscript from command line and then launch Skyscraper from the manage packages menu. There I use the graphic user interface with default options, just choosing which system to scrape.

      mituM 1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator @m2306
        last edited by mitu

        @m2306 You said you're using Skyscraper from the command line, which for me means you're running it directly (Skyscraper [... options..]).
        If you're running it from the RetroPie-Setup front-end then some options are predefined - including where the gamelist.xml is stored. Take a look at the Docs - especially the section with Where are my scraped media and metadata saved? - and see where the gamelist.xml is stored - if it's not in the ROMs folder, then check your ROM folder for a gamelist.xml and remove it, then re-generate again the gamelist from the interface (without gathering).

        m2306M 2 Replies Last reply Reply Quote 1
        • m2306M
          m2306 @mitu
          last edited by

          @mitu Thank you very much. It worked for one of the systems that Skyscraper gathered data for but didn’t show up in ES. As for GBA I will have to scrape again to see if it works as it actually didn’t download any data for half the roms.

          ClydeC 1 Reply Last reply Reply Quote 0
          • ClydeC
            Clyde @m2306
            last edited by

            @m2306 A quick way to disable all existing gamelists in your rom folders is this one-line shell script that I wrote a while ago: https://retropie.org.uk/forum/topic/23235/script-one-liner-to-backup-or-disable-the-gamelists-in-all-rom-directories

            This way (and/or checking the Skyscraper options regarding the gamelist path in the Retropie Setup like @mitu suggested) you can be sure that ES won't load old gamelists instead of the ones you created anew with Skyscraper.

            1 Reply Last reply Reply Quote 1
            • m2306M
              m2306 @mitu
              last edited by

              @mitu So, while the scraping worked for some systems and regenerating the gamelists worked for some of the affected ones I get the same error again with some systems. I removed gamelist, purged and scraped again for GBA but the same thing happened again at around the letter T (I clenaed up the romset so it's also a few roms shorter now, around 1000). I also got the same problem on PSX that only has around 70 roms, the last few are left without any data. Any ideas on how to proceed?

              1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator
                last edited by

                Assuming it's a throttling issue, you should try re-scraping. But the ScreenScraper servers are usually busy during the week-end, so I'd wait until monday.

                1 Reply Last reply Reply Quote 1
                • ClydeC
                  Clyde
                  last edited by Clyde

                  Also, registering at www.screenscraper.fr for free will get you still access if SS closes its API for non-registered users because of too much traffic.

                  Furthermore, a monthly donation of at least 1€ will raise you to "contributor" status with access if they close the API for non-registered and registered users, and 50.000 scraping requests instead of 20.000.

                  edit: To let Skyscraper use your Screenscraper user credentials, you'll have to add theses lines to your ~/.skyscaper/config.ini:

                  [screenscraper]
                  userCreds="username:password"
                  

                  Beware that .skyscraper is a hidden directory, because its name begins with a dot. So, you might not see it, but nevertheless you can edit it by entering nano ~/.skyscraper/config.ini.

                  m2306M 1 Reply Last reply Reply Quote 1
                  • m2306M
                    m2306 @Clyde
                    last edited by

                    @Clyde I made a user account. The whole config.ini file in that directory is commented and the same as the config.ini.example file. Since it’s all commented I can’t see how it could be the correct config file.. I tried to uncomment the line with the username and password (and saved changes) but it wasn’t recognised by Skyscraper.

                    muldjordM 1 Reply Last reply Reply Quote 0
                    • muldjordM
                      muldjord @m2306
                      last edited by

                      @m2306 You also need to have the line [screenscraper] above the userCreds line for it to work. Like this:

                      [screenscraper)
                      userCreds="USER:PASSWORD"
                      

                      Also be aware that ScreenScraper has several limitations in general. If it stopped getting data at some point, you probably ran out of requests for the day. So as others point out, just try again the next day. But yes, always create a user and use your credentials. It's much more stable as the API is very often shut down for unregistered users due to high server loads.

                      m2306M 1 Reply Last reply Reply Quote 1
                      • m2306M
                        m2306 @muldjord
                        last edited by

                        @muldjord ok. Thank you for a great application!

                        1 Reply Last reply Reply Quote 1
                        • First post
                          Last post

                        Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                        Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.