RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Skyscraper Stopped Passing Credentials to Screeenscraper

    Scheduled Pinned Locked Moved
    Help and Support
    skyscraper screenscraper scrape issues scraper problem
    3
    9
    882
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      BPJerseyboy
      last edited by

      Pi Model or other hardware: Pi3B
      Power Supply used: CanaKit 5V 2.5A
      RetroPie Version Used : 4.7.1
      Skyscraper Version: 3.6.13
      Built From: Pre made SD Image on RetroPie website
      USB Devices connected: Xbox 360 Wired Controller, Logitech Wireless K400r Keyboard
      Controller used: Xbox 360 Wired Controller
      Guide used: I use the one in RetroPie Docs - https://retropie.org.uk/docs/Scraper/#using-skyscraper

      How to replicate the problem:
      Let me start by saying that I have used Skyscraper on this build before with no issues. I updated the config.ini with username and password and uncommented the line. A few months ago I ran Skyscraper using ScreenScraper with multiple threads (I am a supporter) and had absolutely zero problems.

      I recently added some games to RetroPie so I ran them through Skyscraper. I selected "scrape only missing" so as not to redo the entire game folder and I came across 2 problems.

      • Skyscraper is no longer passing my credentials through for some reason, so I am back to one thread and a super slow connection. I get the message "Forcing 1 threads as this is the anonymous limit in the ScreenScraper scraping module.".

      • Skyscraper ignored my "scrape only missing" request and attempted to do the entire folder.

      I checked the config.ini and all is as it was. I am still able to log into the ScreenScraper site with no issues. And I've recently run ScreensSraper on EmuElec and had all threads so I'm certain it is not an account/credentials issue.

      1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator
        last edited by

        Can you post your config.ini file (removing the username/password) ?

        1 Reply Last reply Reply Quote 0
        • B
          BPJerseyboy
          last edited by mitu 

          # --------------------------------------------------------------------
# Skyscraper by Lars Muldjord (https://github.com/muldjord/skyscraper)
# --------------------------------------------------------------------

# This is an example config file for use with Skyscraper. Use it as a template for creating
#   your own. If you copy this file to 'config.ini' it will be used per default.
#   You can always copy config.ini.example to a filename of your choice and make Skyscraper
#   use it with the '-c CONFIGFILE' command line option.

# You can have several platform sections in one config file. Further down is an example of
#   a generic platform setup. Check '--help' for more info on supported platforms.

# You can have several scraping module sections in one config file. Further down is an example
#   of a generic module setup. Check '--help' for more info on supported modules.

# Remember that most of these settings can also be set as command line options. Doing so
#   will overrule the options seen here except for the scraping module configs which
#   overrules everything else.
# Platform specific configs overrules main configs.

# Uncomment the sections and lines you wish to use:

[main]
##Setting input, gamelist or media folder here, will automatically append '/[platform]' to path.
##If you need better control, use the same variables under a [<platform>] section instead.
#inputFolder="/home/pi/RetroPie/roms"
#excludeFiles="*[BIOS]*"
#includeFiles="Super*"
#gameListFolder="/home/pi/RetroPie/roms"
#gameListBackup="false"
#mediaFolder="/home/pi/RetroPie/roms"
#cacheFolder="/home/pi/.skyscraper/cache"
#cacheResize="false"
#nameTemplate="%t [%f], %P player(s)"
#jpgQuality="95"
#cacheCovers="true"
#cacheScreenshots="true"
#cacheWheels="true"
#cacheMarquees="true"
#importFolder="/home/pi/.skyscraper/import"
#unpack="false"
#frontend="emulationstation"
#emulator=""
#launch=""
#videos="false"
#videoSizeLimit="42"
#videoConvertCommand="ffmpeg -i %i -y -pix_fmt yuv420p -t 00:00:10 -c:v libx264 -crf 23 -c:a aac -b:a 64k -vf scale=640:480:force_original_aspect_ratio=decrease,pad=640:480:(ow-iw)/2:(oh-ih)/2,setsar=1 %o"
#videoConvertExtension="mp4"
#symlink="false"
#brackets="true"
#maxLength="10000"
#threads="2"
#pretend="false"
#unattend="false"
#unattendSkip="false"
#interactive="false"
#forceFilename="false"
#verbosity="1"
#skipped="false"
#maxFails="30"
#lang="en"
#region="wor"
#langPrios="en,de,es"
#regionPrios="eu,us,ss,uk,wor,jp"
#minMatch="0"
#artworkXml="artwork.xml"
#relativePaths="false"
#addExtensions="*.zst"
#hints="false"
#subdirs="true"
#spaceCheck="true"
#scummIni="/full/path/to/scummvm.ini"

#[<PLATFORM, eg 'amiga'>]
#inputFolder="/home/pi/RetroPie/roms/amiga"
#excludeFiles="*[BIOS]*"
#includeFiles="Super*"
#gameListFolder="/home/pi/RetroPie/roms/amiga"
#mediaFolder="/home/pi/RetroPie/roms/amiga/media"
#cacheFolder="/home/pi/.skyscraper/cache/amiga"
#cacheResize="false"
#nameTemplate="%t [%f], %P player(s)"
#jpgQuality="95"
#cacheCovers="true"
#cacheScreenshots="true"
#cacheWheels="true"
#cacheMarquees="true"
#importFolder="/home/pi/.skyscraper/import/amiga"
#unpack="false"
#emulator=""
#launch=""
#videos="false"
#videoSizeLimit="42"
#symlink="false"
#brackets="true"
#lang="en"
#region="wor"
#langPrios="en,de,es"
#regionPrios="eu,us,ss,uk,wor,jp"
#minMatch="0"
#maxLength="10000"
#threads="2"
#startAt="filename"
#endAt="filename"
#pretend="false"
#unattend="false"
#unattendSkip="false"
#interactive="false"
#forceFilename="false"
#verbosity="1"
#skipped="false"
#artworkXml="artwork.xml"
#relativePaths="false"
#extensions="*.zip *.uae *.adf"
#addExtensions="*.zst *.rom"
#subdirs="true"

#[<FRONTEND, eg 'pegasus'>]
#excludeFiles="*[BIOS]*"
#includeFiles="Super*"
#artworkXml="artwork.xml"
#emulator=""
#launch=""
#gameListFolder="/home/pi/RetroPie/roms/amiga"
#gameListBackup="false"
#mediaFolder="/home/pi/RetroPie/roms/amiga/media"
#skipped="false"
#brackets="true"
#videos="false"
#symlink="false"
#startAt="filename"
#endAt="filename"
#unattend="false"
#unattendSkip="false"
#forceFilename="false"
#verbosity="1"
#maxLength="10000"

#[<SCRAPING MODULE, eg 'screenscraper'>]
userCreds="XXXX:XXXXX"
#threads="1"
#minMatch="0"
#maxLength="10000"
#interactive="false"
#cacheResize="false"
#jpgQuality="95"
#cacheCovers="true"
#cacheScreenshots="true"
#cacheWheels="true"
#cacheMarquees="true"
#videos="false"
#videoSizeLimit="42"
#videoConvertCommand="ffmpeg -i %i -y -pix_fmt yuv420p -t 00:00:10 -c:v libx264 -crf 23 -c:a aac -b:a 64k -vf scale=640:480:force_original_aspect_ratio=decrease,pad=640:480:(ow-iw)/2:(oh-ih)/2,setsar=1 %o"
#videoConvertExtension="mp4"
##The following option is only applicable to 'screenscraper'
#videoPreferNormalized="true"

[esgamelist]
cacheRefresh="true"

[import]
cacheRefresh="true"
          1 Reply Last reply Reply Quote 0
          • B
            BPJerseyboy
            last edited by

            Posted. Sorry for the formatting issues. As you can see, most of the lines are commented. I've always used it this way with no problems until the last few weeks.

            mituM 1 Reply Last reply Reply Quote 0
            • mituM
              mitu Global Moderator @BPJerseyboy
              last edited by

              @bpjerseyboy I reformatted the post and added code tags. Looking at the configuration file, the format is not complete. To add credentials for ScreenScraper you should have:

              [screenscraper]
userCreds="X:Y"

              You only have the last line, but there's no screenscraper section.

              B 1 Reply Last reply Reply Quote 1
              • B
                BPJerseyboy @mitu
                last edited by

                @mitu Many thanks. Oddly the config file has always been this way and it has worked in the past. I will update this and report the result.

                muldjordM 1 Reply Last reply Reply Quote 0
                • B
                  BPJerseyboy
                  last edited by

                  @mitu Thanks! That totally worked. I have all seven threads back. I think I figured out the "scrape only missing" issue as well. It appears my cache is gone. I am assuming that is what skyscraper uses to determine if it has already scraped an item.

                  muldjordM 1 Reply Last reply Reply Quote 0
                  • muldjordM
                    muldjord @BPJerseyboy
                    last edited by

                    @bpjerseyboy said in Skyscraper Stopped Passing Credentials to Screeenscraper:

                    @mitu Thanks! That totally worked. I have all seven threads back. I think I figured out the "scrape only missing" issue as well. It appears my cache is gone. I am assuming that is what skyscraper uses to determine if it has already scraped an item.

                    Yes. Not only that, but it also reuses the resources when re-generating gamelists to avoid hammering the online services (and is thereby many, MANY times faster). So if possible, I would keep the cache intact and never purge it, unless you absolutely have to. :)

                    1 Reply Last reply Reply Quote 0
                    • muldjordM
                      muldjord @BPJerseyboy
                      last edited by

                      @bpjerseyboy said in Skyscraper Stopped Passing Credentials to Screeenscraper:

                      @mitu Many thanks. Oddly the config file has always been this way and it has worked in the past. I will update this and report the result.

                      Unless it has been using a config file from somewhere else where it was entered correctly, this is impossible. It only works if entered as @mitu described. :) I should know, I wrote the software. And if a [screenscraper] section isn't found, it won't use the credentials.

                      1 Reply Last reply Reply Quote 2
                      • First post
                        Last post

                      Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                      Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.