RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Screenscraper error API closed for non-registered members

    Scheduled Pinned Locked Moved Help and Support
    scraperscreenscrapersselph scraperapi closederror
    39 Posts 11 Posters 16.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • top-specciT
      top-specci @mitu
      last edited by top-specci

      @mitu said in Screenscraper error API closed for non-registered members:

      The scraper.cfg doesn't support storing the user/password, you'll have to use the command line and add the parameters (-ss_user/-ss_password) needed to authenticate with your user account when scraping.

      I'm using "Steven Selph's Scraper" (not Skyscraper):
      Actual I'm running in same error message, so unshure if there is "only" a server overload or the login/password is no longer stored.
      Because last weeks srapping works when starting from the shell # retropie_setup.sh

      Also unclear, where my login to screenscaper is "stored", I Have have a login/password but where in RetroPie must this entered (because before it works and I have not use any command line ...)

      thelostsoulT 1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator
        last edited by

        @top-specci said in Screenscraper error API closed for non-registered members:

        Also unclear, where my login to screenscaper is "stored"

        As I said, you'll need to use the command line parameters for user/pass, there's no configuration file for storing it, not when using Steven Selph's scraper.

        1 Reply Last reply Reply Quote 0
        • top-specciT
          top-specci
          last edited by

          Yes, but the grabbing is started from the menu "2: Scrape chosen system", where can I enter here login/password?

          You understood what I mean?
          It works before from this menu-option, so what is the binary (or shell script) I have to add the login/password?
          imho this was not necessary till now ....

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @top-specci
            last edited by

            @top-specci said in Screenscraper error API closed for non-registered members:

            Yes, but the grabbing is started from the menu "2: Scrape chosen system", where can I enter here login/password?

            You'll need to run scraper from the command line and not through the RetroPie-Setup script.

            top-specciT 1 Reply Last reply Reply Quote 0
            • top-specciT
              top-specci @mitu
              last edited by

              @mitu said in Screenscraper error API closed for non-registered members:

              You'll need to run scraper from the command line and not through the RetroPie-Setup script.

              Always? Is this new? Not working anymore from the menu? Was there a change?
              7 days ago it works from the menu !?!?
              This is what I don't understand (or: wondering) ....

              mituM 1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator @top-specci
                last edited by

                @top-specci said in Screenscraper error API closed for non-registered members:

                Always? Is this new? Not working anymore from the menu? Was there a change?
                7 days ago it works from the menu !?!?

                Please re-read the whole topic.

                1 Reply Last reply Reply Quote 0
                • thelostsoulT
                  thelostsoul @top-specci
                  last edited by

                  @top-specci said in Screenscraper error API closed for non-registered members:

                  I'm running in same error message, so unshure if there is "only" a server overload

                  You can open the website and see directly if there is an overload: https://www.screenscraper.fr/

                  screenshot_3.png

                  This info is found on the right top. You can see both CPU of the server are under heavy load (average: 97%). Only API Access is allowed, I guess that means only registered members. The smiley face also indicates that Not Registered members have no access.

                  Just wait some hours or sometimes even days and try again.

                  📜 RE/SET: 100 SNES Games for your RetroPie, 🎁 Share your hidden gems and insider tips

                  1 Reply Last reply Reply Quote 0
                  • top-specciT
                    top-specci
                    last edited by top-specci

                    I read the whole topic, believe me ...
                    There was also skyscraper, but

                    Actuall I only have to grab 10 (new) games, so it seems easier to download the images and movies manually and editthe gameslist.xml also manually

                    I try to undestand:
                    There is a menu to grab (and this was working last week),
                    and now I only get the information I have to use the command line ...

                    Ahh,
                    is this what you mean:
                    When using the menu I only able to download as a unregistered user,
                    and if I want to download as a registered user: This is only possible withe the command line.

                    BTW: Is it normal that the login on https://www.screenscraper.fr is not working with Chrome, in IE it works (for me)

                    1 Reply Last reply Reply Quote 0
                    • T
                      Trebloth
                      last edited by

                      Hi all, I stumbled on this topic in an attempt to solve the same issue the original poster was having (specifically, the fact that the scraper.cfg file doesn't save the username and password settings from ScreenScraper.fr). While a few people chimed in with bits and pieces of information, I'm going to give as much feedback / answers as possible to the initial problem.

                      To reiterate, this is specifically dealing with Sselph's Scraper (just referred to as 'scraper' most of the time). Some comments were talking about sky scraper, which I have not used and this information does not apply to.

                      Problem: running Sselph's scraper when ScreenScraper.fr is overloaded produces errors and does not work. We want to put in our login information to screenscraper.fr when running Sselph's scraper to bypass this issue as a registered user.

                      To get things to work cleanly, I deleted everything that was already in the images folder, as well as the gameslist.xml file.

                      Solution:

                      Exit emulation station (main menu -> quit -> quit emulationstation)
                      You will now be at a command prompt that says pi@retropie:~ $ (exact location text may be different if you left the command prompt from a different location)
                      typing 'ls' (short for list) will show you the folders and give you an idea of where you are.
                      cd RetroPie (this is case sensitive)
                      cd roms
                      ls (again, to see you roms folders)
                      cd (the folder you want to go to if you want to scrape one set of roms at a time like i did, in my case it was cd pcengine)

                      Now, this took me a few tries to get right, but what I figured out was that when running the command line, you have to tell it every single option that isn't default. For me, that meant telling it to use ScreenScraper.fr (-console_src=ss), download videos (-download_videos=true), download marquees (-download_marquees=true), and entering my username (-ss_user=[myusername]) and password (-ss_password=[mypassword]).

                      My command that finally worked was as written below (without the () symbols of course).

                      /opt/retropie/supplementary/scraper/scraper -console_src=ss -download_videos=true -download_marquees=true -ss_user=(insertusernamehere) -ss_password=(insertpasswordhere)

                      And to add, just type emulationstation to restart it.

                      Hope this helps someone! And thanks to everyone else who added some of the pieces that finally helped me put it all together.

                      thelostsoulT 1 Reply Last reply Reply Quote 2
                      • thelostsoulT
                        thelostsoul @Trebloth
                        last edited by

                        @Trebloth Its great to have a posting that is organized as a step by step tutorial and proven to be working. As an additional note, you could create a script out of the command, so next time you just call the script without worrying about settings.

                        📜 RE/SET: 100 SNES Games for your RetroPie, 🎁 Share your hidden gems and insider tips

                        1 Reply Last reply Reply Quote 0
                        • WeirdHW
                          WeirdH
                          last edited by

                          I never used the command line, but instead scrape with screenscraper.fr from the retropie setup, like @top-specci said above. I use this method and it works for my needs (very basic info scraping with me manually editing the gamelist.xml to preference afterwards).

                          Granted, it's not the best option if you need to scrape hundreds of games, but for adding a handful of new entries, it's functional.

                          1 Reply Last reply Reply Quote 0
                          • C
                            Colombia20102018
                            last edited by

                            @mitu hello, I am having a lot of issues understanding the information. It is very high level for me and from all the different posts I see around the Internet, it seems I am not alone. I read the docs but some of the information assumes certain level of knowledge that I don't have. I registered at the screen scraper.fr page. All I want to do now is to go to Retropie to add my user and password so I can scrape all the roms to get video snaps. I see comments such as run it from the roms folder. How do I get to the roms folder to run it? Other comments say edit the config.ini. How do I edit it? How do I get there?
                            I would really appreciate if a step by step or video on how to do this could be shared. For example, step 1. from your emulation station type F4. step 2. type this command (....) and this path(...) to reach the roms folder. Step 3. now type this command (...) and this path (...). Step 4. Now that you are here do this, edit that, type there, change that, etc. Step 5. Save this way. Step 6. Now go back to emulation station this way. I am sure a step by step will save so much time to so many people that to play some games is all they want :). Thank you and Happy New Year

                            ClydeC 1 Reply Last reply Reply Quote 0
                            • ClydeC
                              Clyde @Colombia20102018
                              last edited by Clyde

                              @colombia20102018 I don't have a video for you, but I also don't think that one is necessary for the few steps in this matter.

                              1. As you already said, press F4 in Emulation Station.
                              2. Enter the command nano ~/.skyscraper/config.ini
                              3. You're now in the text editor "nano". Press Ctrl+End or use the cursor keys to get to the end of the file, and append the following lines. (Replace USER and PASSWORD with your own Screenscraper username and password, but keep them separated by a colon.)
                              [screenscraper]
                              userCreds="USER:PASSWORD"
                              
                              1. Exit nano by pressing Ctrl+x, answer the save question with y, and press Enter to confirm the file name. You should be back in the command line after that.
                              2. [Optional] Enter the command tail ~/.skyscraper/config.ini to display the last 10 lines of the config file, and check if your changes were saved.
                              3. Exit the command line by either entering exit or pressing Ctrl+d. This should return you to Emulation Station automatically.

                              Now, Skyscraper should use your credentials to log into Screenscraper if you choose the latter as the scraping source.

                              Alternatively, if your Pi is connected to your LAN, you should be able to access it via Samba like it's described here. Skyscraper's config files should be accessible at the Samba network address \\retropie\configs\all\skyscraper, see here. You should be able to make the changes described in #2 this way, too.

                              C 1 Reply Last reply Reply Quote 2
                              • mituM
                                mitu Global Moderator
                                last edited by

                                @colombia20102018 said in Screenscraper error API closed for non-registered members:

                                hello, I am having a lot of issues understanding the information

                                Using Skyscraper in RetroPie is described in detail in the Docs. The advanced options menu will allow you to edit the configuration file and add your ScreenScraper credentials.

                                C 1 Reply Last reply Reply Quote 0
                                • C
                                  Colombia20102018 @Clyde
                                  last edited by

                                  @clyde hello. Thank you for the steps. I followed them and checked that the user and password were saved. When I try the screen scraper it tells me invalid character F for all roms. When I try Skyscraper it tells me to sign up for an account. I did a reboot and tried again and still got the same messages. What else am i missing? Thanks

                                  1 Reply Last reply Reply Quote 0
                                  • C
                                    Colombia20102018 @mitu
                                    last edited by

                                    @mitu I read the docs one more time plus the troubleshooting section. I do not see the steps to enter the user and password anywhere. Where is this information? Thanks

                                    mituM 1 Reply Last reply Reply Quote 0
                                    • mituM
                                      mitu Global Moderator @Colombia20102018
                                      last edited by

                                      @colombia20102018 said in Screenscraper error API closed for non-registered members:

                                      Where is this information? Thanks

                                      The advanced options menu will allow you to edit the configuration file and add your ScreenScraper credentials.

                                      C 1 Reply Last reply Reply Quote 0
                                      • C
                                        Colombia20102018 @mitu
                                        last edited by

                                        @mitu the advance configuration section does not explain how to do any of that. This might me intuitive for some people but not for me 😊
                                        This is the message I am getting now:0531D8BD-57B4-4883-8591-F5CDC3462575.jpeg

                                        1 Reply Last reply Reply Quote 0
                                        • mituM
                                          mitu Global Moderator
                                          last edited by mitu

                                          @colombia20102018 said in Screenscraper error API closed for non-registered members:

                                          the advance configuration section does not explain how to do any of that.

                                          The advanced options section has an entry to edit your configuration:

                                          64786408-41cb-4a04-9bd3-8f813df67cba-image.png

                                          When you select it, an editor is opened to edit the file and you can enter the user and password in the [screenscraper] section, as @Clyde explained to you.

                                          This is the message I am getting now:

                                          This means you didn't properly add your user and password and Skyscraper doesn't use your registered account to access ScreenScraper.

                                          C 1 Reply Last reply Reply Quote 0
                                          • C
                                            Colombia20102018 @mitu
                                            last edited by

                                            @mitu I checked both ways. The configuration file shows the correct user and password. I am assuming the user is the pseudo name and not my email address, correct? Maybe it takes some time for the system to sync?

                                            mituM 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.