RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraper will not scrape in emulation station

    Scheduled Pinned Locked Moved Help and Support
    scraperemulationstaion
    14 Posts 2 Posters 2.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      mahoneyt944
      last edited by mahoneyt944

      how can I check? I installed emulationstation from binary just a moment ago and within the ES start menu select scraper. Neither database is working for me.

      1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator
        last edited by

        ScreenScraper at the moment is not working for non-registered users, so that won't work. I'm not sure about TGDB source, they had an outage near the end of last year and they've changed their site and the way artwork is searched and downloaded, probably that's why it doesn't work.

        I think that right now your option is to use an external scraper - like SkyScraper.

        M 1 Reply Last reply Reply Quote 0
        • M
          mahoneyt944
          last edited by

          Ill try it. I did try one of the external scrapers though. I think the Stephen one? It couldn't scrape either.

          1 Reply Last reply Reply Quote 0
          • M
            mahoneyt944 @mitu
            last edited by

            @mitu

            Unfortunately sky scraper also does not work. I think because it pulls from the same resources which are not working...…

            any other solutions available?

            mituM 1 Reply Last reply Reply Quote 0
            • mituM
              mitu Global Moderator @mahoneyt944
              last edited by

              @mahoneyt944 said in Scraper will not scrape in emulation station:

              Unfortunately sky scraper also does not work. I think because it pulls from the same resources which are not working...…

              What source are you using ? If it's ScreenScraper, then you need to register an account with them in order to work - as I said before, non-registered users cannot use the site right now.

              M 1 Reply Last reply Reply Quote 0
              • M
                mahoneyt944 @mitu
                last edited by mahoneyt944

                @mitu

                I registered on ScreenScraper.fr, how do I get retropie to login to it so I can scrape from ES?

                mituM 1 Reply Last reply Reply Quote 0
                • mituM
                  mitu Global Moderator @mahoneyt944
                  last edited by

                  You'll need to edit the Skyscraper's configuration file ($HOME/.skyscraper/config.ini) and add your credentials there, for the screenscraper module.

                  [screenscraper]
                  userCreds="user:passwd"
                  

                  More details in the Skyscraper Docs.

                  M 1 Reply Last reply Reply Quote 0
                  • M
                    mahoneyt944 @mitu
                    last edited by mahoneyt944

                    @mitu

                    I'm trying to understand what's happening here.... I reinstalled scraper and skyscraper from the optional packages menu in retropie setup.

                    For scraper I was able to edit:

                    /home/pi/RetroPie-Setup/scriptmodules/supplementary/scraper.sh

                    Where I added:
                    params+=(-ss_user "user")
                    params+=(-ss_password "password")

                    This allows scraper to work from command line. But scraper from within ES does not work still.

                    Next I edited:

                    $HOME/.skyscraper/config.ini

                    with these changes:

                    [screenscraper]
                    userCreds="user:passwd"

                    I didn't test skyscraper from command line but I assume it now works, but scraper from within ES start menu still does not work.

                    How do I get scraper that is built in to emulation station start menu to work so I don't have to use command line to scrape?

                    mituM 1 Reply Last reply Reply Quote 0
                    • mituM
                      mitu Global Moderator @mahoneyt944
                      last edited by

                      @mahoneyt944 said in Scraper will not scrape in emulation station:

                      I didn't test skyscraper from command line but I assume it now works, but scraper from within ES start menu still does not work.

                      I'm confused to why would you think it would work ? My suggestion to use an external scraper (i.e. external to EmulationStation) was because scraping from within EmulationStation does not work at the moment because of the changes/limitations of the scraping sources.

                      1 Reply Last reply Reply Quote 0
                      • M
                        mahoneyt944
                        last edited by

                        My confusion was from the "screenscraper" name being under the ES menu.... I assumed it was the same script running as scraper from command line. So I was confused as to why scraper was working in command line but not ES.

                        So.. ES uses its own script to connect to the ScreenScraper.fr database that's currently not working and scraper from command line is connecting to ScreenScraper.fr in a different way that's working?

                        Is the ES scraper issue just the login to ScreenScraper.fr ….. anyway to edit it in?

                        mituM 1 Reply Last reply Reply Quote 0
                        • mituM
                          mitu Global Moderator @mahoneyt944
                          last edited by mitu

                          @mahoneyt944 said in Scraper will not scrape in emulation station:

                          So.. ES uses its own script to connect to the ScreenScraper.fr database that's currently not working and scraper from command line is connecting to ScreenScraper.fr in a different way that's working?

                          No. There's no 'script' - it's built in EmulationStation. The reason it's not working is that it doesn't use credentials for scraping from ScreenScraper.

                          Is the ES scraper issue just the login to ScreenScraper.fr ….. anyway to edit it in?

                          No, EmulationStation does not support user/password for scraping (from ScreenScraper or other source). Please use skyscraper with your registered account on ScreenScraper.fr to scrape.

                          M 1 Reply Last reply Reply Quote 0
                          • M
                            mahoneyt944 @mitu
                            last edited by

                            @mitu ok, thank you!

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post

                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.