RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    EmulationStation Sluggish and Scraper Broken with 4.7 Release

    Scheduled Pinned Locked Moved Help and Support
    retropie 4.7es slowscrape issuesretropie
    42 Posts 11 Posters 8.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mituM
      mitu Global Moderator @Phil_Chambers
      last edited by

      @phil_chambers I wasn't rude, just merely asking for more details. What scraping source are you using ?

      P 1 Reply Last reply Reply Quote 0
      • P
        Phil_Chambers @mitu
        last edited by

        @mitu The built in scraper that comes installed with stock 4.7.

        mituM 1 Reply Last reply Reply Quote 0
        • mituM
          mitu Global Moderator @Phil_Chambers
          last edited by

          @phil_chambers The built-in scraper has 2 sources for scraping available

          • TheGamesDB.net
          • ScreenScraper.fr

          You can configure which one is used from the EmulationStation's settings. Right now, ScreenScraper.fr is not accessible for non-registered users, so scraping from that source does not work - it's not a bug in EmulationStation.

          If you change the scraping source and use TheGamesDB, scraping will work.

          P 1 Reply Last reply Reply Quote 0
          • P
            Phil_Chambers @mitu
            last edited by

            @mitu Scraping from TheGamesDB doesn't pull any results for any rom on any system. Is there a system log somewhere I can pull?

            mituM 1 Reply Last reply Reply Quote 0
            • mituM
              mitu Global Moderator @Phil_Chambers
              last edited by

              @phil_chambers said in EmulationStation Sluggish and Scraper Broken with 4.7 Release:

              Is there a system log somewhere I can pull?

              EmulationStation has a log in \\retropie\configs\all\emulationstation (es_log.txt), but I don't think that it logs any details about scraping request error (just the error).

              jamrom2J 1 Reply Last reply Reply Quote 0
              • jamrom2J
                jamrom2 @mitu
                last edited by

                @mitu does the new version fix the Atari 800 scraping?

                mituM 1 Reply Last reply Reply Quote 0
                • mituM
                  mitu Global Moderator @jamrom2
                  last edited by

                  @jamrom2 I think so.

                  jamrom2J 1 Reply Last reply Reply Quote 0
                  • jamrom2J
                    jamrom2 @mitu
                    last edited by

                    @mitu thank you. I'll give it a shot and report.

                    jamrom2J 1 Reply Last reply Reply Quote 0
                    • jamrom2J
                      jamrom2 @jamrom2
                      last edited by

                      @jamrom2 well... it kinda works...

                      I get parsing errors and every now and then it picks up a game title. The games it does read are seen as Atari 400/800 titles, which is good. But it doesn't recognize many, and again... a ton of parsing errors when you restart ES.

                      mituM 1 Reply Last reply Reply Quote 0
                      • mituM
                        mitu Global Moderator @jamrom2
                        last edited by

                        @jamrom2 Thanks for the test. I wonder if it's screeenscraper that's wonky of the scraping that's not ok. Are you scraping just the Atari800 system ?

                        jamrom2J 1 Reply Last reply Reply Quote 0
                        • jamrom2J
                          jamrom2 @mitu
                          last edited by

                          @mitu yes, via the ES option. I also tried using Skyscraper from Retropie_Setup from the console, and I got something very similar. Like a lot of truncated info, or not found.

                          I also updated to the latest Retropie Set-up script (but I'll guess you knew that because I updated ES..LOL)

                          mituM 1 Reply Last reply Reply Quote 0
                          • mituM
                            mitu Global Moderator @jamrom2
                            last edited by

                            @jamrom2 said in EmulationStation Sluggish and Scraper Broken with 4.7 Release:

                            @mitu yes, via the ES option. I also tried using Skyscraper from Retropie_Setup from the console, and I got something very similar. Like a lot of truncated info, or not found.

                            Hm, if the same happens from Skyscraper, it may be something on the source site. Can you list some of the ROMs that have issues ? I'll give it a shot from my side and see what's the issue.

                            jamrom2J 2 Replies Last reply Reply Quote 0
                            • jamrom2J
                              jamrom2 @mitu
                              last edited by

                              @mitu

                              thegamesdb and screenscraper both used.

                              worked through ES scraper -
                              Action Biker (1985)(Mastertronic)(US).zip
                              F-15 Strike Eagle (19xx)(MicroProse)[cr The Cruiser].zip
                              H.E.R.O. (1984)(Activision).zip
                              Galaxian (1982)(Atari).zip

                              Failed in ES and Skyscraper:
                              A-E (1982)(Broderbund).zip
                              Archon (1983)(Electronic Arts).zip
                              Goonies, The (1985)(Datasoft).zip
                              Gateway to Apshai (1983)(Epyx).zip

                              mituM 1 Reply Last reply Reply Quote 0
                              • jamrom2J
                                jamrom2 @mitu
                                last edited by jamrom2

                                @mitu

                                Looks like I'm getting the same thing from the Atari ST games as well.

                                Action Fighter (Europe).zip
                                10th Frame (Europe)
                                Afterburner (Europe)

                                well... it scrapes with thegamesdb... but its about 25% of my total 305 games and many of them are standard/popular games.

                                Gonna be a life-time of me doing manual meta inputs... :(

                                1 Reply Last reply Reply Quote 0
                                • mituM
                                  mitu Global Moderator @jamrom2
                                  last edited by

                                  @jamrom2 said in EmulationStation Sluggish and Scraper Broken with 4.7 Release:

                                  A-E (1982)(Broderbund).zip
                                  Archon (1983)(Electronic Arts).zip
                                  Goonies, The (1985)(Datasoft).zip
                                  Gateway to Apshai (1983)(Epyx).zip

                                  I tested scraping these from ScreenScraper (from within EmulationStation) and they seem to work:

                                  9055a9e3-3cbb-4e1c-90a0-507ed17a4c55-image.png

                                  scraper2.png

                                  They're in the Atari800 folder, did you use another folder ?

                                  jamrom2J 2 Replies Last reply Reply Quote 0
                                  • jamrom2J
                                    jamrom2 @mitu
                                    last edited by jamrom2

                                    @mitu yes. They're in the atari800 folder. From my end, it doesn't find anything, then gives this list of errors when I restart ES. Not sure why it's doing this, I've done 41 other systems with no issues. Only two I've seen this with are Atari 800 and Atari ST.

                                    <time and date> ScreenScraperRequest - Error parsing XML..
                                    Start-end tags mismatch

                                    1 Reply Last reply Reply Quote 0
                                    • jamrom2J
                                      jamrom2 @mitu
                                      last edited by jamrom2

                                      @mitu I went back to my build and renamed both the image folder and gamelist file to let it rebuild new ones

                                      I used both sources, but screenscraper seemed to work a lot better. It read the games, many were missing descriptions, but it read them all. Seems like its working now. I'll do the same for the Atari ST files and patch them all up manually so they have descriptions and images if missing any.

                                      Thanks for the help, I'll say it's working...not optimally, but working. Lol.

                                      Now...if you can tell me why the hell my Budgie keeps ripping his feathers out... I'll be good to go. Lol

                                      1 Reply Last reply Reply Quote 0
                                      • First post
                                        Last post

                                      Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                      Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.