RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    EmulationStation Sluggish and Scraper Broken with 4.7 Release

    Scheduled Pinned Locked Moved Help and Support
    retropie 4.7es slowscrape issuesretropie
    42 Posts 11 Posters 9.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P
      Phil_Chambers @mitu
      last edited by

      @mitu You don't need to be rude. As I previously stated it's unable to scrape for ANY AND ALL games I have, that were previously being scraped while on 4.6. So why I would need to provide specific examples escapes me, but I'll give you several examples to humor you.
      Final Fantasy Tactics Advance - GBA
      Legend of Zelda, The Oracle of Ages - GBC
      NBA Jam Tournament Edition - Sega Master System
      Castlevania II - Simon's Quest - NES
      Castlevania - Symphony of the Night - Playstaion
      Donkey Kong Country 2 - SNES
      Metal Slug X - Arcade

      mituM 1 Reply Last reply Reply Quote -1
      • mituM
        mitu Global Moderator @Phil_Chambers
        last edited by

        @phil_chambers I wasn't rude, just merely asking for more details. What scraping source are you using ?

        P 1 Reply Last reply Reply Quote 0
        • P
          Phil_Chambers @mitu
          last edited by

          @mitu The built in scraper that comes installed with stock 4.7.

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @Phil_Chambers
            last edited by

            @phil_chambers The built-in scraper has 2 sources for scraping available

            • TheGamesDB.net
            • ScreenScraper.fr

            You can configure which one is used from the EmulationStation's settings. Right now, ScreenScraper.fr is not accessible for non-registered users, so scraping from that source does not work - it's not a bug in EmulationStation.

            If you change the scraping source and use TheGamesDB, scraping will work.

            P 1 Reply Last reply Reply Quote 0
            • P
              Phil_Chambers @mitu
              last edited by

              @mitu Scraping from TheGamesDB doesn't pull any results for any rom on any system. Is there a system log somewhere I can pull?

              mituM 1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator @Phil_Chambers
                last edited by

                @phil_chambers said in EmulationStation Sluggish and Scraper Broken with 4.7 Release:

                Is there a system log somewhere I can pull?

                EmulationStation has a log in \\retropie\configs\all\emulationstation (es_log.txt), but I don't think that it logs any details about scraping request error (just the error).

                jamrom2J 1 Reply Last reply Reply Quote 0
                • jamrom2J
                  jamrom2 @mitu
                  last edited by

                  @mitu does the new version fix the Atari 800 scraping?

                  mituM 1 Reply Last reply Reply Quote 0
                  • mituM
                    mitu Global Moderator @jamrom2
                    last edited by

                    @jamrom2 I think so.

                    jamrom2J 1 Reply Last reply Reply Quote 0
                    • jamrom2J
                      jamrom2 @mitu
                      last edited by

                      @mitu thank you. I'll give it a shot and report.

                      jamrom2J 1 Reply Last reply Reply Quote 0
                      • jamrom2J
                        jamrom2 @jamrom2
                        last edited by

                        @jamrom2 well... it kinda works...

                        I get parsing errors and every now and then it picks up a game title. The games it does read are seen as Atari 400/800 titles, which is good. But it doesn't recognize many, and again... a ton of parsing errors when you restart ES.

                        mituM 1 Reply Last reply Reply Quote 0
                        • mituM
                          mitu Global Moderator @jamrom2
                          last edited by

                          @jamrom2 Thanks for the test. I wonder if it's screeenscraper that's wonky of the scraping that's not ok. Are you scraping just the Atari800 system ?

                          jamrom2J 1 Reply Last reply Reply Quote 0
                          • jamrom2J
                            jamrom2 @mitu
                            last edited by

                            @mitu yes, via the ES option. I also tried using Skyscraper from Retropie_Setup from the console, and I got something very similar. Like a lot of truncated info, or not found.

                            I also updated to the latest Retropie Set-up script (but I'll guess you knew that because I updated ES..LOL)

                            mituM 1 Reply Last reply Reply Quote 0
                            • mituM
                              mitu Global Moderator @jamrom2
                              last edited by

                              @jamrom2 said in EmulationStation Sluggish and Scraper Broken with 4.7 Release:

                              @mitu yes, via the ES option. I also tried using Skyscraper from Retropie_Setup from the console, and I got something very similar. Like a lot of truncated info, or not found.

                              Hm, if the same happens from Skyscraper, it may be something on the source site. Can you list some of the ROMs that have issues ? I'll give it a shot from my side and see what's the issue.

                              jamrom2J 2 Replies Last reply Reply Quote 0
                              • jamrom2J
                                jamrom2 @mitu
                                last edited by

                                @mitu

                                thegamesdb and screenscraper both used.

                                worked through ES scraper -
                                Action Biker (1985)(Mastertronic)(US).zip
                                F-15 Strike Eagle (19xx)(MicroProse)[cr The Cruiser].zip
                                H.E.R.O. (1984)(Activision).zip
                                Galaxian (1982)(Atari).zip

                                Failed in ES and Skyscraper:
                                A-E (1982)(Broderbund).zip
                                Archon (1983)(Electronic Arts).zip
                                Goonies, The (1985)(Datasoft).zip
                                Gateway to Apshai (1983)(Epyx).zip

                                mituM 1 Reply Last reply Reply Quote 0
                                • jamrom2J
                                  jamrom2 @mitu
                                  last edited by jamrom2

                                  @mitu

                                  Looks like I'm getting the same thing from the Atari ST games as well.

                                  Action Fighter (Europe).zip
                                  10th Frame (Europe)
                                  Afterburner (Europe)

                                  well... it scrapes with thegamesdb... but its about 25% of my total 305 games and many of them are standard/popular games.

                                  Gonna be a life-time of me doing manual meta inputs... :(

                                  1 Reply Last reply Reply Quote 0
                                  • mituM
                                    mitu Global Moderator @jamrom2
                                    last edited by

                                    @jamrom2 said in EmulationStation Sluggish and Scraper Broken with 4.7 Release:

                                    A-E (1982)(Broderbund).zip
                                    Archon (1983)(Electronic Arts).zip
                                    Goonies, The (1985)(Datasoft).zip
                                    Gateway to Apshai (1983)(Epyx).zip

                                    I tested scraping these from ScreenScraper (from within EmulationStation) and they seem to work:

                                    9055a9e3-3cbb-4e1c-90a0-507ed17a4c55-image.png

                                    scraper2.png

                                    They're in the Atari800 folder, did you use another folder ?

                                    jamrom2J 2 Replies Last reply Reply Quote 0
                                    • jamrom2J
                                      jamrom2 @mitu
                                      last edited by jamrom2

                                      @mitu yes. They're in the atari800 folder. From my end, it doesn't find anything, then gives this list of errors when I restart ES. Not sure why it's doing this, I've done 41 other systems with no issues. Only two I've seen this with are Atari 800 and Atari ST.

                                      <time and date> ScreenScraperRequest - Error parsing XML..
                                      Start-end tags mismatch

                                      1 Reply Last reply Reply Quote 0
                                      • jamrom2J
                                        jamrom2 @mitu
                                        last edited by jamrom2

                                        @mitu I went back to my build and renamed both the image folder and gamelist file to let it rebuild new ones

                                        I used both sources, but screenscraper seemed to work a lot better. It read the games, many were missing descriptions, but it read them all. Seems like its working now. I'll do the same for the Atari ST files and patch them all up manually so they have descriptions and images if missing any.

                                        Thanks for the help, I'll say it's working...not optimally, but working. Lol.

                                        Now...if you can tell me why the hell my Budgie keeps ripping his feathers out... I'll be good to go. Lol

                                        1 Reply Last reply Reply Quote 0
                                        • First post
                                          Last post

                                        Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                        Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.