RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraper not getting all.

    Scheduled Pinned Locked Moved Help and Support
    screensaver vid
    27 Posts 3 Posters 2.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • U
      ucald4amarine @mitu
      last edited by

      @mitu correction on my part. I thought arcade games were playing on the menu. I was wrong. Fba games were playing, but NOTHING from arcade will display. Almost like the scraper didn't collect dfeom there at all.

      ClydeC 1 Reply Last reply Reply Quote 0
      • U
        ucald4amarine @mitu
        last edited by

        @mitu ahh. Sorry mitu. I'll try to find that in a bit. Kids are up and hungry.

        1 Reply Last reply Reply Quote 0
        • ClydeC
          Clyde @ucald4amarine
          last edited by

          @ucald4amarine said in Scraper not getting all.:

          Fba games were playing, but NOTHING from arcade will display. Almost like the scraper didn't collect dfeom there at all.

          Are there any video files in arcade/images?

          Is there a text file named gamelist.xml in arcade?

          If so, are there <video> tags for the videos in the gamelist.xml file?

          U 2 Replies Last reply Reply Quote 0
          • U
            ucald4amarine @Clyde
            last edited by

            @Clyde I think I saw a game list file, don't remember the rest. I'll check on that asap

            1 Reply Last reply Reply Quote 0
            • U
              ucald4amarine @Clyde
              last edited by

              @Clyde On that, it just popped up with: Permission Denied. That was all.

              1 Reply Last reply Reply Quote 0
              • U
                ucald4amarine @Clyde
                last edited by

                @Clyde In answer to your question on the video files. There is indeed a game list. and an image file. The image file is full of images for the game. As far as the gamelist.xml, it is there. And the <video> tag is there as well. Ill copy and paste it below:

                <marquee>./images/aburner-marquee.png</marquee>
                	<video>./images/aburner-video.mp4</video>
                	<cloneof>aburner2</cloneof>
                

                Thats what your looking for correct?

                1 Reply Last reply Reply Quote 0
                • U
                  ucald4amarine @mitu
                  last edited by

                  @mitu Im not sure how to go about your instructions. Am I litterally supposed to copy cp ~/.emulationstation/es_log.txt ~/RetroPie/roms into the roms file?
                  Once again, please forgive my lack of knowledge.

                  1 Reply Last reply Reply Quote 0
                  • U
                    ucald4amarine
                    last edited by

                    Just out of interest, I went ahead and pulled up the scraper again and told it to scrape the games using alternate sources. (Screenscraper, Arcadetalia, Etc.) and I watched the system do its thing. I observed that it blasted through the entire arcade listing, didnt throw a single error message. Whereas the games in other systems that it had skipped over previously, (battletoads in the megadrive for example.) it showed an error message and skipped to the next.

                    1 Reply Last reply Reply Quote 0
                    • U
                      ucald4amarine
                      last edited by

                      new info to share. Ive pulled 3 different videos from the Pi and put them on my computer to watch.
                      1, bubsy, works. And Im able to view it as an mp4.
                      2, afterburner, calls itself a mp4, will play sound, but no more.
                      3, battletoads, again, an mp4, when I try to play it comes up with an error stating that the file is unsupported, or the file is corrupt.

                      U 1 Reply Last reply Reply Quote 0
                      • U
                        ucald4amarine @ucald4amarine
                        last edited by

                        @ucald4amarine solved! Deleted all videos, rescrapped from the source: screenscraper. And, it still doesn't have all games. But it has enough that I'm happy. Or, happier.

                        ClydeC 1 Reply Last reply Reply Quote 0
                        • ClydeC
                          Clyde @ucald4amarine
                          last edited by

                          @ucald4amarine That's nice to hear. Some games can be missing because their checksum isn't included in the scraping source. You could try to scrape them manually from within Emulation Station. It doesn't scrape videos, though. So, you would have to add them manually from YouTube etc.

                          Happy new year!

                          U 1 Reply Last reply Reply Quote 0
                          • U
                            ucald4amarine @Clyde
                            last edited by

                            @Clyde that's an idea. There really aren't many missing. But a simple scrape from an alternate source wouldn't take more than a hour or so of my time. That's great! Thanks everyone!

                            ClydeC 1 Reply Last reply Reply Quote 0
                            • ClydeC
                              Clyde @ucald4amarine
                              last edited by

                              @ucald4amarine said in Scraper not getting all.:

                              @Clyde But a simple scrape from an alternate source wouldn't take more than a hour or so of my time.

                              Then it remains an option for those games which aren't included in any of the online databases. Glad that you like it. :)

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post

                              Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                              Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.