RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraper not getting all.

    Scheduled Pinned Locked Moved Help and Support
    screensaver vid
    27 Posts 3 Posters 2.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • U
      ucald4amarine @mitu
      last edited by

      @mitu just tried running the command. And was given the message: permission denied. (I started in emulation station, hit f4, and typed the command there.)

      mituM ClydeC 2 Replies Last reply Reply Quote 0
      • U
        ucald4amarine @Clyde
        last edited by

        @Clyde can't seem to get those commands to work. An additional mystery, every time Ive started the arcade up before running the scraper, it would play a random video on startup. (Set it on random and gave it 5 vids to go through. ) Now, after running the scraper, it will only play the one video, and the sound is really bad. Dunno if it has anything to do with this. But it seems odd.

        1 Reply Last reply Reply Quote 0
        • mituM
          mitu Global Moderator @ucald4amarine
          last edited by

          @ucald4amarine That's not a command, but a file. You're suppose to get its contents uploaded to pastebin.com, not to execute it. Copy it to your ROMs folder and then open it from your PC with Notepad and upload it to pastebin.com

          cp ~/.emulationstation/es_log.txt ~/RetroPie/roms
          
          U 2 Replies Last reply Reply Quote 0
          • ClydeC
            Clyde @ucald4amarine
            last edited by

            @ucald4amarine Mitu didn't give you a command. Do you mean mine?

            However, please be more elaborate about how you "can't seem to get those commands to work".

            May you have mistyped them? What errors came up?

            U 1 Reply Last reply Reply Quote 0
            • U
              ucald4amarine @mitu
              last edited by

              @mitu correction on my part. I thought arcade games were playing on the menu. I was wrong. Fba games were playing, but NOTHING from arcade will display. Almost like the scraper didn't collect dfeom there at all.

              ClydeC 1 Reply Last reply Reply Quote 0
              • U
                ucald4amarine @mitu
                last edited by

                @mitu ahh. Sorry mitu. I'll try to find that in a bit. Kids are up and hungry.

                1 Reply Last reply Reply Quote 0
                • ClydeC
                  Clyde @ucald4amarine
                  last edited by

                  @ucald4amarine said in Scraper not getting all.:

                  Fba games were playing, but NOTHING from arcade will display. Almost like the scraper didn't collect dfeom there at all.

                  Are there any video files in arcade/images?

                  Is there a text file named gamelist.xml in arcade?

                  If so, are there <video> tags for the videos in the gamelist.xml file?

                  U 2 Replies Last reply Reply Quote 0
                  • U
                    ucald4amarine @Clyde
                    last edited by

                    @Clyde I think I saw a game list file, don't remember the rest. I'll check on that asap

                    1 Reply Last reply Reply Quote 0
                    • U
                      ucald4amarine @Clyde
                      last edited by

                      @Clyde On that, it just popped up with: Permission Denied. That was all.

                      1 Reply Last reply Reply Quote 0
                      • U
                        ucald4amarine @Clyde
                        last edited by

                        @Clyde In answer to your question on the video files. There is indeed a game list. and an image file. The image file is full of images for the game. As far as the gamelist.xml, it is there. And the <video> tag is there as well. Ill copy and paste it below:

                        <marquee>./images/aburner-marquee.png</marquee>
                        	<video>./images/aburner-video.mp4</video>
                        	<cloneof>aburner2</cloneof>
                        

                        Thats what your looking for correct?

                        1 Reply Last reply Reply Quote 0
                        • U
                          ucald4amarine @mitu
                          last edited by

                          @mitu Im not sure how to go about your instructions. Am I litterally supposed to copy cp ~/.emulationstation/es_log.txt ~/RetroPie/roms into the roms file?
                          Once again, please forgive my lack of knowledge.

                          1 Reply Last reply Reply Quote 0
                          • U
                            ucald4amarine
                            last edited by

                            Just out of interest, I went ahead and pulled up the scraper again and told it to scrape the games using alternate sources. (Screenscraper, Arcadetalia, Etc.) and I watched the system do its thing. I observed that it blasted through the entire arcade listing, didnt throw a single error message. Whereas the games in other systems that it had skipped over previously, (battletoads in the megadrive for example.) it showed an error message and skipped to the next.

                            1 Reply Last reply Reply Quote 0
                            • U
                              ucald4amarine
                              last edited by

                              new info to share. Ive pulled 3 different videos from the Pi and put them on my computer to watch.
                              1, bubsy, works. And Im able to view it as an mp4.
                              2, afterburner, calls itself a mp4, will play sound, but no more.
                              3, battletoads, again, an mp4, when I try to play it comes up with an error stating that the file is unsupported, or the file is corrupt.

                              U 1 Reply Last reply Reply Quote 0
                              • U
                                ucald4amarine @ucald4amarine
                                last edited by

                                @ucald4amarine solved! Deleted all videos, rescrapped from the source: screenscraper. And, it still doesn't have all games. But it has enough that I'm happy. Or, happier.

                                ClydeC 1 Reply Last reply Reply Quote 0
                                • ClydeC
                                  Clyde @ucald4amarine
                                  last edited by

                                  @ucald4amarine That's nice to hear. Some games can be missing because their checksum isn't included in the scraping source. You could try to scrape them manually from within Emulation Station. It doesn't scrape videos, though. So, you would have to add them manually from YouTube etc.

                                  Happy new year!

                                  U 1 Reply Last reply Reply Quote 0
                                  • U
                                    ucald4amarine @Clyde
                                    last edited by

                                    @Clyde that's an idea. There really aren't many missing. But a simple scrape from an alternate source wouldn't take more than a hour or so of my time. That's great! Thanks everyone!

                                    ClydeC 1 Reply Last reply Reply Quote 0
                                    • ClydeC
                                      Clyde @ucald4amarine
                                      last edited by

                                      @ucald4amarine said in Scraper not getting all.:

                                      @Clyde But a simple scrape from an alternate source wouldn't take more than a hour or so of my time.

                                      Then it remains an option for those games which aren't included in any of the online databases. Glad that you like it. :)

                                      1 Reply Last reply Reply Quote 0
                                      • First post
                                        Last post

                                      Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                      Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.