RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping multi disc roms

    Scheduled Pinned Locked Moved Help and Support
    scrapegamelist
    51 Posts 5 Posters 7.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • HurricaneFanH
      HurricaneFan
      last edited by

      Got a question on how other people have scraped Multi Disc roms (examples: PSX, SEGA CD).

      Do you have 2 entries in your gamelist? Do they both say the same Game Title?

      1 Reply Last reply Reply Quote 0
      • SanoS
        Sano
        last edited by

        I create a folder for each multi disc game, and I scrape the folder :)

        HurricaneFanH 1 Reply Last reply Reply Quote 2
        • HurricaneFanH
          HurricaneFan @Sano
          last edited by

          @sano HA, I just tried this method. EmulationStation crashes to the command prompt with:

          terminate called after throwing an instance of 'std::out_of_range'
          what():  map::at
          Aborted
          

          Can't type anything at the command prompt after this happens. Had to hard reboot my pi.

          1 Reply Last reply Reply Quote 0
          • SanoS
            Sano
            last edited by Sano

            You pressed select on the folder, then edit game metadata, and scrape ?
            I'll try to reproduce.
            @pjft are you aware of this ?

            Edit : I wasn't able to reproduce the crash. Could you tell us more about your setup ?
            (ES and retropie-setup versions, last update, ... see https://retropie.org.uk/forum/topic/3/read-this-first )

            HurricaneFanH 1 Reply Last reply Reply Quote 0
            • HurricaneFanH
              HurricaneFan @Sano
              last edited by

              @sano I am running Retropie version 4.2.10, theme is Carbon.

              I did exactly what you stated, select > edit metadata > Click Save and poof it crashes.

              It's repeatable on my build.

              1 Reply Last reply Reply Quote 0
              • pjftP
                pjft
                last edited by pjft

                Not aware. Might be easier to diagnose if you share details on the file formats, the games at hand and gamelist content for those systems you're scraping. When exactly does it crash though? Are you connected to the internet?

                A short video would also help I imagine - it can be a crash in the scraper, in rendering, in saving...

                Edit: what EmulationStation version, not that I'd imagine would make much difference?

                mediamogulM 1 Reply Last reply Reply Quote 0
                • mediamogulM
                  mediamogul Global Moderator @pjft
                  last edited by mediamogul

                  @pjft

                  Just tried this on a folder for the Apple II system on my 4.2.10 setup using the Carbon theme and got the same result. This might also be as good an opportunity as any to mention a minor cosmetic issue in Emulation Station regarding the verbiage of scraping. Currently it reads "Scrape Metadata for this Game". Seeing as how scraping can be very useful for folders and visible shell scripts, would it not be better for it to read, "Scrape Metadata for this Item"?

                  RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                  pjftP 1 Reply Last reply Reply Quote 1
                  • pjftP
                    pjft @mediamogul
                    last edited by

                    @mediamogul same result as in crashing?

                    It could be renamed. To be honest I'm not sure quite familiar with the scraper - both in terms of code as well as in terms of what it's supposed to do. Meaning: I'm not sure it's supposed to work on folders (notwithstanding the fact that it may or may not effectively work).

                    mediamogulM 1 Reply Last reply Reply Quote 0
                    • mediamogulM
                      mediamogul Global Moderator @pjft
                      last edited by mediamogul

                      @pjft said in Scraping multi disc roms:

                      same result as in crashing?

                      Yes indeed.

                      I'm not sure it's supposed to work on folders

                      It could have always been a happy accident, but until recently, it worked very well.

                      RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                      pjftP 1 Reply Last reply Reply Quote 0
                      • pjftP
                        pjft @mediamogul
                        last edited by

                        @mediamogul happy accidents are the best kind of accidents, though let's assume it's supposed to work.

                        Can you describe to me the folder structure, content of root and sub folders you're trying to scrape?

                        As I mentioned, a video may help.

                        I likely won't pick this up anytime soon, but can add it to the backlog.

                        Ideally/alternatively I'd certainly recommend creating a bug, for tracking, especially after we are able to narrow down the cause.

                        Thanks.

                        mediamogulM 1 Reply Last reply Reply Quote 0
                        • mediamogulM
                          mediamogul Global Moderator @pjft
                          last edited by

                          @pjft

                          Can you describe to me the folder structure, content of root and sub folders you're trying to scrape?

                          Sure. This particular example is about as basic as it gets. There's one folder and two items inside.

                          /The Oregon Trail/
                          Oregon Trail (Disk 1 of 2).dsk
                          Oregon Trail (Disk 1 of 2).dsk

                          Ideally/alternatively I'd certainly recommend creating a bug, for tracking, especially after we are able to narrow down the cause.

                          I'll go ahead and do that now.

                          RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                          1 Reply Last reply Reply Quote 0
                          • HurricaneFanH
                            HurricaneFan
                            last edited by

                            Yeah, My scenario was I had a folder inside the SegaCD folder and 2 bin and 2 cue files in that folder. When I try to scrape the folder, it finds the data and image for the game. But when you hit the save icon. Hard crash to command line with no way of using your keyboard any more.

                            1 Reply Last reply Reply Quote 0
                            • C
                              clueless
                              last edited by

                              Hi, sorry to necro but this is the only relevant thread I found.
                              Did you ever find a solution to this problem? The same thing happens to me when trying to save metadata/scrape to folders. It's annoying because for some reason the folder is named wrong in ES and trying to change it manually kicks me out of ES when I click save, requiring me to pull the power plug as no input will work afterwards.

                              HurricaneFanH 1 Reply Last reply Reply Quote 0
                              • HurricaneFanH
                                HurricaneFan @clueless
                                last edited by

                                @clueless An issue was filed but its still a bug.

                                https://github.com/RetroPie/EmulationStation/issues/186

                                C 1 Reply Last reply Reply Quote 0
                                • C
                                  clueless @HurricaneFan
                                  last edited by

                                  @hurricanefan thank you

                                  1 Reply Last reply Reply Quote 0
                                  • mediamogulM
                                    mediamogul Global Moderator
                                    last edited by mediamogul

                                    Rather than clutter the Github issue with potential theories, I thought I might float one here first. This issue seems to coincide with the addition of the 'Favorites' feature, dating around the last few weeks of last July. I've noticed that you cannot add a folder as a favorite, but tonight I got curious to see what would happen if I manually added the 'favorite' MD tag to a folder.

                                    Anticlimactically, ES launched without so much as an error, while simply ignoring the folder in the 'favorites' list. However, the folder was in fact showing as being a favorite in the MD inspector. I'm wondering if the fact that folders are not fully accounted for as being a valid option for the favorite MD tag is somehow related to the "out of range" instance that's being thrown.

                                    RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                                    pjftP 1 Reply Last reply Reply Quote 1
                                    • pjftP
                                      pjft @mediamogul
                                      last edited by

                                      @mediamogul Sure, I'll bite since you're bringing up the favorites feature here as potentially related. :)

                                      It may certainly be related, I can't say otherwise. Thanks for trying to narrow it down. I do confirm that folders aren't designed to be treated any different if they're marked as favorites (though I'm not even sure there's a legit way to make that happen from within ES).

                                      Would you be open to doing some good old-fashioned bisecting using git? I'm happy to help with it here.

                                      Thanks!

                                      mediamogulM 1 Reply Last reply Reply Quote 0
                                      • mediamogulM
                                        mediamogul Global Moderator @pjft
                                        last edited by mediamogul

                                        @pjft said in Scraping multi disc roms:

                                        Would you be open to doing some good old-fashioned bisecting using git?

                                        Certainly. Git bisecting is something I've been very interested to learn more about. I've just looked over the man page and it seems reasonably straightforward. I'll read more about general use and application later today and see if I can't get to a jumping off point.

                                        RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                                        pjftP 1 Reply Last reply Reply Quote 0
                                        • pjftP
                                          pjft @mediamogul
                                          last edited by

                                          @mediamogul oh, great! Let me also share some pointers later as I'm sure I've written something about that in the past that may be helpful. :)

                                          mediamogulM 1 Reply Last reply Reply Quote 0
                                          • mediamogulM
                                            mediamogul Global Moderator @pjft
                                            last edited by

                                            @pjft

                                            That would be most helpful, thanks!

                                            RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.