RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping multi disc roms

    Scheduled Pinned Locked Moved Help and Support
    scrapegamelist
    51 Posts 5 Posters 7.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mediamogulM
      mediamogul Global Moderator @HurricaneFan
      last edited by

      @hurricanefan said in Scraping multi disc roms:

      Your build works for me.

      Were you using the dev branch or the method above? I had already compiled based on above earlier and it crashed when scraping a folder. I 'm in and out today, but I'll compile the dev branch next time I'm back and see if it makes any difference.

      RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

      HurricaneFanH 1 Reply Last reply Reply Quote 1
      • pjftP
        pjft @HurricaneFan
        last edited by pjft

        @hurricanefan you're very kind, I appreciate the offer. It isn't necessary though:)

        My previous dev pi is now being used for an arcade build I put together in the past few weeks, so I try to be careful not to break it much with my development shenanigans:)

        In today's case I actually didn't have access to a pi at the time to test, as I was accessing it remotely, just that.

        I was waiting for the Pi foundation birthday to see if they'd launch a new model, but it's not the case so I'm buying a new 3 for developing on.

        Thank you for testing.

        @mediamogul the dev branch and my branch are exactly the same as the PR has been accepted already. Actually, I also fixed something in regards to the collection paths that has been broken in the dev branch so that'll be the most advisable build to run things these days. My branch doesn't yet have that fix I also submitted today.

        Edit: hm. You're suggesting you had built my branch and it crashed. If you could test it again let me know how it goes. It might have been something else I missed. Exact steps on how you get it to crash can help. But if you find that the dev branch works then that's what matters as that's what's final in the end.

        Thanks both for flagging this and helping out! Have a great weekend.

        1 Reply Last reply Reply Quote 1
        • HurricaneFanH
          HurricaneFan @mediamogul
          last edited by

          @mediamogul I used the exact instructions pjft provided in his post.

          mediamogulM 1 Reply Last reply Reply Quote 0
          • mediamogulM
            mediamogul Global Moderator @HurricaneFan
            last edited by mediamogul

            @pjft, @hurricanefan

            I'll give it another go later this evening.

            Exact steps on how you get it to crash can help.

            I highlighted a folder in ES without any prior metadata attached to it and selected the scraping option from the menu. The folder name was 'The Oregon Trail', so it discovered quite a few options. I selected one, which then left me at the menu to save. After selecting the 'save' option, the crash happens immediately.

            RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

            pjftP 1 Reply Last reply Reply Quote 0
            • pjftP
              pjft @mediamogul
              last edited by

              @mediamogul from your description, that's the exact issue I addressed. Let me know. Best.

              mediamogulM 1 Reply Last reply Reply Quote 0
              • mediamogulM
                mediamogul Global Moderator @pjft
                last edited by

                @pjft

                OK, I tried the one from your branch one more time and still got the crash. However, I then tried the dev branch and no crash at all. I tested it further by scraping multiple folders and game files. I also tested manual metadata additions and it still held up. I want to test a few more scenarios tomorrow such as scraping script files, but for now it's been a crazy long day and I'm looking to break out the Scotch and unwind a little. It really looks like you've nailed this thing down and it'll be great to have this feature back.

                RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                pjftP 1 Reply Last reply Reply Quote 2
                • pjftP
                  pjft @mediamogul
                  last edited by

                  @mediamogul good to hear. Maybe I gave you the wrong instructions, so I wouldn't worry about my branch. Glad that the dev one works for you.

                  mediamogulM 2 Replies Last reply Reply Quote 0
                  • mediamogulM
                    mediamogul Global Moderator @pjft
                    last edited by

                    @pjft said in Scraping multi disc roms:

                    Maybe I gave you the wrong instructions

                    I'm sure the issue was on my end in some way. I'm just thrilled everything's set now. I plan on testing a few more scenarios around lunch, but I really think you got the crash licked.

                    RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                    1 Reply Last reply Reply Quote 2
                    • mediamogulM
                      mediamogul Global Moderator @pjft
                      last edited by mediamogul

                      @pjft

                      After testing several scenarios, your fix held up every time in both manually and automatically adding metadata to a directory. I also tested many individual game files for any possible issues that may have sprung up and everything seems to be working well there too. This was stellar work and is most appreciated. Also, thank you to @HurricaneFan for first bringing the issue to light and helping to troubleshoot.

                      RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                      pjftP 1 Reply Last reply Reply Quote 2
                      • pjftP
                        pjft @mediamogul
                        last edited by

                        @mediamogul not at all. A big part of the work was bisecting it, so thank you very much for all the help!

                        mediamogulM 1 Reply Last reply Reply Quote 3
                        • mediamogulM
                          mediamogul Global Moderator @pjft
                          last edited by

                          @pjft, @BuZz

                          It's been a while since this issue was fixed and it still doesn't seem to have made it into the main branch. Was there an issue of some sort, or has it just been lost in the mix? I haven't installed the development branch in a while, does it still exist there?

                          RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                          pjftP 1 Reply Last reply Reply Quote 1
                          • pjftP
                            pjft @mediamogul
                            last edited by

                            @mediamogul I wish I had a better answer here. I'm not really sure there's a proper graduation path from dev features to master. In fact, in hindsight, this breakdown was introduced when there was a lot of entropy because of multiple parallel developments that had an impact across the board - I recall power savings and some internal refactoring taking place at the same time.

                            Still, given that there's not a lot of meaty new development in ES these days, and the last meaningful changes took place quite a while back, it could make sense to consider a different approach so that new features are released faster?

                            mediamogulM 1 Reply Last reply Reply Quote 1
                            • mediamogulM
                              mediamogul Global Moderator @pjft
                              last edited by mediamogul

                              @pjft said in Scraping multi disc roms:

                              Still, given that there's not a lot of meaty new development in ES these days, and the last meaningful changes took place quite a while back, it could make sense to consider a different approach so that new features are released faster?

                              Sorry for the late response... Holidays, ho ho ho and all. I know I would be all for that personally. Especially when it comes to releasing quality of life bug fixes like this. Editing the gamelists by hand is no fun. I believe the 'Last Played' limit has also yet to make it out of the development branch.

                              RetroPie v4.5 • RPi3 Model B • 5.1V 2.5A PSU • 16GB SanDisk microSD • 512GB External Drive

                              1 Reply Last reply Reply Quote 1
                              • First post
                                Last post

                              Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                              Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.