• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login

[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

Scheduled Pinned Locked Moved Projects and Themes
scrapescraperuxs
728 Posts 111 Posters 739.9k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • H
    hansolo77 @AlexMurphy
    last edited by 26 May 2017, 23:04

    @AlexMurphy Ah.. is there a utility to batch process this?

    Who's Scruffy Looking?

    A 1 Reply Last reply 26 May 2017, 23:24 Reply Quote 0
    • A
      AlexMurphy Banned @hansolo77
      last edited by 26 May 2017, 23:24

      @hansolo77 Again, handbrake is often spoken of.

      1 Reply Last reply Reply Quote 0
      • H
        hansolo77
        last edited by 27 May 2017, 13:12

        Thanks I'll give it a try.

        Who's Scruffy Looking?

        1 Reply Last reply Reply Quote 0
        • H
          hansolo77 @screech
          last edited by hansolo77 28 May 2017, 02:13

          @screech where do I find the settings for this "RomsExcluded" functionality? Is it built into the program, or is it something I have to manually add to the ini? When I scrape SegaCD I still get multiple entries for the same game. Here is an example of the artwork it creates:

          https://pastebin.com/UVQY7egb

          Who's Scruffy Looking?

          R 1 Reply Last reply 28 May 2017, 10:20 Reply Quote 0
          • R
            Rion @hansolo77
            last edited by Rion 28 May 2017, 10:20

            @hansolo77 Your img files are split in to multiple bin files. Rebuild your Redump games by mounting the image. Select your cue file and mount it. Make new image with imgburn.

            That will produce one bin/img file and one cue file.

            FBNeo rom filtering
            Mame2003 Arcade Bezels
            Fba Arcade Bezels
            Fba NeoGeo Bezels

            1 Reply Last reply Reply Quote 0
            • H
              hansolo77
              last edited by hansolo77 28 May 2017, 12:13

              That sounds too easy. :) Will the emulators for Sega read bin/cue? I thought I read somewhere the files had to be bin/cue/wav.

              Who's Scruffy Looking?

              1 Reply Last reply Reply Quote 0
              • S
                screech
                last edited by 28 May 2017, 13:05

                @hansolo77
                Normally the RomsExcluded is already in the Retropie.xml Profil.
                But maybe it won't work, I haven't so much tested this :S

                The best way still to exclude *.wav from the scrape or like Rion Say : Create a cue+bin and scrape the cue.

                1 Reply Last reply Reply Quote 0
                • H
                  hansolo77
                  last edited by 28 May 2017, 14:07

                  Yeah, my xml has it listed, but it didn't catch it. I'm trying to rebuild bin/cue images now.

                  Who's Scruffy Looking?

                  1 Reply Last reply Reply Quote 0
                  • H
                    hooperre
                    last edited by 28 May 2017, 16:57

                    @screech Good news. Was able to download the new XML update without any firewall/Windows defender hits.

                    4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                    1 Reply Last reply Reply Quote 0
                    • H
                      hansolo77
                      last edited by 28 May 2017, 17:47

                      Ok, so mounting the images and remaking them in bin/cue doesn't work. For some reason, I'm now only able to scrap about 3 games. :(

                      Who's Scruffy Looking?

                      1 Reply Last reply Reply Quote 0
                      • H
                        hansolo77
                        last edited by 28 May 2017, 22:20

                        :( I'm having all kinds of problems now. I managed to get my SegaCD to scrape with only 1 entry for each finally. Now I'm trying to re-scrape my PSX path. It goes through the "Please wait testing server.." then says it will kill EmulationStation. I click "OK" then it gives me an error "Roms path can't be reached". It's ubsurd. I don't know why it's giving me this error. I checked, and I can access the path fine.

                        In Putty:

                        pi@retropie:~ $ cd /home/pi/RetroPie/roms/psx
                        pi@retropie:~/RetroPie/roms/psx $
                        

                        With a keyboard connected to the PI:

                        pi@retropie:~ $ cd /home/pi/RetroPie/roms/psx
                        pi@retropie:~/RetroPie/roms/psx $
                        

                        Through SFTP:
                        /home/pi/RetroPie/roms/psx

                        Everything works. So why is UXS telling me it can't access the path?! Argh!

                        Who's Scruffy Looking?

                        1 Reply Last reply Reply Quote 0
                        • A
                          AndersHP
                          last edited by 31 May 2017, 19:18

                          Is Universal XML working when you boot roms off a USB?
                          I've connected to my Pie via Windows 10, and can see that the scraper makes images in the home/pi/.emulationstation/downloaded_images folder, and the corresponding home/pi/.emulationstation/gamelist links to the above mentioned images, but the images does not show, and it seems that it's still the old scraping from the built-in / sselph scraper metadata that's showing underneath the games.

                          I can see that in my other games folders, the gamelist is in the roms folder, but for this particular folder, it's not there. So where does it get the old metadata from? And how do I reset all this old metadata and start using Universal XML with my roms running off a usb?

                          My "Bubble Bobble" Themed Bartop Arcade
                          My Gameboy

                          K 1 Reply Last reply 31 May 2017, 19:44 Reply Quote 0
                          • K
                            kbronctjr @AndersHP
                            last edited by 31 May 2017, 19:44

                            @AndersHP I have my roms on a usb and have a symlink from the usb0 to the roms folder and the scraping is working well

                            A 1 Reply Last reply 31 May 2017, 20:09 Reply Quote 0
                            • A
                              AndersHP @kbronctjr
                              last edited by 31 May 2017, 20:09

                              @kbronctjr I'm using the standard method with the automounting, I thought this was preferred.

                              I still don't understand where the old metadata is, when there's no gamelist in the roms folder..

                              My "Bubble Bobble" Themed Bartop Arcade
                              My Gameboy

                              K 1 Reply Last reply 31 May 2017, 20:10 Reply Quote 0
                              • K
                                kbronctjr @AndersHP
                                last edited by 31 May 2017, 20:10

                                @AndersHP you should have your gamelist home/pi/.emulationstation/gamelist anyway

                                A 2 Replies Last reply 31 May 2017, 20:12 Reply Quote 0
                                • A
                                  AndersHP @kbronctjr
                                  last edited by AndersHP 6 Jan 2017, 07:05 31 May 2017, 20:12

                                  @kbronctjr it's there. Universal XML Scraper made it. The content of this list looks good, and links to the scraped images. But the games do not read this list. That's what I don't understand.

                                  My "Bubble Bobble" Themed Bartop Arcade
                                  My Gameboy

                                  1 Reply Last reply Reply Quote 0
                                  • A
                                    AndersHP @kbronctjr
                                    last edited by 31 May 2017, 20:27

                                    @kbronctjr the way I see it is that because I've scraped with the built-in scraper or sselphs, the system looks for images in the images-subfolder of the roms folder. Doesn't use the gameslist in the .emulationstation folder at all!
                                    So should I uninatall sselphs scraper before I can get the system to use the gameslist?

                                    My "Bubble Bobble" Themed Bartop Arcade
                                    My Gameboy

                                    K 1 Reply Last reply 31 May 2017, 20:28 Reply Quote 0
                                    • K
                                      kbronctjr @AndersHP
                                      last edited by 31 May 2017, 20:28

                                      @AndersHP When I scraped with the visual builtin scraper I had also the images an game list inhome/pi/.emulationstation/

                                      A 1 Reply Last reply 31 May 2017, 20:34 Reply Quote 0
                                      • A
                                        AndersHP @kbronctjr
                                        last edited by AndersHP 6 Jan 2017, 07:07 31 May 2017, 20:34

                                        @kbronctjr so it must be the sselph scraper that makes a gameslist and images folder in the roms folder. I'll try uninstalling sselphs scraper then...

                                        My "Bubble Bobble" Themed Bartop Arcade
                                        My Gameboy

                                        1 Reply Last reply Reply Quote 0
                                        • S
                                          SonPluck
                                          last edited by 2 Jun 2017, 18:45

                                          Where do the images come from? for the rom's.

                                          E 1 Reply Last reply 2 Jun 2017, 22:31 Reply Quote 0
                                          532 out of 728
                                          • First post
                                            532/728
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received