• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login

[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

Scheduled Pinned Locked Moved Projects and Themes
scrapescraperuxs
728 Posts 111 Posters 737.2k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S
    screech
    last edited by 7 Feb 2017, 13:08

    UXS only Scrape ;)

    The Layout is in the theming (and need the right version of Retropie to work ;) )

    1 Reply Last reply Reply Quote 0
    • S
      Squilenator @screech
      last edited by 7 Feb 2017, 13:28

      @screech Nintendo NES

      1 Reply Last reply Reply Quote 0
      • J
        Jeck11
        last edited by 7 Feb 2017, 13:47

        I just downloaded from the github and my Windows Defender registered a couple hits from it: 0_1486475237403_2017-02-07 08_45_51-Windows Defender.png

        Anyone else noticed anything weird?

        1 Reply Last reply Reply Quote 0
        • D
          Dukafleed
          last edited by 7 Feb 2017, 18:16

          screech, i have been using your tool for sometime and i can say it is the best artwork provider (specially the 3 in 1 feature)

          are you looking to expand itin include a rom metadata manager where you can fetch info and edit them accordingly by rom or roms ?

          1 Reply Last reply Reply Quote 0
          • B
            BORIStheBLADE1
            last edited by 9 Feb 2017, 20:08

            OK so with version 2.1.0.5 I was able to scrap all my rom sets and every thing came back 100%. I updated to 2.1.0.6 and it wouldn't scrap the same rom sets 100%. Also every other time I'd try to use it, it would say something about losing connection. So I have reverted back to 2.1.0.5 and everything is working right again.

            1 Reply Last reply Reply Quote 0
            • H
              hooperre @Tasio
              last edited by 16 Feb 2017, 16:32

              @Tasio

              • I think creating files and folder when first lunch may not be a good idea unless you ask for confirmation, many pleople try to open open downloaded software from the browser.

              If I may add something specific... I think overwriting the XML file without confirmation is quite detrimental and, if not backed up, can cause a major headache for anyone who has done video set ups and things of that nature.

              4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

              1 Reply Last reply Reply Quote 0
              • H
                hooperre
                last edited by hooperre 16 Feb 2017, 16:48

                I'm wondering a way to get specific files that were missed. When I first downloaded roms (as a 10 year old 10 years ago) I renamed everything because I didn't understand why there were (rev a) or (USA) or (U)'s attached in the romsets. I just wanted 1 game with an easy title. So a few (overall it did a great job identifying my games) games were not picked up. One that doesn't make much sense to me is Donkey Kong Country 2 and 3. I'll use DKC3 as my example.

                My file name is simply: "Donkey Kong Country 3 - Dixie Kong's Double Trouble.zip"

                So I went to the game page on screenscraper.fr and created a fake new (text) file and renamed it one of the 'Associated File Names' directly from the file name section: "Donkey Kong Country 3 - Dixie Kong's Double Trouble! (USA) (En, Fr) .zip" and "Donkey Kong Country 3 - Dixie Kong's Double Trouble! (USA) (En, Fr) .sfc". (File extension was correct, not just renamed with a .txt extension.)

                Re-ran the scraper and no luck. This method did work for Mega Man 8 and Dragon Ball Z - Hyper Dimension, however. Is there some trick to this that I'm missing?

                4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                T 1 Reply Last reply 19 Feb 2017, 02:41 Reply Quote 0
                • H
                  hansolo77
                  last edited by 16 Feb 2017, 20:36

                  I think the scraper will use rom name only as a last resort, and will use a hash check first. The hash shouldn't have changed if the name is all that has.

                  Who's Scruffy Looking?

                  1 Reply Last reply Reply Quote 0
                  • D
                    davidgrohl Banned
                    last edited by 16 Feb 2017, 20:59

                    Hi,
                    I would to try this program with retro pie running on raspberry pi 3.
                    Is it possibile to scrap my roms and transfer result on retropie?

                    Thanks

                    1 Reply Last reply Reply Quote 0
                    • T
                      Tasio @hooperre
                      last edited by 19 Feb 2017, 02:41

                      @hooperre what worked best for me was getting the missing roms from a good source.

                      1 Reply Last reply Reply Quote 0
                      • F
                        FlyingTomahawk
                        last edited by FlyingTomahawk 19 Feb 2017, 03:10

                        Notebook: Acer, i5, 4GB RAM etc...
                        OS: Windows 7 64-bit

                        Downloaded this form github into my downloads folder.
                        Extracted there and tried to run the program with either Scraper64.exe or Scraper.exe but nothing happens, nothing loads, no process is started.
                        Looking at the task manager there is no indication that this program was started.
                        Deactivated firewall and anti-virus software, still no luck.
                        Did I miss a step?

                        P 1 Reply Last reply 19 Feb 2017, 03:13 Reply Quote 0
                        • P
                          paradadf @FlyingTomahawk
                          last edited by 19 Feb 2017, 03:13

                          @FlyingTomahawk why do some people doesn't look into the releases page like in almost any other project?
                          https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

                          F 1 Reply Last reply 19 Feb 2017, 03:18 Reply Quote 0
                          • F
                            FlyingTomahawk @paradadf
                            last edited by FlyingTomahawk 19 Feb 2017, 03:18

                            @paradadf

                            Lesson learned, thank you.

                            1 Reply Last reply Reply Quote 0
                            • F
                              FlyingTomahawk
                              last edited by FlyingTomahawk 19 Feb 2017, 04:07

                              @screech
                              Fantastic work!
                              Just played around with it and it is not only fast but also gives you tons of options.
                              I like the MIX images thing that looks really awesome.
                              I just tested this on my PC but I will have to trash all my images and gamelists on my 2 RPis and replace them with this stuff here.

                              Again thanks a lot for this.

                              1 Reply Last reply Reply Quote 0
                              • F
                                FlyingTomahawk
                                last edited by 19 Feb 2017, 14:46

                                After 6 hours and 54 minutes scrapping I have 820 Images and.... an empty gamelist.xml file. :-/ lol
                                I don't think it can handle more then a few roms at the time. I am trying now half of that amount to see if it'll work this time.
                                I'll know more in 3 hours and 3 minutes...

                                1 Reply Last reply Reply Quote 0
                                • D
                                  Dochartaigh
                                  last edited by Dochartaigh 19 Feb 2017, 15:56

                                  I could have totally missed this, but I'm coming from a Mac and installed Parallels so I can use PC programs. To get this scraper to work your Windows PC needs to be able to see the Pi as a network drive, correct? How are you guys doing this?

                                  On my Mac it's not setup as a network drive either - I either SSH in with the built-in Mac Terminal program, or use my FTP program (Cyberduck or FileZilla)...just seeing how you PC users would go about this the best way. All my searches are bringing up how to run ROMs from a Network drive - when I want to go the opposite way (view the Pi as a Network drive in Windows, not have the Pi see a network drive in PC/Windows land).

                                  P 1 Reply Last reply 19 Feb 2017, 17:03 Reply Quote 0
                                  • F
                                    FlyingTomahawk
                                    last edited by 19 Feb 2017, 16:05

                                    I have Emulationstation setup on Windows with the exact same system setup and roms as on my RPi. I then scrape the roms on PC (RetroPie roms MIX) by selecting the paths that are setup in Emulationstation PC.
                                    And once done I adjust the paths inside the gamelist.xml file to match the folder structure of my RPi and then transfer the images and gamelist.xml files via network access to the RPi.

                                    1 Reply Last reply Reply Quote 0
                                    • P
                                      paradadf @Dochartaigh
                                      last edited by 19 Feb 2017, 17:03

                                      @Dochartaigh sadly, UXS doesn't work on a virtual machine. Or at least, nobody has been able to make it work (yet).

                                      D 1 Reply Last reply 19 Feb 2017, 17:27 Reply Quote 0
                                      • D
                                        Dochartaigh @paradadf
                                        last edited by Dochartaigh 19 Feb 2017, 17:27

                                        @paradadf said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                                        @Dochartaigh sadly, UXS doesn't work on a virtual machine. Or at least, nobody has been able to make it work (yet).

                                        Parallels isn't like a traditional virtual machine per se, it's using the mac's Bootcamp Windows (10) partition so you can run ANY Windows program as if you were running Windows diretly (including Universal XML Scraper).

                                        ...I just need to know how you guys are using Universal XML Scraper. Ignore that I'm on a Mac. How do you setup your Pi as a network drive in Windows? -- that's what needs to be done correct to get it to work, correct? I'm watching YouTube videos now so all will become self evident I'm sure...(maybe ;)

                                        EDIT YouTube seems to say that RetroPie automatically shows up as a network drive in Windows if they're both connected to the same network? If so that would be the first time Windows makes something easier to use than my Mac ;) ...booting up now to see if I've missed that drive in Windows Explorer and will try to run the scraper (going to try the cool 3-image "MIX" option).

                                        T 1 Reply Last reply 19 Feb 2017, 19:17 Reply Quote 0
                                        • T
                                          Tasio @Dochartaigh
                                          last edited by 19 Feb 2017, 19:17

                                          @Dochartaigh not sure if this is answering your question but to access the retropie shared folder on windows, type this address on the file explorer: "\retropie" without the quotes, if is not working use the IP address instead of "retropie"

                                          D 1 Reply Last reply 19 Feb 2017, 20:20 Reply Quote 0
                                          279 out of 728
                                          • First post
                                            279/728
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received