RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 741.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SquilenatorS
      Squilenator @screech
      last edited by

      @screech I'm using the last release and got a problem, after the scrape process some roms were renamed wrongly, such as "Advanced Dungeons & Dragons - Pool of Radiance (USA)" which became just "Pool of Radiance". It was always like that?

      1 Reply Last reply Reply Quote 0
      • B
        BORIStheBLADE1
        last edited by

        I posted this in my thread and just realized this is probably a better place for it.

        Ran some N64 roms and have five that won't scrap. Ran it two different times with your new software.

        http://pastebin.com/QYYApU0f

        1 Reply Last reply Reply Quote 0
        • mattrixkM
          mattrixk @gameplaygoon
          last edited by

          @gameplaygoon If you update RetroPie from source you can get the ability to have Video Previews. This gives you 2 new tags for use in your gamelist.xml files: <video> and <marquee>. You can use the RetroPie (video) scrape profile to scrape videos and UXS will scrape the game videos that exist and put them in the <video> tag in the created gamelist.xml along with all the other metadata.

          Just be careful. The videos are all 640x480 (I think) and a couple of MB each. That can add up if you aren't careful, so maybe scrape them on your PC first and then only use certain videos.

          My ES themes: MetaPixel | Spare | Io | Indent

          G 1 Reply Last reply Reply Quote 0
          • G
            gameplaygoon @mattrixk
            last edited by

            @mattrixk Thanks but what do you mean update Retropie from source, I have the latest version installed?

            mattrixkM 1 Reply Last reply Reply Quote 0
            • mattrixkM
              mattrixk @gameplaygoon
              last edited by

              @gameplaygoon Sorry mate, someone else is going to have to answer that one for you. I've never done it. I have a my setup working and since it's more a media box than a game station, I don't really mess with it.

              This is where they talk about Video Preview, but beware as it's now over 400 comments long.

              My ES themes: MetaPixel | Spare | Io | Indent

              1 Reply Last reply Reply Quote 0
              • screechS
                screech
                last edited by

                @mattrixk and @gameplaygoon Warning : no more "RetroPie (video)" scrape profile.
                Now there is only Retropie (Standard, MIX, or Rom Folder) profiles. BUT, in "Option configuration" Menu, you can "activate" video" and choose what you want to download as Marquee (not only Marquees ;) )

                @Squilenator on wich plateform ?

                @BORIStheBLADE1 "Conker's Bad Fur Day (USA).z64 " haven't CRC... so i can't import it. . The other one are ok, it's done.

                @gameplaygoon What do you try to "update" ? On plateform like MAME, UXS try to found a match inside the ZIP if the ZIP isn't found. So it can be long. On CD plateform try this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/ISO-Scrape-Freeze-or-are-very-long

                @Tasio :

                • Freeze : Try this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Universal-XML-Scraper-fatal-error!-(err_SystemList)

                • Mix Profile : It look like a "write right" problem... Try launch in admin ?

                • Not found : Try this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper

                • Path to the scrape, and Info for SSH are dissociated... (sorry) So you need to configure it both if you aren't in a "standard" configuration

                • Creating file/folder : You are true... It's an old "security" function I need to take off...

                • Scraping FBA : I don't know why :S need to check...

                • Time may be du to Server response (some heavy load these last days...) But having multiple time the same info is weird :S

                • Parsing Error : It's maybe due to the same issue (write auth), it can parse the xml maybe because it can't write it....

                (Sorry for the delay to answer, I were sick.. And it's not finish >< )

                SquilenatorS 1 Reply Last reply Reply Quote 1
                • G
                  gameplaygoon
                  last edited by

                  How do you choose how the video will be layed out or does it simply just download it into a folder and you have to do the rest. Because when you choose the layout of the pictures how do you choose where the video is placed?

                  Thanks

                  1 Reply Last reply Reply Quote 0
                  • screechS
                    screech
                    last edited by

                    UXS only Scrape ;)

                    The Layout is in the theming (and need the right version of Retropie to work ;) )

                    1 Reply Last reply Reply Quote 0
                    • SquilenatorS
                      Squilenator @screech
                      last edited by

                      @screech Nintendo NES

                      1 Reply Last reply Reply Quote 0
                      • J
                        Jeck11
                        last edited by

                        I just downloaded from the github and my Windows Defender registered a couple hits from it: 0_1486475237403_2017-02-07 08_45_51-Windows Defender.png

                        Anyone else noticed anything weird?

                        1 Reply Last reply Reply Quote 0
                        • D
                          Dukafleed
                          last edited by

                          screech, i have been using your tool for sometime and i can say it is the best artwork provider (specially the 3 in 1 feature)

                          are you looking to expand itin include a rom metadata manager where you can fetch info and edit them accordingly by rom or roms ?

                          1 Reply Last reply Reply Quote 0
                          • B
                            BORIStheBLADE1
                            last edited by

                            OK so with version 2.1.0.5 I was able to scrap all my rom sets and every thing came back 100%. I updated to 2.1.0.6 and it wouldn't scrap the same rom sets 100%. Also every other time I'd try to use it, it would say something about losing connection. So I have reverted back to 2.1.0.5 and everything is working right again.

                            1 Reply Last reply Reply Quote 0
                            • hooperreH
                              hooperre @Tasio
                              last edited by

                              @Tasio

                              • I think creating files and folder when first lunch may not be a good idea unless you ask for confirmation, many pleople try to open open downloaded software from the browser.

                              If I may add something specific... I think overwriting the XML file without confirmation is quite detrimental and, if not backed up, can cause a major headache for anyone who has done video set ups and things of that nature.

                              4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                              1 Reply Last reply Reply Quote 0
                              • hooperreH
                                hooperre
                                last edited by hooperre

                                I'm wondering a way to get specific files that were missed. When I first downloaded roms (as a 10 year old 10 years ago) I renamed everything because I didn't understand why there were (rev a) or (USA) or (U)'s attached in the romsets. I just wanted 1 game with an easy title. So a few (overall it did a great job identifying my games) games were not picked up. One that doesn't make much sense to me is Donkey Kong Country 2 and 3. I'll use DKC3 as my example.

                                My file name is simply: "Donkey Kong Country 3 - Dixie Kong's Double Trouble.zip"

                                So I went to the game page on screenscraper.fr and created a fake new (text) file and renamed it one of the 'Associated File Names' directly from the file name section: "Donkey Kong Country 3 - Dixie Kong's Double Trouble! (USA) (En, Fr) .zip" and "Donkey Kong Country 3 - Dixie Kong's Double Trouble! (USA) (En, Fr) .sfc". (File extension was correct, not just renamed with a .txt extension.)

                                Re-ran the scraper and no luck. This method did work for Mega Man 8 and Dragon Ball Z - Hyper Dimension, however. Is there some trick to this that I'm missing?

                                4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                T 1 Reply Last reply Reply Quote 0
                                • hansolo77H
                                  hansolo77
                                  last edited by

                                  I think the scraper will use rom name only as a last resort, and will use a hash check first. The hash shouldn't have changed if the name is all that has.

                                  Who's Scruffy Looking?

                                  1 Reply Last reply Reply Quote 0
                                  • D
                                    davidgrohl Banned
                                    last edited by

                                    Hi,
                                    I would to try this program with retro pie running on raspberry pi 3.
                                    Is it possibile to scrap my roms and transfer result on retropie?

                                    Thanks

                                    1 Reply Last reply Reply Quote 0
                                    • T
                                      Tasio @hooperre
                                      last edited by

                                      @hooperre what worked best for me was getting the missing roms from a good source.

                                      1 Reply Last reply Reply Quote 0
                                      • FlyingTomahawkF
                                        FlyingTomahawk
                                        last edited by FlyingTomahawk

                                        Notebook: Acer, i5, 4GB RAM etc...
                                        OS: Windows 7 64-bit

                                        Downloaded this form github into my downloads folder.
                                        Extracted there and tried to run the program with either Scraper64.exe or Scraper.exe but nothing happens, nothing loads, no process is started.
                                        Looking at the task manager there is no indication that this program was started.
                                        Deactivated firewall and anti-virus software, still no luck.
                                        Did I miss a step?

                                        P 1 Reply Last reply Reply Quote 0
                                        • P
                                          paradadf @FlyingTomahawk
                                          last edited by

                                          @FlyingTomahawk why do some people doesn't look into the releases page like in almost any other project?
                                          https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

                                          FlyingTomahawkF 1 Reply Last reply Reply Quote 0
                                          • FlyingTomahawkF
                                            FlyingTomahawk @paradadf
                                            last edited by FlyingTomahawk

                                            @paradadf

                                            Lesson learned, thank you.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.