RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 749.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • screechS
      screech
      last edited by

      Unfortunatly, you can only with MIX profil :s
      I need to check if I can put this in the "standard" profil...
      (So much work ^^ sorry, I'm very late on my todolist :S)

      mattrixkM 1 Reply Last reply Reply Quote 0
      • mattrixkM
        mattrixk @screech
        last edited by

        @screech I'm sorry I keep loading requests for other stuff onto you.

        My ES themes: MetaPixel | Spare | Io | Indent

        1 Reply Last reply Reply Quote 0
        • Danorak1981D
          Danorak1981
          last edited by

          This looks like such a good idea, unfortunately I'm an OSX user so will never be able to use it.

          What I've taken to doing is replacing the box art myself, but it doesn't affect me too much as I only have about 60 games loaded into Retropie-even then it's just the SNES and the (two!) N64 games I have that get the treatment. I prefer the PAL box art so hunt Google for reasonably decent quality scans, then either recreate the box myself (plenty of logo .png files to be found) or tidy up the ones that are more difficult or have complex back rounds all in Photoshop. I've only uploaded two to my Flickr but they're in the RPi album if it takes your fancy.

          I do find the current scraper is pretty good, but doesn't always pick up some games (FZero, SNES was one I had to enter manually as it would not scrape any info at all).

          I'd love the idea of being able to do it at my computer though, kudos to you @screech for the effort!

          Restored SNES UK Boxart
          RPi Modified Case to fit PowerBlock

          1 Reply Last reply Reply Quote 0
          • A
            Aksen
            last edited by

            I really love this tool and screenscraper seems to have a lot of stuff i need, so I signed up for the patreon, vive la france!

            Anyway, I've noticed that the scraping is noticeably slower than it was a while ago. My GBA folder has 900 roms in it, and UXS was reporting that it would take 2 days to scrape it. Could it be that screenscraper.fr is being overloaded...?

            columboscoatC 1 Reply Last reply Reply Quote 0
            • columboscoatC
              columboscoat Banned @Aksen
              last edited by

              @Aksen Yip. I would say it's getting a lot more hits since @screech started promoting his scraper here.

              A 1 Reply Last reply Reply Quote 0
              • A
                Aksen @columboscoat
                last edited by

                @columboscoat I paused my antivirus and it seems to be going faster. 1 hour for the GBA roms. Still waaaaaaaaaaaay slower than the sselph scraper.

                columboscoatC 2 Replies Last reply Reply Quote 0
                • columboscoatC
                  columboscoat Banned @Aksen
                  last edited by

                  @Danorak1981 The inbuilt scraper for ES that uses thegames.db is VERY fussy over special characters such as dashes and ampersands etc. It also has issues with names less than 3 characters...

                  1 Reply Last reply Reply Quote 0
                  • columboscoatC
                    columboscoat Banned @Aksen
                    last edited by

                    @Aksen Yeah, but 900 gba ROMs... really? Seems like a lot! Uxmls can be slow. It just depends on the time of day. I guess the screenscraper.fr servers are in France and it's evening time there. Just the time when things get busy on servers hosting stuff like this.

                    1 Reply Last reply Reply Quote 0
                    • FurlugeF
                      Furluge
                      last edited by Furluge

                      I have been having some issues getting the software to pull down marquees when using the Retropie(Video) profile when scraping for final burn alpha. Nothing I seem to set for default picture gets me the marquees. Edit: It does not seem to want to pull down a7800 boxes either even though I see them on the site. :/ Does not seem to be pulling down a lot of a2600 boxes either. Still getting all the video though.

                      1 Reply Last reply Reply Quote 0
                      • D
                        detron
                        last edited by

                        on the General Configuration page of UXS, what does the option
                        "Add missing roms in XML" actually mean?

                        I have used UXS without it checked, and games that it did not have any artwork found still showed up.

                        though it seems straight forward, I would like to know what it really means before I re-scan some folders.

                        thanks

                        P 1 Reply Last reply Reply Quote 0
                        • P
                          paradadf @detron
                          last edited by

                          @detron i believe that options just add an entry for the roms on the gamelist.xml, although without data, as no match was found.

                          RionR 1 Reply Last reply Reply Quote 1
                          • RionR
                            Rion @paradadf
                            last edited by

                            @paradadf Yes that's right. I use it for rom translations and hacks. Then i manually add the information to that rom.

                            FBNeo rom filtering
                            Mame2003 Arcade Bezels
                            Fba Arcade Bezels
                            Fba NeoGeo Bezels

                            1 Reply Last reply Reply Quote 0
                            • A
                              a7mag3ddon
                              last edited by

                              I would like to add a suggestion if it hasn't been suggested already.

                              Can an option be added to skip the image if it already exists in the images folder.

                              Thanks

                              1 Reply Last reply Reply Quote 0
                              • screechS
                                screech
                                last edited by

                                normally it's already the case...

                                A 1 Reply Last reply Reply Quote 0
                                • A
                                  Aksen @screech
                                  last edited by

                                  @screech Can there be an option to scrape metadata but skip the image? I'd like to re-scrape at some point, because some of my scraped metadata was in french.

                                  1 Reply Last reply Reply Quote 0
                                  • screechS
                                    screech
                                    last edited by

                                    @Aksen
                                    Normally the basic option do that :
                                    Recreate the XML, but if picture exist, don't touch it... Can you give it a try?

                                    @mattrixk
                                    Just release a new version : You can now put a size for every media you download (in the standard profil)
                                    (Need to see for sys info/media now...)

                                    Some new things added :
                                    You can now add Genre Picto in the Mix
                                    You can now put some text in Mix
                                    You can now rotate picture in Mix
                                    Lot's of correction on the fallback function (some pictures doesn't download exemple : 2DBox in standard profil now work nice ;) )
                                    Added a Mirror server to avoid main server instability. (automatique fallback)

                                    The Wiki is up to date with the new function for MIX : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/[TUTO]-Making-a-MIX-Template

                                    mattrixkM 2 Replies Last reply Reply Quote 2
                                    • mattrixkM
                                      mattrixk @screech
                                      last edited by

                                      @screech You're a legend. Hopefully I'll get the chance to try this out today or tomorrow.

                                      My ES themes: MetaPixel | Spare | Io | Indent

                                      1 Reply Last reply Reply Quote 1
                                      • mattrixkM
                                        mattrixk @screech
                                        last edited by mattrixk

                                        @screech I downloaded the latest version, but when I try to run it I get this error:

                                        Universal XML Scraper fatal error !
                                        (Time Out)
                                        

                                        Edit: I'm on a Windows 7 PC.

                                        Edit 2: I just realised it could be because screenscraper.fr is down. It would be nice if I could still play with the program, even if the website isn't working. I could keep working on Profiles without actually scraping, even if the website was down.

                                        I just tried the previous version (v2.1.0.3) that worked yesterday. It doesn't work at the moment either.

                                        My ES themes: MetaPixel | Spare | Io | Indent

                                        fergyzF 1 Reply Last reply Reply Quote 0
                                        • fergyzF
                                          fergyz @mattrixk
                                          last edited by

                                          @mattrixk at least you confirmed I'm not crazy... i get the same error.

                                          mattrixkM 1 Reply Last reply Reply Quote 0
                                          • mattrixkM
                                            mattrixk @fergyz
                                            last edited by

                                            @fergyz yeah, I'm pretty sure it's because the website is down.

                                            @screech, is it possible to open the program when the website isn't working? I had the idea of creating a MIX Profile to smush Local images into a single image.

                                            Eg: Say I have 5 games in a system, and for each game I've already used a Scrape Profile to download Wheel, 3D Box Art and Screenshot, and suffixed each image with "-wheel", "-boxart" and "-screenshot" respectively.

                                            Can I use UXS to format each of these images into a single image per game? Or maybe have a Scrape Profile that downloads the images separately, but also Mixes some of them together? That would be awesome.

                                            My ES themes: MetaPixel | Spare | Io | Indent

                                            E 1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.