RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 747.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • T
      tien_huu_1408
      last edited by tien_huu_1408

      Dear all,
      I tried Universal XML Scraper to scrap Neogeo Samurai Shodown series (fba folder) for Mix3 (mixed 3 images) on Retropie. I found media in screenscraper.fr. However, when finish scraping, just Samurai Shodown V and Samurai Shodown V special zero have full scrap (all information and mix 3D boxed art with screenshot and wheel). Could you help me scrap the others? Even I tried sselph scraper on command line with mix3 option did not work, it just come up with simple 2D box art. That's strange. Thanks for your help!
      For example, Samurai Shodown 2 neogeo on the screenscraper.fr link
      https://www.screenscraper.fr/gameinfos.php?plateforme=142&gameid=37630

      1 Reply Last reply Reply Quote 0
      • hansolo77H
        hansolo77
        last edited by

        The scraper works (by default) by checking the CRC and then the filename. If your ROM doesn't match the information in their databases, that's why it doesn't pull it even if it exists. Double-check the name. I managed to force a match by renaming several of my ROMs to match what the database had for it's name. A few of my games were listed multiple times in their database although with many different CRC results but none that matched what I had. So I ended up renaming it and then it worked. If doing that doesn't work either, you can always ask @screech to add your CRC to their list. I've not done that, but he's said in the past it's no problem.

        Who's Scruffy Looking?

        mattrixkM 1 Reply Last reply Reply Quote 0
        • T
          tien_huu_1408
          last edited by tien_huu_1408

          Thanks for your quick reply. I just used another romset and bumped it worked with full scrap. Viola!

          1 Reply Last reply Reply Quote 0
          • mattrixkM
            mattrixk @hansolo77
            last edited by

            @hansolo77 said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

            I managed to force a match by renaming several of my ROMs to match what the database had for it's name

            I need to do that for a bunch of my PSX and PSP games, but they all have the ":" character, which Windows won't let me put in the filename, so they will never scrape.

            My ES themes: MetaPixel | Spare | Io | Indent

            1 Reply Last reply Reply Quote 0
            • B
              BORIStheBLADE1
              last edited by BORIStheBLADE1

              I'm noticing it's not actually shutting down emulation station to scrap like it used to or letting me and none of the SSH commands are working . Anyone having the same issues?

              Mike

              1 Reply Last reply Reply Quote 0
              • hansolo77H
                hansolo77
                last edited by

                I have an issue I'd like to recommend getting resolved...

                Multi-Disk games don't include their (disc #) in the created gamelist.xml files. This is EXTREMELY annoying. For instance..

                /home/pi/RetroPie/roms/America/Fear Effect (USA) (Disc 1).cue
                /home/pi/RetroPie/roms/America/Fear Effect (USA) (Disc 2).cue
                /home/pi/RetroPie/roms/America/Fear Effect (USA) (Disc 3).cue
                /home/pi/RetroPie/roms/America/Fear Effect (USA) (Disc 4).cue
                

                Generates a gamelist.xml file, and inside EmulationStation, the results look like this:

                Fear Effect [USA]
                Fear Effect [USA]
                Fear Effect [USA]
                Fear Effect [USA]
                

                Is there a different setting I should be using under the Options->Name->Name Format area of the program? Right now, I'm using "Game name + Options". Should I be using one of the others, like perhaps "Game name + filename tag"? To me, that sounds like I'd generate a list with files called Fear Effect [USA].cue multiple times. Then there is the "Filename (without ext)" which sounds like it would create exactly what the file name is WITHOUT the .cue parts.. and that can get pointless too when you have excessively large file names.

                So what's the best way to do this to just get a clean list like (even better without the [USA] bit:

                Fear Effect (disc 1)
                Fear Effect (disc 2)
                Fear Effect (disc 3)
                Fear Effect (disc 4)
                

                Who's Scruffy Looking?

                1 Reply Last reply Reply Quote 0
                • screechS
                  screech
                  last edited by

                  You can do it in 2 pass :

                  Move your multiDisk in an other folder, Scrape your Solo Disc like you want, Then readd your MultiDisk Game and Update the gamelist.xml.

                  Inbetween, you change the Name Format.
                  Game name + Options : is the Std one (you can choose option)
                  Game name + filename tag : Take the scraped Name and add the "tag" between () or [] from the filename at the end. (without extension)
                  Filename (without ext) : Obviously Filename without extension ;)

                  1 Reply Last reply Reply Quote 0
                  • hansolo77H
                    hansolo77
                    last edited by

                    So what your saying is, if I pick the Game name + filename tag, it will take

                    /home/pi/RetroPie/roms/America/Fear Effect (USA) (Disc 2).cue
                    

                    and create a

                    Fear Effect (USA) (Disc 2)
                    

                    Or just up to the Disk 2 part, using only the first set of ()?

                    Who's Scruffy Looking?

                    1 Reply Last reply Reply Quote 0
                    • P
                      Panther7
                      last edited by

                      This crashes no matter what I do, immediately after starting a scrape.

                      It says "hashing" on the bottom line, then stops responding until I kill the process. The log reads as such:

                      [03:18:32] - C:\Users\Redacted\Desktop\UXS\Scraper64.exe (1.2.0.10)
                      [03:18:32] - WIN_7(X64) - 0409
                      [03:18:32] - > systemlist.xml Opened
                      [03:18:32] - > Genrelist.xml Opened

                      screechS 1 Reply Last reply Reply Quote 0
                      • screechS
                        screech @Panther7
                        last edited by

                        @Panther7 are you scraping iso ?
                        Big file May Take long time to hash. ...
                        Look at the uxs wiki There is several solutions.

                        P 1 Reply Last reply Reply Quote 0
                        • P
                          Panther7 @screech
                          last edited by

                          @screech I actually think I figured that one out. I was using the wrong password for my SSH. I didn't realize I had to independently sign in on that application. I still can't get the correct marquee download though. Didn't mess with it much more. I was only looking at it because the actual built-in scraper wasn't working.

                          I've spent all night trying to get the actual built in scraper to work. That thing is all over the place for me. It usually finishes without even scanning the roms (Dreamcast/Playstation). I'm at a loss, as I had it working fine just a few days ago.

                          1 Reply Last reply Reply Quote 0
                          • J
                            Jste84
                            last edited by

                            possibly a silly question here @screech and I've tried to find this myself, but is there a way to scrape missing images only?

                            1 Reply Last reply Reply Quote 0
                            • UDb23U
                              UDb23 @hansolo77
                              last edited by

                              @hansolo77 said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                              How do I manually download the images hosted at screenscraper.fr?

                              It's a little bit tricky but can be done.
                              take this page as an example. Take note of the horizontal size of the fan art (1920) and then right click on the Fan Art image and select "open image in another tab". You will get here..
                              Now edit the URL by replacing the "maxwidth=" in the URL with the actual width you noted (and delete trailing"'&maxheight=190" as not needed).
                              Press enter and you get the full res image.

                              1 Reply Last reply Reply Quote 1
                              • FlyingTomahawkF
                                FlyingTomahawk
                                last edited by FlyingTomahawk

                                @screech

                                Also getting some error with the latest version.

                                AutoIt Error
                                Line 26288 (File "C:\Users\XXXXX\Desktop\Raspberry\Universal XML Scraper\Universal_XML_Scraper64.exe"):
                                Error: Subscript used on non-accessible variable.

                                Also when I set the image size to 960x540 it gets completely ignored and it gives me something like 384x224 size images.

                                The previous version of UXMLS worked just fine though.

                                mattrixkM 1 Reply Last reply Reply Quote 0
                                • mattrixkM
                                  mattrixk @FlyingTomahawk
                                  last edited by

                                  @flyingtomahawk said:

                                  when I set the image size to 960x540 it gets completely ignored and it gives me something like 384x224 size images

                                  I might be wrong about this, but I thought it wouldn't make the images any larger than their default size. Eg: If you set the size to 1920x1080, a 640x480 image won't download any larger than 640x480.

                                  So maybe the images you are trying to download are just 384x224 and won't grow any bigger? Just a thought.

                                  My ES themes: MetaPixel | Spare | Io | Indent

                                  FlyingTomahawkF 1 Reply Last reply Reply Quote 0
                                  • FlyingTomahawkF
                                    FlyingTomahawk @mattrixk
                                    last edited by FlyingTomahawk

                                    @mattrixk

                                    That could be but then this must be a new feature.
                                    Before I could scrape the exact same images in larger size. And on their website the images are available in larger size. It would be a big pain to go and download each image manually.

                                    CORRECTION:

                                    You are right the screenshot images are mostly small at 320x224 resolution.
                                    So if I create mix images like screenshot+marquee the screenshot gets blown up to match but when scrapping for screenshots only the images are small.

                                    Strange, no error message today...

                                    mattrixkM 1 Reply Last reply Reply Quote 0
                                    • mattrixkM
                                      mattrixk @FlyingTomahawk
                                      last edited by mattrixk

                                      @flyingtomahawk said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                                      It would be a big pain to go and download each image manually

                                      You have no idea. I'm currently manually creating MIX images and a gamelist for PSP because nothing scrapes it correctly. I have to get all the different images (and data) from numerous sources. It's painstaking.

                                      Edit: or you might have some idea. You may have gone through this before, I have no way of knowing.

                                      My ES themes: MetaPixel | Spare | Io | Indent

                                      1 Reply Last reply Reply Quote 1
                                      • R
                                        red2blue
                                        last edited by

                                        @screech hey man i submitted about 10 things on screenscraper and they've all been accepted yet i did not receive any new threads ???? I only received 2 from 2 days ago when i submitted one box art photo, but i didnt receive anything from the 10 things i submitted last night... but like i said they are all accepted and i got nothing in return. just that puzzle japan thing pieces

                                        FlyingTomahawkF 1 Reply Last reply Reply Quote 0
                                        • FlyingTomahawkF
                                          FlyingTomahawk @red2blue
                                          last edited by

                                          @red2blue

                                          Join their chat and tell them that you submited some stuff and haven't received any threads.

                                          R 1 Reply Last reply Reply Quote 0
                                          • R
                                            red2blue @FlyingTomahawk
                                            last edited by

                                            @flyingtomahawk said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                                            Join their chat and tell them that you submited some stuff and haven't received any threads.

                                            can you give me link for chat?

                                            FlyingTomahawkF 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.