RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 750.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ExarKunIvE
      ExarKunIv
      last edited by

      Having a problem getting this to launch

      i got the latest version from Github v 2.2.0.0
      I run Universal_XML_Scraper64.exe. i get the splash screen and then a error pops up

      Line 38253 (file "c:\my stuff/ Universal-XML-Scraper-master\Universal_XML_Scraper64.exe"):

      error subscript used on non-accessible variable

      i looked in the logs folder and here is what i got

      [11:03:09] - C:\My stuff\Universal-XML-Scraper-master\Universal_XML_Scraper64.exe (2.2.0.0)
      [11:03:09] - WIN_8(X64) - 0409
      [11:03:09] - Scrape in x64
      [11:03:09] - > No updated files needed (Version : 2.2.0.0)
      [11:03:09] - Starting files installation
      [11:03:09] - > Ending files installation
      [11:03:09] - /!\ Error Downloading File : C:\My stuff\Universal-XML-Scraper-master\Ressources\ServerList.txt
      [11:03:09] - /!\ Bytes read: 0
      [11:03:09] - /!\ Size: 0
      [11:03:09] - /!\ Complete: True
      [11:03:09] - /!\ successful: False
      [11:03:09] - /!\ @error: 13
      [11:03:09] - /!\ @extended: 12029
      [11:03:10] - /!\ Error Downloading File : C:\My stuff\Universal-XML-Scraper-master\Ressources\ServerList.txt
      [11:03:10] - /!\ Bytes read: 0
      [11:03:10] - /!\ Size: 0
      [11:03:10] - /!\ Complete: True
      [11:03:10] - /!\ successful: False
      [11:03:10] - /!\ @error: 13
      [11:03:10] - /!\ @extended: 12029
      [11:03:10] - /!\ Error Downloading File : C:\My stuff\Universal-XML-Scraper-master\Ressources\ServerList.txt
      [11:03:10] - /!\ Bytes read: 0
      [11:03:10] - /!\ Size: 0
      [11:03:10] - /!\ Complete: True
      [11:03:10] - /!\ successful: False
      [11:03:10] - /!\ @error: 13
      [11:03:10] - /!\ @extended: 12029
      [11:03:10] - > -In 3 try and 0.86s
      

      so i look in the Ressources folder for the ServerList.txt and i saw it was missing so i unziped Ressources zip and placed it in there. i saw that once i ran the exe it disappeared. and yes i did try in admin mode.

      any ideas what im doing wrong here

      RPi3B+ / 200GB/ RetroPie v4.5.14, RPi4 Model B 4gb / 256gb / RetroPie 4.8.2
      RPi5 4gb / 512gb / RetroPie 4.8.9 -Basic
      Maintainer of RetroPie-Extra .

      1 Reply Last reply Reply Quote 0
      • screechS
        screech
        last edited by

        strange, serverList is here : https://raw.githubusercontent.com/Universal-Rom-Tools/Universal-XML-Scraper/master/Ressources/ServerList.txt

        It's not a DB issue, it's like UXS can't download it... Have you open your firewall ?
        (FYI it's the first file it try to download... So...)

        1 Reply Last reply Reply Quote 0
        • ExarKunIvE
          ExarKunIv
          last edited by

          yes i have the firewall turned off. still same thing.
          Im currently at work. so i think it is something they have set for the firewall here. :(

          ill give it a shot when i get home.
          thx for the help

          RPi3B+ / 200GB/ RetroPie v4.5.14, RPi4 Model B 4gb / 256gb / RetroPie 4.8.2
          RPi5 4gb / 512gb / RetroPie 4.8.9 -Basic
          Maintainer of RetroPie-Extra .

          1 Reply Last reply Reply Quote 0
          • ExarKunIvE
            ExarKunIv
            last edited by

            my work around is i just install my VPN here, and im useing that. lol

            RPi3B+ / 200GB/ RetroPie v4.5.14, RPi4 Model B 4gb / 256gb / RetroPie 4.8.2
            RPi5 4gb / 512gb / RetroPie 4.8.9 -Basic
            Maintainer of RetroPie-Extra .

            1 Reply Last reply Reply Quote 0
            • D
              DynaMight
              last edited by

              The update looks good but it isnt scraping anywhere near as many games? The previous update scraped 896 out of 900 roms (Megadrive) however the latest update only managed to scrape 565? Exactly the same roms. I re-ran it and it did exactly the same amount.

              Any ideas?

              1 Reply Last reply Reply Quote 0
              • screechS
                screech
                last edited by

                @ExarKunIv So it's ok ?
                @DynaMight try to check the "Unzip zip" checkbox in the general config ;)

                D 1 Reply Last reply Reply Quote 0
                • D
                  DynaMight @screech
                  last edited by

                  @screech No I didnt, I did see the option but didnt understand what it actually meant. All the roms are zipped. I'll try it tomorrow, but what does the option do/mean?

                  Thanks

                  1 Reply Last reply Reply Quote 0
                  • screechS
                    screech
                    last edited by

                    Before the 2.2 UXS do this :

                    look for the file hash in the DB
                    if not found, look for the rom file name in the DB
                    if not found, unzip the zip file (if zip) and look for the first file hash in the DB
                    if not found, look for the first file name in the DB
                    if not found, look for the second file hash in the DB
                    if not found, look for the second file name in the DB
                    And so on till it found a match or do all the file in the zip...
                    It work nice on some case (specialy console)

                    But it's horrible on other system (like Mame :S)

                    the unzip part is now an option you can activate or deactivate...
                    By default it's not activated because of that and to make a quick scrape..
                    it's faster but less precise because if not found in the 2 first case (Hash and filename of the zip)... it don't look further...

                    mattrixkM 1 Reply Last reply Reply Quote 1
                    • mattrixkM
                      mattrixk @screech
                      last edited by

                      Looking good @screech. I'll hopefully have a chance to check it out in a few hours. (and you release this just after I completed my custom Scrape and MIX Profiles too :D)

                      My ES themes: MetaPixel | Spare | Io | Indent

                      1 Reply Last reply Reply Quote 0
                      • screechS
                        screech
                        last edited by

                        really sorry @mattrixk ^^
                        MIX profiles haven't change so normally it's ok ;)
                        For your Scrape profiles, send me the "old one" I'll adapt them to the "new" format if you want ;)

                        mattrixkM 1 Reply Last reply Reply Quote 0
                        • mattrixkM
                          mattrixk @screech
                          last edited by

                          @screech No worries mate. I'll didn't get the chance to play with it today, but I'll have a look soon. I only have about 30-40 minutes of free time a day (during lunch at work), so I have lots of stuff to fit in there, and some times l like to chill and watch YouTube or something.

                          My ES themes: MetaPixel | Spare | Io | Indent

                          1 Reply Last reply Reply Quote 0
                          • screechS
                            screech
                            last edited by

                            WARNING : I confirm that the Kill emulationstation don't work :(

                            So you need to stop it manually till I correct that tonight...

                            SuperMagicomS 1 Reply Last reply Reply Quote 0
                            • SquilenatorS
                              Squilenator
                              last edited by Squilenator

                              @screech for some reason the new version is not scraping Wheel Art into the mix profiles for Arcade Zoom, and the Standard 2img sometimes scraps the wheel and sometimes not, it happens a lot now.

                              SuperMagicomS 1 Reply Last reply Reply Quote 0
                              • SuperMagicomS
                                SuperMagicom @Squilenator
                                last edited by

                                @Squilenator It's not just that mix profile either. The mix scraping is totally fubar in the latest version. I opened an issue ticket on github the other day so hopefully he fixes it soon. Until then I've gone back to the previous version and everything scrapes normally.

                                1 Reply Last reply Reply Quote 0
                                • SuperMagicomS
                                  SuperMagicom @screech
                                  last edited by

                                  @screech Latest versions, including today's update, throwing "AutoIt error: Subscript used on non-accessible variable" and crashing after boot screen. 2.1.0.4 is the newest version that will run normally. :(

                                  D 1 Reply Last reply Reply Quote 0
                                  • Y
                                    yortdog
                                    last edited by

                                    Loved using this tool !!!
                                    For what it's worth, I've been using 2.1.0.6 perfectly for the last 2 weeks, and today is giving me the "Error: Subscript used on non-accessible variable" message, too. There have been no changes to my firewall settings.

                                    Also, when I click on the link above (https://raw.githubusercontent.com/Universal-Rom-Tools/Universal-XML-Scraper/master/Ressources/ServerList.txt) it opens the browser with the text: "404: Not Found." Is that expected?

                                    Thanks again for all your hard work. Amazing tool.

                                    P 1 Reply Last reply Reply Quote 0
                                    • P
                                      paradadf @yortdog
                                      last edited by

                                      @yortdog I can see that file wirhout any problems. Maybe a proxy issue?

                                      SuperMagicomS 1 Reply Last reply Reply Quote 0
                                      • Y
                                        yortdog
                                        last edited by

                                        @paradadf : Not sure, but logged in this morning & it's working fine. Perhaps a localized network connection problem. I can see the text file now.

                                        Sorry for the false alarm. The Universal_XML_Scraper64.exe program loads fine for me today.

                                        1 Reply Last reply Reply Quote 0
                                        • SuperMagicomS
                                          SuperMagicom @paradadf
                                          last edited by

                                          @paradadf The file was not there when he posted it. I checked it myself.

                                          1 Reply Last reply Reply Quote 0
                                          • SuperMagicomS
                                            SuperMagicom
                                            last edited by

                                            Latest version still is not creating mix profiles properly. The 2.2 versions have been major downgrades both in GUI usability and stability.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.