RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 749.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • daeksD
      daeks
      last edited by daeks

      Nice tool, tried it on my machine and found couple of roms not associated. How can I upload these missing rom hashs to the website?

      Improvement suggestion: If you query the database for a rom and it can not be found, why not adding the hash and filename automatically to the db?

      1 Reply Last reply Reply Quote 0
      • screechS
        screech
        last edited by

        Hi @daeks , Sorry, you can't directly add roms hash to the DB, but you can send me your missing.txt file, and I'll check what I can do.

        For the auto add to database, it's already existe ;) but with limitation : the missing rom must be scraped from 5 differents user to be send to moderation, then modo can associate it to the good game.

        The aim is to avoid lot's of bad file (if you scrape your familly photo folder by mistake, we don't want to add them to the DB ;) )

        RionR 1 Reply Last reply Reply Quote 0
        • RionR
          Rion @screech
          last edited by

          @screech LoL

          FBNeo rom filtering
          Mame2003 Arcade Bezels
          Fba Arcade Bezels
          Fba NeoGeo Bezels

          1 Reply Last reply Reply Quote 0
          • L
            Lok
            last edited by Lok

            Hello and many thanks for this scrapper who look very usefull.

            At first, excuse my english.

            I'm using Retropie within kodi on a OSMC configuration with that https://discourse.osmc.tv/t/howto-retrosmc-retrogaming-on-osmc/6671 and everthing works fine. Except when I try Universal XLM scrapper.

            I think that the problem come from bad path because my Pi is not "/home/pi/RetroPie..." but / OSMC/osmc/RetroPie..." so I have changed the autoconfiguration path with something like :

            alt text

            I kill the emulstation process (after changing the SSH parameters), the scrapping launch and finish well but when I came back to RetroPie no information on my roms.

            A folder named "configs" is created on my Pi (\OSMC\osmc\configs) with lots of info in it but RetroPie won't get theses informations from there.

            I must have done womething wrong with the paths I guess but what ?

            Thanks for your help.

            1 Reply Last reply Reply Quote 0
            • screechS
              screech
              last edited by screech

              delete your UXS-config.ini file (when you relaunch UXS it will recreate it for you)

              To change the autoconfig path, only change the "Root System directory" with your "reel" root directory
              (I think it's //OSMC/osmc/RetroPie/roms )

              The other path will adapt themself to match the "corresponding Retropie Path"

              An other solution, is to use The Retropie Profil with [Sselph path]
              just change the "Root System directory" as well and try to scrape ;)

              The main difference is :

              • In the retropie profil, path match the retropie "standard" path.

              • In the retropie [Sselph's path] profil, downloaded-image and gamelist.xml are put in the rom system folder directly (it works well, and it's pretty easier to handle ;) )

              For the "Kill emulationstation" function, be sure it is well killed (you can do it manually directly on SSH or on a terminal)... If not, the new scraped gamelist.xml isn't used... and Emulationstation will overwrite it with the old one...

              1 Reply Last reply Reply Quote 0
              • L
                Lok
                last edited by

                Thanks for your answer.

                When I only change the "root systeme directory" in the autoconfig path. At the end of the scrap I have the error inLine 21922 " Error: subscript used on non accessible variable" .

                Maybe it's because my repertory ".emulationstation" on my Pi is not accessible (it says I haven't the rights to manage it when I clic on it in the windows explorer"

                Well, I'll examine the problem this evening.

                1 Reply Last reply Reply Quote 0
                • screechS
                  screech
                  last edited by

                  If you don't have access, it's certainly the problem...

                  Try with the Sselph's path profil ;)

                  1 Reply Last reply Reply Quote 0
                  • C
                    captainvelvet
                    last edited by

                    Hi guys, I've been scrapping a few of my systems and it worked superb. Problem is I've tried to add MIX scrapping on an already scrapped system but after completing scrapping and rebooting I still had the old scrapped pictures. So I deleted the info files from raspbian, rescrapped but now I've no scrapped images left. What files should I delete for a fresh rescrapping? Thanks for your help.

                    RionR 1 Reply Last reply Reply Quote 0
                    • RionR
                      Rion @captainvelvet
                      last edited by

                      @captainvelvet gamelist.xml and the images

                      FBNeo rom filtering
                      Mame2003 Arcade Bezels
                      Fba Arcade Bezels
                      Fba NeoGeo Bezels

                      1 Reply Last reply Reply Quote 0
                      • C
                        captainvelvet
                        last edited by

                        from putty? Or from raspbian?

                        1 Reply Last reply Reply Quote 0
                        • C
                          captainvelvet
                          last edited by

                          Well that's weird. I've scrapped my PCE romset, a romset I'd never scrapped and the art doesn't shows up after rebooting. I've checked in the downloaded images file. I can see all the scrapped art. Deleted the gamelist.xml, didn't help either. Any idea?

                          1 Reply Last reply Reply Quote 0
                          • P
                            paradadf
                            last edited by

                            Did you stop ES before scraping? That is a must!

                            1 Reply Last reply Reply Quote 0
                            • S
                              ShawnS
                              last edited by

                              This looks great and I've heard good reports from people using it but on my PC, Windows 10, neither Scraper.exe or Scraper64.exe will run. They ask for permission but nothing comes up. I didn't see anyone else here or on the reddit group with the same problem. Hopefully I'm just missing something?

                              Thanks for the help!

                              P 1 Reply Last reply Reply Quote 0
                              • C
                                chuzzwuzzer
                                last edited by

                                New to this and have just tried scraping my atari 2600 collection. I can see them on my network by going to configs>all>emulationstation>downloaded images but for some reason they are still not showing when I run emulationstation. I have my roms running from a 64gb usb stick. Which path do I need to change to see them.

                                1 Reply Last reply Reply Quote 0
                                • P
                                  paradadf @ShawnS
                                  last edited by

                                  @ShawnS scraper.exe or scraper64.exe aren't the files to use, but the Universal_XML_Scraper.exe file (out of memory).

                                  S 1 Reply Last reply Reply Quote 1
                                  • S
                                    ShawnS @paradadf
                                    last edited by

                                    @paradadf I don't have Universal_XML_Scraper.exe it has the .au3 extension. I'm not sure how to run that "out of memory".

                                    P 1 Reply Last reply Reply Quote 0
                                    • P
                                      paradadf @ShawnS
                                      last edited by

                                      @ShawnS I don't know what you've downloaded, but the files are here:
                                      https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

                                      That is also the only launcher.

                                      S 1 Reply Last reply Reply Quote 0
                                      • S
                                        ShawnS @paradadf
                                        last edited by

                                        @paradadf doh! The only link I saw in the original post was to the GitHub repository for the code. I totally missed the launcher in there. Thank you!!

                                        1 Reply Last reply Reply Quote 0
                                        • screechS
                                          screech
                                          last edited by

                                          Sorry to be late ;)

                                          Thank you @paradadf to answer ;)

                                          yep, just launch "Universal_XML_Scraper.exe" or "Universal_XML_Scraper64.exe"
                                          "Scraper.exe" and "scraper64.exe" are just the "Scrape Engine" not the main core software... So they do nothing if you launch them directly (that's why they normally be hiden by the soft ;) )

                                          1 Reply Last reply Reply Quote 0
                                          • C
                                            captainvelvet
                                            last edited by

                                            Ok guys, I've fixed it. I deleted the xml file and images, then pressed F4 in emuletionstation and ran the scraper. Everything ran ok. Beautiful PI that I have now!

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.