RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 737.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RionR
      Rion @screech
      last edited by

      @screech LoL

      FBNeo rom filtering
      Mame2003 Arcade Bezels
      Fba Arcade Bezels
      Fba NeoGeo Bezels

      1 Reply Last reply Reply Quote 0
      • L
        Lok
        last edited by Lok

        Hello and many thanks for this scrapper who look very usefull.

        At first, excuse my english.

        I'm using Retropie within kodi on a OSMC configuration with that https://discourse.osmc.tv/t/howto-retrosmc-retrogaming-on-osmc/6671 and everthing works fine. Except when I try Universal XLM scrapper.

        I think that the problem come from bad path because my Pi is not "/home/pi/RetroPie..." but / OSMC/osmc/RetroPie..." so I have changed the autoconfiguration path with something like :

        alt text

        I kill the emulstation process (after changing the SSH parameters), the scrapping launch and finish well but when I came back to RetroPie no information on my roms.

        A folder named "configs" is created on my Pi (\OSMC\osmc\configs) with lots of info in it but RetroPie won't get theses informations from there.

        I must have done womething wrong with the paths I guess but what ?

        Thanks for your help.

        1 Reply Last reply Reply Quote 0
        • screechS
          screech
          last edited by screech

          delete your UXS-config.ini file (when you relaunch UXS it will recreate it for you)

          To change the autoconfig path, only change the "Root System directory" with your "reel" root directory
          (I think it's //OSMC/osmc/RetroPie/roms )

          The other path will adapt themself to match the "corresponding Retropie Path"

          An other solution, is to use The Retropie Profil with [Sselph path]
          just change the "Root System directory" as well and try to scrape ;)

          The main difference is :

          • In the retropie profil, path match the retropie "standard" path.

          • In the retropie [Sselph's path] profil, downloaded-image and gamelist.xml are put in the rom system folder directly (it works well, and it's pretty easier to handle ;) )

          For the "Kill emulationstation" function, be sure it is well killed (you can do it manually directly on SSH or on a terminal)... If not, the new scraped gamelist.xml isn't used... and Emulationstation will overwrite it with the old one...

          1 Reply Last reply Reply Quote 0
          • L
            Lok
            last edited by

            Thanks for your answer.

            When I only change the "root systeme directory" in the autoconfig path. At the end of the scrap I have the error inLine 21922 " Error: subscript used on non accessible variable" .

            Maybe it's because my repertory ".emulationstation" on my Pi is not accessible (it says I haven't the rights to manage it when I clic on it in the windows explorer"

            Well, I'll examine the problem this evening.

            1 Reply Last reply Reply Quote 0
            • screechS
              screech
              last edited by

              If you don't have access, it's certainly the problem...

              Try with the Sselph's path profil ;)

              1 Reply Last reply Reply Quote 0
              • C
                captainvelvet
                last edited by

                Hi guys, I've been scrapping a few of my systems and it worked superb. Problem is I've tried to add MIX scrapping on an already scrapped system but after completing scrapping and rebooting I still had the old scrapped pictures. So I deleted the info files from raspbian, rescrapped but now I've no scrapped images left. What files should I delete for a fresh rescrapping? Thanks for your help.

                RionR 1 Reply Last reply Reply Quote 0
                • RionR
                  Rion @captainvelvet
                  last edited by

                  @captainvelvet gamelist.xml and the images

                  FBNeo rom filtering
                  Mame2003 Arcade Bezels
                  Fba Arcade Bezels
                  Fba NeoGeo Bezels

                  1 Reply Last reply Reply Quote 0
                  • C
                    captainvelvet
                    last edited by

                    from putty? Or from raspbian?

                    1 Reply Last reply Reply Quote 0
                    • C
                      captainvelvet
                      last edited by

                      Well that's weird. I've scrapped my PCE romset, a romset I'd never scrapped and the art doesn't shows up after rebooting. I've checked in the downloaded images file. I can see all the scrapped art. Deleted the gamelist.xml, didn't help either. Any idea?

                      1 Reply Last reply Reply Quote 0
                      • P
                        paradadf
                        last edited by

                        Did you stop ES before scraping? That is a must!

                        1 Reply Last reply Reply Quote 0
                        • S
                          ShawnS
                          last edited by

                          This looks great and I've heard good reports from people using it but on my PC, Windows 10, neither Scraper.exe or Scraper64.exe will run. They ask for permission but nothing comes up. I didn't see anyone else here or on the reddit group with the same problem. Hopefully I'm just missing something?

                          Thanks for the help!

                          P 1 Reply Last reply Reply Quote 0
                          • C
                            chuzzwuzzer
                            last edited by

                            New to this and have just tried scraping my atari 2600 collection. I can see them on my network by going to configs>all>emulationstation>downloaded images but for some reason they are still not showing when I run emulationstation. I have my roms running from a 64gb usb stick. Which path do I need to change to see them.

                            1 Reply Last reply Reply Quote 0
                            • P
                              paradadf @ShawnS
                              last edited by

                              @ShawnS scraper.exe or scraper64.exe aren't the files to use, but the Universal_XML_Scraper.exe file (out of memory).

                              S 1 Reply Last reply Reply Quote 1
                              • S
                                ShawnS @paradadf
                                last edited by

                                @paradadf I don't have Universal_XML_Scraper.exe it has the .au3 extension. I'm not sure how to run that "out of memory".

                                P 1 Reply Last reply Reply Quote 0
                                • P
                                  paradadf @ShawnS
                                  last edited by

                                  @ShawnS I don't know what you've downloaded, but the files are here:
                                  https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

                                  That is also the only launcher.

                                  S 1 Reply Last reply Reply Quote 0
                                  • S
                                    ShawnS @paradadf
                                    last edited by

                                    @paradadf doh! The only link I saw in the original post was to the GitHub repository for the code. I totally missed the launcher in there. Thank you!!

                                    1 Reply Last reply Reply Quote 0
                                    • screechS
                                      screech
                                      last edited by

                                      Sorry to be late ;)

                                      Thank you @paradadf to answer ;)

                                      yep, just launch "Universal_XML_Scraper.exe" or "Universal_XML_Scraper64.exe"
                                      "Scraper.exe" and "scraper64.exe" are just the "Scrape Engine" not the main core software... So they do nothing if you launch them directly (that's why they normally be hiden by the soft ;) )

                                      1 Reply Last reply Reply Quote 0
                                      • C
                                        captainvelvet
                                        last edited by

                                        Ok guys, I've fixed it. I deleted the xml file and images, then pressed F4 in emuletionstation and ran the scraper. Everything ran ok. Beautiful PI that I have now!

                                        1 Reply Last reply Reply Quote 0
                                        • hansolo77H
                                          hansolo77
                                          last edited by hansolo77

                                          Latest version (2.0.0.8) changed RetroPi Scraping again. Not sure where it saves all the metadata/artwork... but it doesn't save it in the \\RetroPie\configs\all\emulationstation\downloaded_images\%system% path anymore. Actually, it looks like it's saving them into \\RetroPie\roms\%system%\downloaded_images now. This is a brand new setup.

                                          Autoconfiguration path configuration is set as follows:

                                          • Root System directory
                                            \\retropie\roms
                                          • XML file name
                                            %Source_RootPath%\%system%\gamelist.xml
                                          • Path to the roms in your XML file
                                            ./
                                          • Folder Name where pictures will be do
                                            %Source_RootPath%\%system%\downloaded_images
                                          • Path to the picture in your XML file
                                            ./downloaded_images/

                                          So why this change? I don't want the artwork saved like this. I want the artwork saved on my SD card (the way it was before) and the ROMs located on the external USB HD. The problem with this too, is when I go to scrape for the missing stuff UXS doesn't find, and I use Selph's or the ES one. They default to saving in the other path. This just sucks.

                                          Who's Scruffy Looking?

                                          vbsV 1 Reply Last reply Reply Quote 0
                                          • vbsV
                                            vbs @hansolo77
                                            last edited by

                                            @hansolo77
                                            There is a new profile named Retropie [Rom folder] now which behaves as you described. Did you choose that maybe? Make sure to choose Retropie if you want the old behavior.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.