RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 751.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      BORIStheBLADE1 @screech
      last edited by

      @screech
      When scraping for the RPI it works fine. Im talking about scraping locally.

      Ive used the wizard many times for scraping to the RPI. Im talking about "locally " to my PC.
      alt text

      1 Reply Last reply Reply Quote 0
      • hansolo77H
        hansolo77
        last edited by hansolo77

        So it's been a while since I've updated my system. I'm trying to get UXS to scrape but I've altered the paths and it's not working. In my setup, I've got all my roms on a hard drive, which is attached to the Pi. My plan was to use the larger capacity of the hard drive to store large games (.iso's, etc) and video screen shots. The way UXS sets up for default on the auto-configure, it tries to store all the artwork on SD card inside a nested folder for EmulationStation. I've changed it so it will put it in a subfolder with the ROMS. However, it's not working. It will go through and scrape everything fine. I can load up the created gamelist.xml and can see where it wrote out the location for the various artwork. But the path I told it use doesn't exist. "/home/pi/RetroPie/roms/%system&/art". Everything up to the "art" bit works, but it doesn't create that new path and save images there.

        Is this related to the problem with the SSH commands not shutting down EmulationStation? I've got ES turned off before I scrape. I'm scraping again now, storing the scraped artwork locally on my computer and I will try to move them to the Pi's drive when finished. Is this going to be the only way I can do this?

        Who's Scruffy Looking?

        1 Reply Last reply Reply Quote 0
        • screechS
          screech
          last edited by

          @BORIStheBLADE1 and @hansolo77

          In ProfilsFiles Folder, open Retropie.xml

          Look for the section <AutoConf>

          and replace it by :

          <AutoConf>  
          <Source_RootPath>\\retropie\roms</Source_RootPath>  
          <Target_XMLName>%Source_RootPath%\%system%\gamelist.xml</Target_XMLName>  
          <Target_RomPath>./</Target_RomPath>
          <Source_ImagePath>%Source_RootPath%\%system%\downloaded_images</Source_ImagePath>
          <Target_ImagePath>./downloaded_images/</Target_ImagePath>
          </AutoConf>
          

          For both of you : Change the <Source_RootPath> with the "reel path to your rom's systems folder"
          For @hansolo77 :
          Change <Source_ImagePath> by : %Source_RootPath%\%system%\art
          and
          Change <Target_ImagePath> by : ./art/

          It must work ;)
          (You can do it through the interface ^^ but it's easier to copy/past ;) )

          B mattrixkM 2 Replies Last reply Reply Quote 0
          • hansolo77H
            hansolo77
            last edited by

            I've got it working by downloading locally and copying the files over. I think the problem I was having was due to SSH and permissions. It wouldn't create the path I needed, and didn't download the images to it.

            Who's Scruffy Looking?

            1 Reply Last reply Reply Quote 0
            • B
              BORIStheBLADE1 @screech
              last edited by

              @screech Will give it a try, thanks

              1 Reply Last reply Reply Quote 0
              • mattrixkM
                mattrixk @screech
                last edited by

                Hi @screech, you probably know this already, but the screenscraper.fr site is currently down. Did you ever get around to making the change that lets a user run the program, even if it can't connect to the screenscraper server?

                I'd still like to be able to play with MIX profiles and other things that don't necessarily require access to the server.

                Note: I still use v2.1.0.6 because it works well for me. I understand that v2.2.0.0 was a pretty major upgrade, but I just haven't had to the time to sit down and play with it yet to work out all the differences.

                My ES themes: MetaPixel | Spare | Io | Indent

                1 Reply Last reply Reply Quote 0
                • O
                  ortsac
                  last edited by

                  Help is appreciated for a newbie here. Is UXS a separate from Retropie? Where can I get it and how to install it? I need to get download game videos and someone suggested it is a great avenue for such tasks...

                  AlexMurphyA 1 Reply Last reply Reply Quote 0
                  • AlexMurphyA
                    AlexMurphy Banned @ortsac
                    last edited by

                    @ortsac Yes, it's totally separate and needs to be run using a Windows PC. Link: https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

                    O 1 Reply Last reply Reply Quote 1
                    • O
                      ortsac @AlexMurphy
                      last edited by

                      @AlexMurphy Awesome!!! thanks for the reply. will give it a try.

                      O 1 Reply Last reply Reply Quote 0
                      • O
                        ortsac @ortsac
                        last edited by

                        @ortsac Does anyone know if screescraper.fr is down? I subscribed to the site and it replied afterwards that my credentials were saved but will require confirmation via link that will be provided on an email. I repeated the subscription about 30 minutes later, making sure the email address I provided was good. It's been 1 hour since and I have not gotten the confirmation link email. Maybe the site is not overseen during off hours or week end, so I'm wondering if the site is currently down?

                        AlexMurphyA 1 Reply Last reply Reply Quote 0
                        • AlexMurphyA
                          AlexMurphy Banned @ortsac
                          last edited by AlexMurphy

                          @ortsac It's working fine for me. https://screenscraper.fr/ Have you checked your spam folder?

                          EDIT: It will still work without an account but you only get a single thread, so will take longer.

                          O 2 Replies Last reply Reply Quote 0
                          • O
                            ortsac @AlexMurphy
                            last edited by

                            @AlexMurphy not in the spam folder either.

                            1 Reply Last reply Reply Quote 0
                            • O
                              ortsac @AlexMurphy
                              last edited by

                              @AlexMurphy where in the site can I get game videos exactly. Just to download one to try out....Thanks for the help.

                              AlexMurphyA 1 Reply Last reply Reply Quote 0
                              • AlexMurphyA
                                AlexMurphy Banned @ortsac
                                last edited by

                                @ortsac Hmmm, the connection is actually timing out on me now. But when it does work there is a menu up top including media. You can also click on the little US flag on the left to get a (mostly) translated version of the site.

                                1 Reply Last reply Reply Quote 0
                                • O
                                  ortsac
                                  last edited by

                                  OK...I got the site in English. which area in the site contains games video for download?

                                  E 1 Reply Last reply Reply Quote 0
                                  • E
                                    EctoOne @ortsac
                                    last edited by

                                    @ortsac the videos are found in (some) game details. Like https://screenscraper.fr/gameinfos.php?plateforme=2&gameid=754 it's listed under All Media. If you want to scrape them with UXS you need to pick the right profil or enable an option (can't remember what works now and actually never really tried it).

                                    O 1 Reply Last reply Reply Quote 0
                                    • screechS
                                      screech
                                      last edited by

                                      @ortsac I just forced your validation ;) (sometime, email don't want to be send :S )

                                      For information, we've got some problem with the server today... And normally it's ok now ;)

                                      O 1 Reply Last reply Reply Quote 0
                                      • O
                                        ortsac @EctoOne
                                        last edited by

                                        This post is deleted!
                                        herb_fargusH TMNTturtlguyT 2 Replies Last reply Reply Quote 0
                                        • O
                                          ortsac @screech
                                          last edited by

                                          @screech Thanks!!! I'll give it a try again.

                                          1 Reply Last reply Reply Quote 0
                                          • screechS
                                            screech
                                            last edited by

                                            You can't download rom ^^ it's only a DB to scrape your own rom.
                                            And to Scrape, the best way is to use a scraper ;) like the one from sselph or UXS ;)

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.