• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login

[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

Scheduled Pinned Locked Moved Projects and Themes
scrapescraperuxs
728 Posts 111 Posters 741.8k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • B
    BORIStheBLADE1
    last edited by 16 May 2017, 03:45

    Ok so has anyone scraped their ROM collection on their computer with this program? I've been trying to do it but it's not working right. It will scrap one system but after that it doesnt save any pictures. What folder structure are you also using?

    Thanks

    1 Reply Last reply Reply Quote 0
    • S
      screech
      last edited by 16 May 2017, 08:39

      @rapidfire Bug referenced (and corrected on the next version I must release) : It's happen when you check "Missing Roms" in the general config, and when the rom is not found (but Added to the XML)

      @mattrixk Pretty weird... It's like UXS were blocked by your Firewall/AV ? or Github is inaccessible...

      @BORIStheBLADE1 If you use well the wizard, it use the "default" path to store gamelist and picture on your PI (like the Retropie integrated scraper)
      Be aware there is a probleme with the "auto kill es function". (When you scrape, UXS offer you to Kill ES, if it doesn't work you need to do it manually. It's already corrected in the next version... Really need to release :S )

      B 1 Reply Last reply 16 May 2017, 12:43 Reply Quote 0
      • B
        BORIStheBLADE1 @screech
        last edited by 16 May 2017, 12:43

        @screech
        When scraping for the RPI it works fine. Im talking about scraping locally.

        Ive used the wizard many times for scraping to the RPI. Im talking about "locally " to my PC.
        alt text

        1 Reply Last reply Reply Quote 0
        • H
          hansolo77
          last edited by hansolo77 17 May 2017, 18:23

          So it's been a while since I've updated my system. I'm trying to get UXS to scrape but I've altered the paths and it's not working. In my setup, I've got all my roms on a hard drive, which is attached to the Pi. My plan was to use the larger capacity of the hard drive to store large games (.iso's, etc) and video screen shots. The way UXS sets up for default on the auto-configure, it tries to store all the artwork on SD card inside a nested folder for EmulationStation. I've changed it so it will put it in a subfolder with the ROMS. However, it's not working. It will go through and scrape everything fine. I can load up the created gamelist.xml and can see where it wrote out the location for the various artwork. But the path I told it use doesn't exist. "/home/pi/RetroPie/roms/%system&/art". Everything up to the "art" bit works, but it doesn't create that new path and save images there.

          Is this related to the problem with the SSH commands not shutting down EmulationStation? I've got ES turned off before I scrape. I'm scraping again now, storing the scraped artwork locally on my computer and I will try to move them to the Pi's drive when finished. Is this going to be the only way I can do this?

          Who's Scruffy Looking?

          1 Reply Last reply Reply Quote 0
          • S
            screech
            last edited by 19 May 2017, 13:14

            @BORIStheBLADE1 and @hansolo77

            In ProfilsFiles Folder, open Retropie.xml

            Look for the section <AutoConf>

            and replace it by :

            <AutoConf>  
            <Source_RootPath>\\retropie\roms</Source_RootPath>  
            <Target_XMLName>%Source_RootPath%\%system%\gamelist.xml</Target_XMLName>  
            <Target_RomPath>./</Target_RomPath>
            <Source_ImagePath>%Source_RootPath%\%system%\downloaded_images</Source_ImagePath>
            <Target_ImagePath>./downloaded_images/</Target_ImagePath>
            </AutoConf>
            

            For both of you : Change the <Source_RootPath> with the "reel path to your rom's systems folder"
            For @hansolo77 :
            Change <Source_ImagePath> by : %Source_RootPath%\%system%\art
            and
            Change <Target_ImagePath> by : ./art/

            It must work ;)
            (You can do it through the interface ^^ but it's easier to copy/past ;) )

            B M 2 Replies Last reply 20 May 2017, 03:44 Reply Quote 0
            • H
              hansolo77
              last edited by 19 May 2017, 21:33

              I've got it working by downloading locally and copying the files over. I think the problem I was having was due to SSH and permissions. It wouldn't create the path I needed, and didn't download the images to it.

              Who's Scruffy Looking?

              1 Reply Last reply Reply Quote 0
              • B
                BORIStheBLADE1 @screech
                last edited by 20 May 2017, 03:44

                @screech Will give it a try, thanks

                1 Reply Last reply Reply Quote 0
                • M
                  mattrixk @screech
                  last edited by 20 May 2017, 10:42

                  Hi @screech, you probably know this already, but the screenscraper.fr site is currently down. Did you ever get around to making the change that lets a user run the program, even if it can't connect to the screenscraper server?

                  I'd still like to be able to play with MIX profiles and other things that don't necessarily require access to the server.

                  Note: I still use v2.1.0.6 because it works well for me. I understand that v2.2.0.0 was a pretty major upgrade, but I just haven't had to the time to sit down and play with it yet to work out all the differences.

                  My ES themes: MetaPixel | Spare | Io | Indent

                  1 Reply Last reply Reply Quote 0
                  • O
                    ortsac
                    last edited by 20 May 2017, 16:55

                    Help is appreciated for a newbie here. Is UXS a separate from Retropie? Where can I get it and how to install it? I need to get download game videos and someone suggested it is a great avenue for such tasks...

                    A 1 Reply Last reply 20 May 2017, 16:57 Reply Quote 0
                    • A
                      AlexMurphy Banned @ortsac
                      last edited by 20 May 2017, 16:57

                      @ortsac Yes, it's totally separate and needs to be run using a Windows PC. Link: https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/releases

                      O 1 Reply Last reply 20 May 2017, 17:00 Reply Quote 1
                      • O
                        ortsac @AlexMurphy
                        last edited by 20 May 2017, 17:00

                        @AlexMurphy Awesome!!! thanks for the reply. will give it a try.

                        O 1 Reply Last reply 20 May 2017, 19:24 Reply Quote 0
                        • O
                          ortsac @ortsac
                          last edited by 20 May 2017, 19:24

                          @ortsac Does anyone know if screescraper.fr is down? I subscribed to the site and it replied afterwards that my credentials were saved but will require confirmation via link that will be provided on an email. I repeated the subscription about 30 minutes later, making sure the email address I provided was good. It's been 1 hour since and I have not gotten the confirmation link email. Maybe the site is not overseen during off hours or week end, so I'm wondering if the site is currently down?

                          A 1 Reply Last reply 20 May 2017, 19:25 Reply Quote 0
                          • A
                            AlexMurphy Banned @ortsac
                            last edited by AlexMurphy 20 May 2017, 19:25

                            @ortsac It's working fine for me. https://screenscraper.fr/ Have you checked your spam folder?

                            EDIT: It will still work without an account but you only get a single thread, so will take longer.

                            O 2 Replies Last reply 20 May 2017, 19:44 Reply Quote 0
                            • O
                              ortsac @AlexMurphy
                              last edited by 20 May 2017, 19:44

                              @AlexMurphy not in the spam folder either.

                              1 Reply Last reply Reply Quote 0
                              • O
                                ortsac @AlexMurphy
                                last edited by 20 May 2017, 19:46

                                @AlexMurphy where in the site can I get game videos exactly. Just to download one to try out....Thanks for the help.

                                A 1 Reply Last reply 20 May 2017, 19:49 Reply Quote 0
                                • A
                                  AlexMurphy Banned @ortsac
                                  last edited by 20 May 2017, 19:49

                                  @ortsac Hmmm, the connection is actually timing out on me now. But when it does work there is a menu up top including media. You can also click on the little US flag on the left to get a (mostly) translated version of the site.

                                  1 Reply Last reply Reply Quote 0
                                  • O
                                    ortsac
                                    last edited by 20 May 2017, 19:51

                                    OK...I got the site in English. which area in the site contains games video for download?

                                    E 1 Reply Last reply 20 May 2017, 20:09 Reply Quote 0
                                    • E
                                      EctoOne @ortsac
                                      last edited by 20 May 2017, 20:09

                                      @ortsac the videos are found in (some) game details. Like https://screenscraper.fr/gameinfos.php?plateforme=2&gameid=754 it's listed under All Media. If you want to scrape them with UXS you need to pick the right profil or enable an option (can't remember what works now and actually never really tried it).

                                      O 1 Reply Last reply 20 May 2017, 20:31 Reply Quote 0
                                      • S
                                        screech
                                        last edited by 20 May 2017, 20:30

                                        @ortsac I just forced your validation ;) (sometime, email don't want to be send :S )

                                        For information, we've got some problem with the server today... And normally it's ok now ;)

                                        O 1 Reply Last reply 20 May 2017, 20:32 Reply Quote 0
                                        • O
                                          ortsac @EctoOne
                                          last edited by 20 May 2017, 20:31

                                          This post is deleted!
                                          H T 2 Replies Last reply 20 May 2017, 20:32 Reply Quote 0
                                          435 out of 728
                                          • First post
                                            435/728
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                            This community forum collects and processes your personal information.
                                            consent.not_received