RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 748.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • screechS
      screech
      last edited by

      so you need to "simulate" the Retropie standard path on your PC... like I did for the test ^^

      Make a folder name Retropie.
      and subfolder /configs/all/emulationstation/downloaded_images
      and subfolder /configs/all/emulationstation/gamelists
      and subfolder /roms

      So you just need to put your different plateform folder (named exactly the same as retropie) in the Roms folder and just tell UXS you want to autoconfigure on this one ;) (with the wizzard and a standard profil ;) )

      1 Reply Last reply Reply Quote 0
      • C
        C hicaned
        last edited by C hicaned

        Hello!

        Anyone experiencing this error when scraping roms :-

        0_1486288643964_upload-3d2ddb5f-db6c-4c10-b4a1-77594b0104f8

        Seeing this error several times when scraping 800 Megadrive roms with 3 pictures per rom.

        Should probably add I'm on the very latest version as well (2.1.0.6). I wasn't going to mention the 'unusual' error ;-)

        Thanks,

        Chicaned

        N 1 Reply Last reply Reply Quote 1
        • N
          Nismo @C hicaned
          last edited by Nismo

          @C-hicaned error.. png fucked... lol XD

          I'm sure @screech can help you with that.

          UDb23U 1 Reply Last reply Reply Quote 3
          • UDb23U
            UDb23 @Nismo
            last edited by

            @Nismo Unusual error message lol!

            1 Reply Last reply Reply Quote 2
            • screechS
              screech
              last edited by

              Oups !! sorry for this unusual error message ^^
              It's a debug one who normally don't happen anymore (it's when I try to resize a picture and the original one have no dimension... so the picture is a fu£$*%^ one ;) )

              Need to recheck why it can appear again :S

              1 Reply Last reply Reply Quote 2
              • J
                Jeck11
                last edited by

                Will this scrape videos as well? Looking for a way to build up a collection for the new themes.

                1 Reply Last reply Reply Quote 0
                • K
                  Keikato
                  last edited by

                  Hi. First of all thanks for your scrapper and sorry my realy bad english (from Ukraine). Please tell me why skrapper skips part of the Roms? Whether it is possible to manually select the cover for missed games?
                  alt text

                  K 1 Reply Last reply Reply Quote 1
                  • K
                    Keikato @Keikato
                    last edited by

                    @Keikato said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                    Hi. First of all thanks for your scrapper and sorry my realy bad english (from Ukraine). Please tell me why skrapper skips part of the Roms? Whether it is possible to manually select the cover for missed games?
                    alt text

                    games from us and jpn regions, some with fan translations, but i still dont see any regulars

                    1 Reply Last reply Reply Quote 0
                    • G
                      gameplaygoon
                      last edited by

                      Im having two big problems with this but also really appreciate you putting this together im sure this took alot of work. Thanks :)

                      When using with Retropie if I press scrape all systems I get this error message everytime.

                      0_1486334289734_Untitled.png

                      Also after using threading it seemed to mess something up and crash everytime afterwards.

                      Thanks

                      1 Reply Last reply Reply Quote 0
                      • T
                        Tasio
                        last edited by Tasio

                        A bit of mixed feelings about this software. I really like the idea but in practice it has many issues.
                        I'll list some of the issues I can remember:

                        • Won't open on my main computer, freeze the file explorer and I can't find the process to kill it, I have to restart windows 10. On an old laptop with windows 10 works fine.
                        • I have tried with master system because I have few games and is faster but no matter what "Mix image profile" I choose, it always creates "BigPicture"
                        • Some games are not found with this software, the non found can be find with the default retropie scraper. Examples: Fantasy zone II
                        • After setting my pi roms folder url "\192.168.1.199\roms" on the wizard, and running the scrape, it throws and error because SSH is still pointing to the default HOST, not to 192.168.1.199, I have to manually edit this configuration.
                        • I think creating files and folder when first lunch may not be a good idea unless you ask for confirmation, many pleople try to open open downloaded software from the browser.
                        • scraping some plataforms like fba with 4 images (mix), I have same error as mentioned above by @gameplaygoon
                        • Very slow for some systems, I tried for pc engine and it tooks 8 minutes for only one game, it didn't find the game and now I have "Akumajou dracula X" duplicated because this scraper did something wrong. this is part of the error log:
                        @error description:
                        $XML_ERR_PARSE=11
                        Error: with Parsing objects, .parseError.errorCode=0 Use _XML_ErrorParser_GetDescription() for get details.
                        
                        @extended description:
                        $XML_EXT_DEFAULT=0
                        Default - Do not return any additional information
                        
                        [11:56:38] - /!\ _XML_Open ERROR (Data/jeu/regionshortnames/regionshortname)
                        [11:56:38] - /!\ _XML_Load @error:
                        @error description:
                        $XML_ERR_PARSE=11
                        Error: with Parsing objects, .parseError.errorCode=0 Use _XML_ErrorParser_GetDescription() for get details.
                        

                        I hope this help, I would really like to try those "Mix image profile", I'll have a look at Screenscraper to see if I can help with anything.

                        hooperreH 1 Reply Last reply Reply Quote 0
                        • G
                          gameplaygoon
                          last edited by

                          I am also noticing when using the update xml method it just seems to says hashing files forever I thought this option was supposed to reduce the time if you already had scraped for some of the roms for a given system it just seems to go on forever. Sorry if Im missing something.

                          Also would anyone kindly clear something up for me, I have noticed people have made themes that have video previews of roms. Something I would love to do, I also noticed in this scraper there is a video profile mentioned is this the same thing of something completely different Im new to this whole thing (:

                          mattrixkM 1 Reply Last reply Reply Quote 0
                          • SquilenatorS
                            Squilenator @screech
                            last edited by

                            @screech I'm using the last release and got a problem, after the scrape process some roms were renamed wrongly, such as "Advanced Dungeons & Dragons - Pool of Radiance (USA)" which became just "Pool of Radiance". It was always like that?

                            1 Reply Last reply Reply Quote 0
                            • B
                              BORIStheBLADE1
                              last edited by

                              I posted this in my thread and just realized this is probably a better place for it.

                              Ran some N64 roms and have five that won't scrap. Ran it two different times with your new software.

                              http://pastebin.com/QYYApU0f

                              1 Reply Last reply Reply Quote 0
                              • mattrixkM
                                mattrixk @gameplaygoon
                                last edited by

                                @gameplaygoon If you update RetroPie from source you can get the ability to have Video Previews. This gives you 2 new tags for use in your gamelist.xml files: <video> and <marquee>. You can use the RetroPie (video) scrape profile to scrape videos and UXS will scrape the game videos that exist and put them in the <video> tag in the created gamelist.xml along with all the other metadata.

                                Just be careful. The videos are all 640x480 (I think) and a couple of MB each. That can add up if you aren't careful, so maybe scrape them on your PC first and then only use certain videos.

                                My ES themes: MetaPixel | Spare | Io | Indent

                                G 1 Reply Last reply Reply Quote 0
                                • G
                                  gameplaygoon @mattrixk
                                  last edited by

                                  @mattrixk Thanks but what do you mean update Retropie from source, I have the latest version installed?

                                  mattrixkM 1 Reply Last reply Reply Quote 0
                                  • mattrixkM
                                    mattrixk @gameplaygoon
                                    last edited by

                                    @gameplaygoon Sorry mate, someone else is going to have to answer that one for you. I've never done it. I have a my setup working and since it's more a media box than a game station, I don't really mess with it.

                                    This is where they talk about Video Preview, but beware as it's now over 400 comments long.

                                    My ES themes: MetaPixel | Spare | Io | Indent

                                    1 Reply Last reply Reply Quote 0
                                    • screechS
                                      screech
                                      last edited by

                                      @mattrixk and @gameplaygoon Warning : no more "RetroPie (video)" scrape profile.
                                      Now there is only Retropie (Standard, MIX, or Rom Folder) profiles. BUT, in "Option configuration" Menu, you can "activate" video" and choose what you want to download as Marquee (not only Marquees ;) )

                                      @Squilenator on wich plateform ?

                                      @BORIStheBLADE1 "Conker's Bad Fur Day (USA).z64 " haven't CRC... so i can't import it. . The other one are ok, it's done.

                                      @gameplaygoon What do you try to "update" ? On plateform like MAME, UXS try to found a match inside the ZIP if the ZIP isn't found. So it can be long. On CD plateform try this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/ISO-Scrape-Freeze-or-are-very-long

                                      @Tasio :

                                      • Freeze : Try this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Universal-XML-Scraper-fatal-error!-(err_SystemList)

                                      • Mix Profile : It look like a "write right" problem... Try launch in admin ?

                                      • Not found : Try this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper

                                      • Path to the scrape, and Info for SSH are dissociated... (sorry) So you need to configure it both if you aren't in a "standard" configuration

                                      • Creating file/folder : You are true... It's an old "security" function I need to take off...

                                      • Scraping FBA : I don't know why :S need to check...

                                      • Time may be du to Server response (some heavy load these last days...) But having multiple time the same info is weird :S

                                      • Parsing Error : It's maybe due to the same issue (write auth), it can parse the xml maybe because it can't write it....

                                      (Sorry for the delay to answer, I were sick.. And it's not finish >< )

                                      SquilenatorS 1 Reply Last reply Reply Quote 1
                                      • G
                                        gameplaygoon
                                        last edited by

                                        How do you choose how the video will be layed out or does it simply just download it into a folder and you have to do the rest. Because when you choose the layout of the pictures how do you choose where the video is placed?

                                        Thanks

                                        1 Reply Last reply Reply Quote 0
                                        • screechS
                                          screech
                                          last edited by

                                          UXS only Scrape ;)

                                          The Layout is in the theming (and need the right version of Retropie to work ;) )

                                          1 Reply Last reply Reply Quote 0
                                          • SquilenatorS
                                            Squilenator @screech
                                            last edited by

                                            @screech Nintendo NES

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.