RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 743.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P
      paradadf @KillerQ
      last edited by

      @KillerQ read a few posts before...
      ScreenScraper is migrating to a better server and thus the current "issues".

      K 1 Reply Last reply Reply Quote 1
      • K
        KillerQ @paradadf
        last edited by

        @paradadf said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

        @KillerQ read a few posts before...
        ScreenScraper is migrating to a better server and thus the current "issues".

        Got it - thanks!!

        1 Reply Last reply Reply Quote 0
        • hansolo77H
          hansolo77
          last edited by

          I noticed in the release notes for the latest version (5 hours ago v2.1.0.0 git 78e5b95) that you have a new profile for video. :) How does this work? Do you need to use a specific theme to get videos to work, or will it work with the default theme? I think for best results it should use the default theme at least. Just curious! If it requires a special theme, it might not work in my case, and I can't test it for you.

          Who's Scruffy Looking?

          1 Reply Last reply Reply Quote 0
          • hansolo77H
            hansolo77
            last edited by hansolo77

            Preliminary testing...

            1. Scraped Atari 2600
            2. Rebooted Pi
            3. Entered Atari 2600
            4. Looked through games
            5. No videos
            6. Noticed some static screenshot images without boxart (using MIX profile)

            Is it possible that the system is using the IMAGE tag first, and the VIDEO tag second as a fallback? If so, it should be the other way around. So the video plays first, and if no video exists then show the image. In the case of the static screenshot without boxart, is there maybe a requirement for ES to have some kind of codec installed to allow playing the video rather than just showing the first frame? Or is it truly just a screenshot without boxart in the database? In either case, it needs more testing. From what I can tell, videos do NOT play while in the default Carbon theme.

            Who's Scruffy Looking?

            vbsV M 2 Replies Last reply Reply Quote 0
            • vbsV
              vbs @hansolo77
              last edited by

              @hansolo77
              Quite sure that if you want videos to show you will have to use a theme that makes use of them.

              hansolo77H 1 Reply Last reply Reply Quote 0
              • G
                giventofly @hansolo77
                last edited by

                @hansolo77 well, for that exact same problem i talked to @screech (guess it was him) on the github to add the hash of those files on the pi directlty instead of "transfering" them first.

                you have the option to do that adding the config in the .ini (see github for the code).

                1 Reply Last reply Reply Quote 0
                • hansolo77H
                  hansolo77 @vbs
                  last edited by

                  @vbs If that's the case, I'll just stick with my current batch of scrapes until Carbon is updated to allow videos. Because I have a bunch of systems installed on my RetroPie, I pretty much have to use Carbon. I don't like it, but it's the only theme that seems to work.

                  Who's Scruffy Looking?

                  N 1 Reply Last reply Reply Quote 0
                  • M
                    MartinS @hansolo77
                    last edited by

                    @hansolo77 So, you have been able to get XML Scraper to work recently? I have tried the new version and old versions. When I select scrape, the program kind of hangs. I have to close it via task manager.

                    T 1 Reply Last reply Reply Quote 0
                    • hansolo77H
                      hansolo77
                      last edited by

                      Their server is undergowing migration. They're moving everything to a larger/faster system. There have been hiccups, and delays. I tried probably a dozen times last night to just get UXS to open, it hangs, then crashes saying it timed out. The one time it DID open, I was able to get Atari 2600 to scrape. It looks like it worked. I just don't have a compatible theme to use the videos. It downloads both simultaneously (videos & images) and stores them side-by-side, and adds a <video>/path/</video> line to each game in the gamelist.xml. The only noticeable difference is the file extension.

                      Who's Scruffy Looking?

                      1 Reply Last reply Reply Quote 1
                      • K
                        KillerQ
                        last edited by

                        Seems that there are still hiccups in the migration - or something.

                        I can scrape roms on my pi that contain less than about 100 ROMS - anything larger just sits there and does nothing. It will create an image folder and gamelist, but it never populates either.

                        I also noticed that some directors and paths under options have a period (.) before the paths... I wonder if that's a typo.

                        Just trying to help.

                        Thanks!

                        1 Reply Last reply Reply Quote 0
                        • K
                          KillerQ
                          last edited by KillerQ

                          I figured something out. If your XMS just hangs and never starts try this... type the name of the system in your roms folder over again... that is, even though the rom folder may look to be named properly, and XMS sees it, before you scrape, just go into the pie and type the rom name folder over.

                          I renamed 'nes' to 'nes' again, and it worked perfectly!!

                          1 Reply Last reply Reply Quote 0
                          • K
                            KillerQ @screech
                            last edited by

                            @screech said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                            Hello Everyone.

                            Sorry for the problem you can have with UXS and Screenscraper.
                            For the new year we are migrating server to a new big one.
                            In the main time, we are migrating screenscraper database to V2. So lot's of new things are coming.
                            Thank you to be patient, it's a matter of day (hour ?)...

                            Bonjour tous le monde,

                            Désolé pour les problèmes que vous pouvez rencontrer actuellement avec UXS et Screenscraper.
                            Pour la nouvelle année nous migrons de serveur et passant sur un nouveau Dédié beaucoup plus performant.
                            En même temps, nous faisons évoluer le site et la BDD de Screenscraper en V2.
                            Donc plein de nouvelles choses qui arrivent.

                            Merci d’être patient, il ne s'agit que d'une question de jours (heures ?).

                            Again we want to thanks all of you who help us participating to the BDD and with some tipee or patreon donation. Have an happy christmas and an happy new year.

                            Encore une fois, nous remercions tous ceux qui nous aide en participant à la BDD et financièrement avec Tipee et Patreon. Joyeux noël et bonne année..

                            Screech,

                             Thanks for your hard work.  I figured something out that may help you out...
                            

                            If your XMS just hangs and never starts try this... type the name of the system in your roms folder over again... that is, even though the rom folder may look to be named properly, and XMS sees it, before you scrape, just go into the pie and type the rom name folder over.

                            I renamed 'nes' to 'nes' again, and it worked perfectly!!

                            vbsV 1 Reply Last reply Reply Quote 0
                            • vbsV
                              vbs @KillerQ
                              last edited by

                              @KillerQ said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                              I renamed 'nes' to 'nes' again, and it worked perfectly!!

                              Sorry to say, but this cannot fix anything. Really not :)

                              1 Reply Last reply Reply Quote 0
                              • M
                                MartinS
                                last edited by

                                I donated £10 to have access to 5 threads. Anyone know how to activate this? I logged in and it says I have access to 1 thread. Thanks.

                                P 1 Reply Last reply Reply Quote 0
                                • P
                                  paradadf @MartinS
                                  last edited by

                                  @MartinS join them on IRC on:
                                  https://kiwiirc.com/client/irc.freenode.net/#screenzone
                                  And tell anyone there that you donated. They'll ask you for your user name and you are ready to go!

                                  M 1 Reply Last reply Reply Quote 1
                                  • M
                                    MartinS @paradadf
                                    last edited by

                                    @paradadf Thanks. I will try that now.

                                    1 Reply Last reply Reply Quote 0
                                    • T
                                      tekn0 @MartinS
                                      last edited by tekn0

                                      @MartinS Same thing here, just hangs and does nothing. Auto configuration seems to work fine. I am only trying to scrape a single system.

                                      1 Reply Last reply Reply Quote 0
                                      • screechS
                                        screech
                                        last edited by

                                        Sorry to be late :S (christmas and familly duty)

                                        Ok, There is a problem with my last change on SSH command :S I'll correct that in the version I release today ;)

                                        (For the other error : it's due to the server migration. Normally all is ok right now ;) )

                                        T 1 Reply Last reply Reply Quote 2
                                        • T
                                          tekn0 @screech
                                          last edited by

                                          @screech said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                                          Sorry to be late :S (christmas and familly duty)

                                          Ok, There is a problem with my last change on SSH command :S I'll correct that in the version I release today ;)

                                          (For the other error : it's due to the server migration. Normally all is ok right now ;) )

                                          The new updated fixed all of the issues for me, thank you very much. :)

                                          Also is there a list that tells what the "profiles" are? I don't understand the difference between
                                          Retropie (Mix) and Retropie [Rom folder] (Mix)

                                          1 Reply Last reply Reply Quote 0
                                          • V
                                            vric
                                            last edited by vric

                                            Last night, I was using the scraper for the whole night (full system scrap). After getting up this morning, I saw the software crashed and did about 30% of the job. Nothing updated on retropie.

                                            Now I try to restart the software, but everytime I get an "Universal XML Scraper fatal error! (err_SystemList)

                                            Tried rebooting, redownloading, deleting settings files, still can't get the software to launch anymore.

                                            Any idea ?

                                            Thanks

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.