RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 742.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • GreenHawk84G
      GreenHawk84
      last edited by

      Is there only ONE mix and ONE video snap per game that everyone receives?

      What if 5 people submit art for the same game and one of those is spot on but the others are inaccurate?

      hooperreH 1 Reply Last reply Reply Quote 0
      • hooperreH
        hooperre @GreenHawk84
        last edited by

        @greenhawk84 said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

        Is there only ONE mix and ONE video snap per game that everyone receives?

        What if 5 people submit art for the same game and one of those is spot on but the others are inaccurate?

        I am not a dev of this project or http://screenscraper.fr, but I'm pretty sure information is submitted and approved by mods at the website and only the one they deem to be more accurate stays. Often times I will create custom ones.

        4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

        1 Reply Last reply Reply Quote 0
        • GreenHawk84G
          GreenHawk84
          last edited by

          Some of the video snaps that were "scraped" are not playing.

          Examples: astorm, altbeast, btime, centiped.

          If I copy the downloaded .mp4 file from my Retropie installation to my desktop and play the .mp4, I will hear sound but see no video. This is different for a video snap that does play in Retropie; everything plays as normal when I copy to my desktop for testing.

          hooperreH QuackwalksQ 2 Replies Last reply Reply Quote 0
          • hooperreH
            hooperre @GreenHawk84
            last edited by

            @greenhawk84 said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

            Some of the video snaps that were "scraped" are not playing.

            Examples: astorm, altbeast, btime, centiped.

            If I copy the downloaded .mp4 file from my Retropie installation to my desktop and play the .mp4, I will hear sound but see no video. This is different for a video snap that does play in Retropie; everything plays as normal when I copy to my desktop for testing.

            I've had the same problem for a while. I go and get the snaps elsewhere in this case. :\

            4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

            GreenHawk84G 1 Reply Last reply Reply Quote 0
            • GreenHawk84G
              GreenHawk84 @hooperre
              last edited by

              @hooperre I wonder if there is a tool that can be created to search for specific images and videos in the databases that scrapers access?

              Say I want Super Mario artwork and I want to see what has been submitted. I would type in Super Mario and the window would populate with available box art/videos/logos. I could click on that file and bring it up on my PC to preview it before dropping it into Retropie via WinSCP.

              Is this possible?

              mituM 1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator @GreenHawk84
                last edited by

                @greenhawk84 Use a browser to access the sites used for scraping, the same artwork should be available and searchable.

                1 Reply Last reply Reply Quote 1
                • P
                  Pyjamarama
                  last edited by

                  Universal XML Scraper V2 scrapes my Amiga .lha files (form the RetroPlay pack) up to letter C. Strange

                  1 Reply Last reply Reply Quote 0
                  • QuackwalksQ
                    Quackwalks @GreenHawk84
                    last edited by Quackwalks

                    @greenhawk84 I'm having the same problem with the same games. The video and sound play fine when copied to my pc. Also, when the OMX player is disabled the videos will play in emulationstation. Something ain't quite right with certain video snaps. (edit) I've learned that some videos are encoded differently, using YUV 4:4:4 instead of YUV 4:2:0, and that I need to convert them to work with OMX player. I guess that answers that.

                    hansolo77H 1 Reply Last reply Reply Quote 0
                    • hansolo77H
                      hansolo77 @Quackwalks
                      last edited by

                      @quackwalks There is a script here in the forums somewhere that will go through your videos and automatically reencode the ones that need it. I don't remember where I found it or what it's called, but I know it's there. You can probably find it if you look for it. It's really easy to use, and a lifesaver. I had the same problem till I learned that.

                      Who's Scruffy Looking?

                      QuackwalksQ 1 Reply Last reply Reply Quote 0
                      • QuackwalksQ
                        Quackwalks @hansolo77
                        last edited by

                        @hansolo77 It's right here, https://retropie.org.uk/forum/topic/15362/script-batch-convert-yuv-4-4-4-videos-to-yuv-4-2-0-in-retropie-linux. I just finished using it and it worked perfectly.

                        1 Reply Last reply Reply Quote 1
                        • E
                          elahrairah
                          last edited by

                          So I downloaded video and 3d box with xml scraper for psx and all went well but the gamelist.xml shows the wrong paths to my video art.

                          I use on my retropie setup (with external hdd) two seperate folders for images and video:
                          Image : folder "boxart
                          Video: folder "snap"
                          Both these folders are in the system rom folder: /roms/psx
                          This is the conventional method almost every retropie user uses.
                          But when looking at the paths to the video and art in the gamelist I see they both point to same location which is /retropie/roms/psx/boxart. This means I have to put all the art in the same "boxart" folder, which I do not want.

                          So I did try to fix it myself and change the path in configuration to "boxart" location which is the right path for the 3d boxes. But I want the gamelist to also create a seperate path to the video in the gamelist.xml, so it points to my art folder "snap"

                          How do I do this?

                          Long question in short: how do I change the paths in the gamelist.xml so each type of art is linked to a seperate folder?

                          E 1 Reply Last reply Reply Quote 0
                          • E
                            EctoOne @elahrairah
                            last edited by

                            @elahrairah there is no way to set differnt paths in the scraper as far as i know. you have to manually edit the video paths in the gamelist.xml. Doing a search/replace should be the easiest method. I suggest to search for <video>OLDPATH/instead of just OLDPATH/ this will prevent that the path to your images will also be changed.

                            E 1 Reply Last reply Reply Quote 1
                            • E
                              elahrairah @EctoOne
                              last edited by

                              @ectoone don't know if I will go through those lengths but I appreciate your answer, at least now I know it's not possible, so I think I'll just put all art in 1 folder.. No big deal.

                              E 1 Reply Last reply Reply Quote 0
                              • E
                                EctoOne @elahrairah
                                last edited by

                                @elahrairah with something like notepad++ it is very simple to achieve though. It lets you search/replace in multiple files and what not. I did the same thing for all four media files (boxart, marquee, thumbnail and video) and have them in separate folders now.

                                1 Reply Last reply Reply Quote 1
                                • hooperreH
                                  hooperre
                                  last edited by hooperre

                                  @screech Is there a way to add a game for PC for example on the screenscraper.fr website? I see Windows 3.1 and stuff.

                                  Also, I haven't been able to login from Google Chrome for about a year. I have had to use Microsoft Edge. :\

                                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                  1 Reply Last reply Reply Quote 0
                                  • BiZzAr721B
                                    BiZzAr721
                                    last edited by

                                    Excellent program! Extremely usefull and simple.

                                    I have been searching for an answer for a question that maybe can be answered here. I have a lot of MS -DOS games that I would like to scrape. I have tried scraping entire folders, renaming files, even creating a blank file with the name & extension shown on ScreenScraper.fe.

                                    Quite a bit of ms-dos games have screenshot/box/disk art. I was able to get scummVM to scrape by naming the scripts to match exactly, but I can't figure out why it will not work with MS-DOS. I asked over at ScreenScraper.fe forums but they seem to be pretty empty and haven't gotten a response. Is it possible to create custom images from multiple images by having all the images in folders on a pc? It would still be a lot better than what I have been doing, which is editing, resizing and combining each artwork manually. Thank you.

                                    1 Reply Last reply Reply Quote 0
                                    • AndersHPA
                                      AndersHP
                                      last edited by AndersHP

                                      I just rescraped my entire arcade catalog, but cannot get UXML V2 to scrape a few selected games: why this issue with even some pretty known titles (and some not)?:

                                      • Qbert
                                      • krull
                                      • ZigZag
                                      • Vendetta
                                      • Rainbow Islands

                                      ..along with a few others. In the final scraping status screen it says 100% found, but it returns 1KB empty images/videos.

                                      My "Bubble Bobble" Themed Bartop Arcade
                                      My Gameboy

                                      AndersHPA 1 Reply Last reply Reply Quote 0
                                      • AndersHPA
                                        AndersHP @AndersHP
                                        last edited by

                                        Just saw that in MAME on screenscraper.fr neither Vendetta or Q*Bert shows up via browser. These were definitely there last time I scraped - how come these games suddenly goes missing?

                                        My "Bubble Bobble" Themed Bartop Arcade
                                        My Gameboy

                                        mituM 1 Reply Last reply Reply Quote 0
                                        • mituM
                                          mitu Global Moderator @AndersHP
                                          last edited by mitu

                                          @andershp They're somewhere on the site, they're not missing

                                          • Q*Bert - https://screenscraper.fr/gameinfos.php?gameid=42584&action=onglet&zone=gameinfosmedias
                                          • Vendetta - https://screenscraper.fr/gameinfos.php?gameid=43932&action=onglet&zone=gameinfosmedias
                                          1 Reply Last reply Reply Quote 1
                                          • screechS
                                            screech
                                            last edited by

                                            There is some work to do on Arcade Game (it's not finished yet ;) there is so much...)

                                            But I just create a New "system" : Gottlieb we haven't.
                                            So now their is 20 new games referenced and sorted nicely (like Q*Bert and Krull ;)
                                            I check the other game and some roms were orphean so I attach them to the good game ;)

                                            normally it's ok now...

                                            (I still have to clean the DB and add stuff, but there is at least some info on media on each game in your list ;) )

                                            Let me know if it's ok ;)

                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.