RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 788.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • hansolo77H
      hansolo77 @Quackwalks
      last edited by

      @quackwalks There is a script here in the forums somewhere that will go through your videos and automatically reencode the ones that need it. I don't remember where I found it or what it's called, but I know it's there. You can probably find it if you look for it. It's really easy to use, and a lifesaver. I had the same problem till I learned that.

      Who's Scruffy Looking?

      QuackwalksQ 1 Reply Last reply Reply Quote 0
      • QuackwalksQ
        Quackwalks @hansolo77
        last edited by

        @hansolo77 It's right here, https://retropie.org.uk/forum/topic/15362/script-batch-convert-yuv-4-4-4-videos-to-yuv-4-2-0-in-retropie-linux. I just finished using it and it worked perfectly.

        1 Reply Last reply Reply Quote 1
        • E
          elahrairah
          last edited by

          So I downloaded video and 3d box with xml scraper for psx and all went well but the gamelist.xml shows the wrong paths to my video art.

          I use on my retropie setup (with external hdd) two seperate folders for images and video:
          Image : folder "boxart
          Video: folder "snap"
          Both these folders are in the system rom folder: /roms/psx
          This is the conventional method almost every retropie user uses.
          But when looking at the paths to the video and art in the gamelist I see they both point to same location which is /retropie/roms/psx/boxart. This means I have to put all the art in the same "boxart" folder, which I do not want.

          So I did try to fix it myself and change the path in configuration to "boxart" location which is the right path for the 3d boxes. But I want the gamelist to also create a seperate path to the video in the gamelist.xml, so it points to my art folder "snap"

          How do I do this?

          Long question in short: how do I change the paths in the gamelist.xml so each type of art is linked to a seperate folder?

          E 1 Reply Last reply Reply Quote 0
          • E
            EctoOne @elahrairah
            last edited by

            @elahrairah there is no way to set differnt paths in the scraper as far as i know. you have to manually edit the video paths in the gamelist.xml. Doing a search/replace should be the easiest method. I suggest to search for <video>OLDPATH/instead of just OLDPATH/ this will prevent that the path to your images will also be changed.

            E 1 Reply Last reply Reply Quote 1
            • E
              elahrairah @EctoOne
              last edited by

              @ectoone don't know if I will go through those lengths but I appreciate your answer, at least now I know it's not possible, so I think I'll just put all art in 1 folder.. No big deal.

              E 1 Reply Last reply Reply Quote 0
              • E
                EctoOne @elahrairah
                last edited by

                @elahrairah with something like notepad++ it is very simple to achieve though. It lets you search/replace in multiple files and what not. I did the same thing for all four media files (boxart, marquee, thumbnail and video) and have them in separate folders now.

                1 Reply Last reply Reply Quote 1
                • hooperreH
                  hooperre
                  last edited by hooperre

                  @screech Is there a way to add a game for PC for example on the screenscraper.fr website? I see Windows 3.1 and stuff.

                  Also, I haven't been able to login from Google Chrome for about a year. I have had to use Microsoft Edge. :\

                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                  1 Reply Last reply Reply Quote 0
                  • BiZzAr721B
                    BiZzAr721
                    last edited by

                    Excellent program! Extremely usefull and simple.

                    I have been searching for an answer for a question that maybe can be answered here. I have a lot of MS -DOS games that I would like to scrape. I have tried scraping entire folders, renaming files, even creating a blank file with the name & extension shown on ScreenScraper.fe.

                    Quite a bit of ms-dos games have screenshot/box/disk art. I was able to get scummVM to scrape by naming the scripts to match exactly, but I can't figure out why it will not work with MS-DOS. I asked over at ScreenScraper.fe forums but they seem to be pretty empty and haven't gotten a response. Is it possible to create custom images from multiple images by having all the images in folders on a pc? It would still be a lot better than what I have been doing, which is editing, resizing and combining each artwork manually. Thank you.

                    1 Reply Last reply Reply Quote 0
                    • AndersHPA
                      AndersHP
                      last edited by AndersHP

                      I just rescraped my entire arcade catalog, but cannot get UXML V2 to scrape a few selected games: why this issue with even some pretty known titles (and some not)?:

                      • Qbert
                      • krull
                      • ZigZag
                      • Vendetta
                      • Rainbow Islands

                      ..along with a few others. In the final scraping status screen it says 100% found, but it returns 1KB empty images/videos.

                      My "Bubble Bobble" Themed Bartop Arcade
                      My Gameboy

                      AndersHPA 1 Reply Last reply Reply Quote 0
                      • AndersHPA
                        AndersHP @AndersHP
                        last edited by

                        Just saw that in MAME on screenscraper.fr neither Vendetta or Q*Bert shows up via browser. These were definitely there last time I scraped - how come these games suddenly goes missing?

                        My "Bubble Bobble" Themed Bartop Arcade
                        My Gameboy

                        mituM 1 Reply Last reply Reply Quote 0
                        • mituM
                          mitu Global Moderator @AndersHP
                          last edited by mitu

                          @andershp They're somewhere on the site, they're not missing

                          • Q*Bert - https://screenscraper.fr/gameinfos.php?gameid=42584&action=onglet&zone=gameinfosmedias
                          • Vendetta - https://screenscraper.fr/gameinfos.php?gameid=43932&action=onglet&zone=gameinfosmedias
                          1 Reply Last reply Reply Quote 1
                          • screechS
                            screech
                            last edited by

                            There is some work to do on Arcade Game (it's not finished yet ;) there is so much...)

                            But I just create a New "system" : Gottlieb we haven't.
                            So now their is 20 new games referenced and sorted nicely (like Q*Bert and Krull ;)
                            I check the other game and some roms were orphean so I attach them to the good game ;)

                            normally it's ok now...

                            (I still have to clean the DB and add stuff, but there is at least some info on media on each game in your list ;) )

                            Let me know if it's ok ;)

                            1 Reply Last reply Reply Quote 1
                            • AndersHPA
                              AndersHP
                              last edited by AndersHP

                              It looks like it worked, thanks @screech ! But I have another question:
                              I rescraped my arcades folder, in the hope that it would just supplement the missing titles, but it scraped EVERY wheelart.png again, but with wheelart.jpg even though I had them already. In my pictures configuration I have chosen png, so why does it do this now?

                              Edit: Even with "default" it still scrapes jpg wheelart - these doesn't look as crisp as png's, how do I force png if the png option doesnt make any difference?

                              My "Bubble Bobble" Themed Bartop Arcade
                              My Gameboy

                              1 Reply Last reply Reply Quote 0
                              • B
                                BlockABoots
                                last edited by

                                Is there a way to speed this program up it seems super slow!. I have it currently sraping 4000 MAME rom files and it says its going to take 21hrs to complete!!!!

                                1 Reply Last reply Reply Quote 0
                                • hooperreH
                                  hooperre
                                  last edited by

                                  Hey, @screech . I have an issue with Dreamcast (about a month). It says it is testing the server, but then just goes until it times out. It times out with a message "Unable to allocate memory." Thanks.

                                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                  1 Reply Last reply Reply Quote 0
                                  • H
                                    hermit
                                    last edited by

                                    could the names of the files used by MESS be added to the database? thank you

                                    1 Reply Last reply Reply Quote 0
                                    • M
                                      mastersetter
                                      last edited by

                                      This is a great app, but for some reason, when scraping videos, about 10 out of 50 dont work. They play but have a black screen and no sound, so i have to replace these with ones from mame packs and rename them to add the -video tag, the others work fine but its a bit of a hassle when some of my systems are over 100 roms. Any ideas? My log in is using 6 threads and is quick enough.

                                      C 1 Reply Last reply Reply Quote 0
                                      • spannernick1S
                                        spannernick1
                                        last edited by spannernick1

                                        Hi Is there any way of changing the names of the images..? I ask because I have a Armiga and it don't have a scraper and it names the covers the name of the rom plus .adf.jpg so the rom name is say 1943.adf.jpg.

                                        Its naming them at the moment 1943-image.jpg because I had to pick Retropie,would love this to support it,I can connect to the Armiga by FTP only. so I can transfer them over to the right folder.

                                        E 1 Reply Last reply Reply Quote 0
                                        • E
                                          EctoOne @spannernick1
                                          last edited by

                                          @spannernick1 There might be if you edit the profile.xml that you're using. But I'm not sure, haven't done it myself. But you could use a different tool to remove the -image part and add the extension. I personally use AntRenamer Portable for such things.

                                          1 Reply Last reply Reply Quote 0
                                          • C
                                            Carcayu @mastersetter
                                            last edited by Carcayu

                                            @mastersetter this is something that also happened to me. As soon as I converted all videos (mostly are 640x480 at 60hz and I changed it to 320x240 at 30hz to save space) it play all the videos, don't know why if it is because of resolution or codec

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.