RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 738.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • BiZzAr721B
      BiZzAr721
      last edited by

      Excellent program! Extremely usefull and simple.

      I have been searching for an answer for a question that maybe can be answered here. I have a lot of MS -DOS games that I would like to scrape. I have tried scraping entire folders, renaming files, even creating a blank file with the name & extension shown on ScreenScraper.fe.

      Quite a bit of ms-dos games have screenshot/box/disk art. I was able to get scummVM to scrape by naming the scripts to match exactly, but I can't figure out why it will not work with MS-DOS. I asked over at ScreenScraper.fe forums but they seem to be pretty empty and haven't gotten a response. Is it possible to create custom images from multiple images by having all the images in folders on a pc? It would still be a lot better than what I have been doing, which is editing, resizing and combining each artwork manually. Thank you.

      1 Reply Last reply Reply Quote 0
      • AndersHPA
        AndersHP
        last edited by AndersHP

        I just rescraped my entire arcade catalog, but cannot get UXML V2 to scrape a few selected games: why this issue with even some pretty known titles (and some not)?:

        • Qbert
        • krull
        • ZigZag
        • Vendetta
        • Rainbow Islands

        ..along with a few others. In the final scraping status screen it says 100% found, but it returns 1KB empty images/videos.

        My "Bubble Bobble" Themed Bartop Arcade
        My Gameboy

        AndersHPA 1 Reply Last reply Reply Quote 0
        • AndersHPA
          AndersHP @AndersHP
          last edited by

          Just saw that in MAME on screenscraper.fr neither Vendetta or Q*Bert shows up via browser. These were definitely there last time I scraped - how come these games suddenly goes missing?

          My "Bubble Bobble" Themed Bartop Arcade
          My Gameboy

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @AndersHP
            last edited by mitu

            @andershp They're somewhere on the site, they're not missing

            • Q*Bert - https://screenscraper.fr/gameinfos.php?gameid=42584&action=onglet&zone=gameinfosmedias
            • Vendetta - https://screenscraper.fr/gameinfos.php?gameid=43932&action=onglet&zone=gameinfosmedias
            1 Reply Last reply Reply Quote 1
            • screechS
              screech
              last edited by

              There is some work to do on Arcade Game (it's not finished yet ;) there is so much...)

              But I just create a New "system" : Gottlieb we haven't.
              So now their is 20 new games referenced and sorted nicely (like Q*Bert and Krull ;)
              I check the other game and some roms were orphean so I attach them to the good game ;)

              normally it's ok now...

              (I still have to clean the DB and add stuff, but there is at least some info on media on each game in your list ;) )

              Let me know if it's ok ;)

              1 Reply Last reply Reply Quote 1
              • AndersHPA
                AndersHP
                last edited by AndersHP

                It looks like it worked, thanks @screech ! But I have another question:
                I rescraped my arcades folder, in the hope that it would just supplement the missing titles, but it scraped EVERY wheelart.png again, but with wheelart.jpg even though I had them already. In my pictures configuration I have chosen png, so why does it do this now?

                Edit: Even with "default" it still scrapes jpg wheelart - these doesn't look as crisp as png's, how do I force png if the png option doesnt make any difference?

                My "Bubble Bobble" Themed Bartop Arcade
                My Gameboy

                1 Reply Last reply Reply Quote 0
                • B
                  BlockABoots
                  last edited by

                  Is there a way to speed this program up it seems super slow!. I have it currently sraping 4000 MAME rom files and it says its going to take 21hrs to complete!!!!

                  1 Reply Last reply Reply Quote 0
                  • hooperreH
                    hooperre
                    last edited by

                    Hey, @screech . I have an issue with Dreamcast (about a month). It says it is testing the server, but then just goes until it times out. It times out with a message "Unable to allocate memory." Thanks.

                    4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                    1 Reply Last reply Reply Quote 0
                    • H
                      hermit
                      last edited by

                      could the names of the files used by MESS be added to the database? thank you

                      1 Reply Last reply Reply Quote 0
                      • M
                        mastersetter
                        last edited by

                        This is a great app, but for some reason, when scraping videos, about 10 out of 50 dont work. They play but have a black screen and no sound, so i have to replace these with ones from mame packs and rename them to add the -video tag, the others work fine but its a bit of a hassle when some of my systems are over 100 roms. Any ideas? My log in is using 6 threads and is quick enough.

                        C 1 Reply Last reply Reply Quote 0
                        • spannernick1S
                          spannernick1
                          last edited by spannernick1

                          Hi Is there any way of changing the names of the images..? I ask because I have a Armiga and it don't have a scraper and it names the covers the name of the rom plus .adf.jpg so the rom name is say 1943.adf.jpg.

                          Its naming them at the moment 1943-image.jpg because I had to pick Retropie,would love this to support it,I can connect to the Armiga by FTP only. so I can transfer them over to the right folder.

                          E 1 Reply Last reply Reply Quote 0
                          • E
                            EctoOne @spannernick1
                            last edited by

                            @spannernick1 There might be if you edit the profile.xml that you're using. But I'm not sure, haven't done it myself. But you could use a different tool to remove the -image part and add the extension. I personally use AntRenamer Portable for such things.

                            1 Reply Last reply Reply Quote 0
                            • C
                              Carcayu @mastersetter
                              last edited by Carcayu

                              @mastersetter this is something that also happened to me. As soon as I converted all videos (mostly are 640x480 at 60hz and I changed it to 320x240 at 30hz to save space) it play all the videos, don't know why if it is because of resolution or codec

                              1 Reply Last reply Reply Quote 0
                              • paffleyP
                                paffley
                                last edited by

                                Hi, is there anyway to scrape video snaps at 320x240 (30hz) from within the scraper?

                                1 Reply Last reply Reply Quote 0
                                • hooperreH
                                  hooperre
                                  last edited by hooperre

                                  Hello all. Is there any way to contribute roms/games to the screenscraper.fr site? I know there are millions of DOS games out there, but there is really no good way to scrape them at this point. Only DOOM works out of my collection. More work for ScummVM, but not all. Retropie uses a .svm file extension and on the site only .scummvm is listed.

                                  Found the answer regarding auto-additions in the forum.

                                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                  1 Reply Last reply Reply Quote 0
                                  • paffleyP
                                    paffley
                                    last edited by

                                    does anybody know the settings for handbrake (windows) to resize the scraped videos from 640x480 to 320x240 please?

                                    M 1 Reply Last reply Reply Quote 0
                                    • M
                                      Mick2K @paffley
                                      last edited by Mick2K

                                      @paffley look at one of the original videos with Mediainfo and then recreate the settings in handbrake and change only the resolution.
                                      That's what u would do.

                                      1 Reply Last reply Reply Quote 0
                                      • paffleyP
                                        paffley
                                        last edited by

                                        Hi @Mick2K yeh ive tried that, the new snap ended up bigger in size for some reason. I'll have to take another look and have a play, I think i'm missing something in the settings but cant fatham out what it is just yet.

                                        M 1 Reply Last reply Reply Quote 0
                                        • M
                                          Mick2K @paffley
                                          last edited by Mick2K

                                          @paffley i made a few tests and with the settings shown on the pictures you can reduce the size by almost 50%. The quality loss is visible but still okay in my eyes.

                                          2018-12-01 21_32_26-Window.png
                                          2018-12-01 21_40_45-Window.png
                                          2018-12-01 21_41_15-Window.png

                                          1 Reply Last reply Reply Quote 0
                                          • paffleyP
                                            paffley
                                            last edited by

                                            Thanks @Mick2K ill have a play with those settings, your a star thanks.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.