RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 764.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • hooperreH
      hooperre
      last edited by

      Hey, @screech . I have an issue with Dreamcast (about a month). It says it is testing the server, but then just goes until it times out. It times out with a message "Unable to allocate memory." Thanks.

      4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

      1 Reply Last reply Reply Quote 0
      • H
        hermit
        last edited by

        could the names of the files used by MESS be added to the database? thank you

        1 Reply Last reply Reply Quote 0
        • M
          mastersetter
          last edited by

          This is a great app, but for some reason, when scraping videos, about 10 out of 50 dont work. They play but have a black screen and no sound, so i have to replace these with ones from mame packs and rename them to add the -video tag, the others work fine but its a bit of a hassle when some of my systems are over 100 roms. Any ideas? My log in is using 6 threads and is quick enough.

          C 1 Reply Last reply Reply Quote 0
          • spannernick1S
            spannernick1
            last edited by spannernick1

            Hi Is there any way of changing the names of the images..? I ask because I have a Armiga and it don't have a scraper and it names the covers the name of the rom plus .adf.jpg so the rom name is say 1943.adf.jpg.

            Its naming them at the moment 1943-image.jpg because I had to pick Retropie,would love this to support it,I can connect to the Armiga by FTP only. so I can transfer them over to the right folder.

            E 1 Reply Last reply Reply Quote 0
            • E
              EctoOne @spannernick1
              last edited by

              @spannernick1 There might be if you edit the profile.xml that you're using. But I'm not sure, haven't done it myself. But you could use a different tool to remove the -image part and add the extension. I personally use AntRenamer Portable for such things.

              1 Reply Last reply Reply Quote 0
              • C
                Carcayu @mastersetter
                last edited by Carcayu

                @mastersetter this is something that also happened to me. As soon as I converted all videos (mostly are 640x480 at 60hz and I changed it to 320x240 at 30hz to save space) it play all the videos, don't know why if it is because of resolution or codec

                1 Reply Last reply Reply Quote 0
                • paffleyP
                  paffley
                  last edited by

                  Hi, is there anyway to scrape video snaps at 320x240 (30hz) from within the scraper?

                  1 Reply Last reply Reply Quote 0
                  • hooperreH
                    hooperre
                    last edited by hooperre

                    Hello all. Is there any way to contribute roms/games to the screenscraper.fr site? I know there are millions of DOS games out there, but there is really no good way to scrape them at this point. Only DOOM works out of my collection. More work for ScummVM, but not all. Retropie uses a .svm file extension and on the site only .scummvm is listed.

                    Found the answer regarding auto-additions in the forum.

                    4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                    1 Reply Last reply Reply Quote 0
                    • paffleyP
                      paffley
                      last edited by

                      does anybody know the settings for handbrake (windows) to resize the scraped videos from 640x480 to 320x240 please?

                      M 1 Reply Last reply Reply Quote 0
                      • M
                        Mick2K @paffley
                        last edited by Mick2K

                        @paffley look at one of the original videos with Mediainfo and then recreate the settings in handbrake and change only the resolution.
                        That's what u would do.

                        1 Reply Last reply Reply Quote 0
                        • paffleyP
                          paffley
                          last edited by

                          Hi @Mick2K yeh ive tried that, the new snap ended up bigger in size for some reason. I'll have to take another look and have a play, I think i'm missing something in the settings but cant fatham out what it is just yet.

                          M 1 Reply Last reply Reply Quote 0
                          • M
                            Mick2K @paffley
                            last edited by Mick2K

                            @paffley i made a few tests and with the settings shown on the pictures you can reduce the size by almost 50%. The quality loss is visible but still okay in my eyes.

                            2018-12-01 21_32_26-Window.png
                            2018-12-01 21_40_45-Window.png
                            2018-12-01 21_41_15-Window.png

                            1 Reply Last reply Reply Quote 0
                            • paffleyP
                              paffley
                              last edited by

                              Thanks @Mick2K ill have a play with those settings, your a star thanks.

                              1 Reply Last reply Reply Quote 0
                              • hansolo77H
                                hansolo77
                                last edited by hansolo77

                                Has something changed with the scraper or site? I'm trying to scrape NeoGeo, it looks like it picked up all the correct art but the gamelist doesn't include any "Names".


                                Nevermind, looks like I fixed it. For some reason, the data in the fields for Language got erased, so it wasn't scraping the name and descriptions. All working now!

                                Who's Scruffy Looking?

                                1 Reply Last reply Reply Quote 0
                                • hansolo77H
                                  hansolo77
                                  last edited by

                                  Back again! I don't think the scraper is working right when I'm scraping Dreamcast. I don't have a full set since the place I got mine from were in a mixed format (mostly cdi but some img, nrg, mdf, etc). Since the emulator can only read the cdi format of these, those are the ones I kept. Anyway, when I scrape the system, I get a lot of bad results. MANY games present the boxart of "Sonic Spinball". It even downloaded the videos for that game too. I thought maybe somebody had hacked the screenscraper.fr server, so I looked. Doesn't seem to be the case, as the few games I checked did have the correct box art available. Maybe it matched the wrong checksum? I'm not sure what happened. I'm about to go to bed and let it scrape overnight again. Just thought I'd post it here. Maybe somebody has seen this before or recently and knows whats up?

                                  Example: https://ibb.co/KDcvgsd

                                  Who's Scruffy Looking?

                                  mituM CarnivoreC 2 Replies Last reply Reply Quote 0
                                  • mituM
                                    mitu Global Moderator @hansolo77
                                    last edited by

                                    @hansolo77 I think there's something on the ScreenScraper side right now - a change in the API or something wonky on their search. I'm not sure UXS gets much activity lately, but one of its succesors is skraper.net. Try using Skraper and see if you get better results.

                                    hansolo77H 1 Reply Last reply Reply Quote 0
                                    • hansolo77H
                                      hansolo77 @mitu
                                      last edited by

                                      @mitu Thanks I'll give it a try. What's the worst that could happen?

                                      Who's Scruffy Looking?

                                      1 Reply Last reply Reply Quote 0
                                      • CarnivoreC
                                        Carnivore @hansolo77
                                        last edited by

                                        @hansolo77 I don't think the Universal XML Scraper makes it possible to scrape Dreamcast images. I don't see the Dreamcast in program's platform list.

                                        1 Reply Last reply Reply Quote 0
                                        • hooperreH
                                          hooperre
                                          last edited by

                                          @screech Sorry to res thread, but doesn't deserve it's own topic. Any reason why <Item Type="SystemWheel"> would no longer be scraping on arcade / MAME files?

                                          4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                          1 Reply Last reply Reply Quote 0
                                          • A
                                            aurunmilla
                                            last edited by

                                            Hi, cery strange issue..
                                            I can't scrape anymore samsho4.
                                            Every time i try to scrape it the program crash.
                                            I scraped with mame, neo geo, but always the same result.
                                            I'm on newer version of uxs..
                                            This appen with only this rom, for now..

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.