RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 742.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mituM
      mitu Global Moderator @AndersHP
      last edited by mitu

      @andershp They're somewhere on the site, they're not missing

      • Q*Bert - https://screenscraper.fr/gameinfos.php?gameid=42584&action=onglet&zone=gameinfosmedias
      • Vendetta - https://screenscraper.fr/gameinfos.php?gameid=43932&action=onglet&zone=gameinfosmedias
      1 Reply Last reply Reply Quote 1
      • screechS
        screech
        last edited by

        There is some work to do on Arcade Game (it's not finished yet ;) there is so much...)

        But I just create a New "system" : Gottlieb we haven't.
        So now their is 20 new games referenced and sorted nicely (like Q*Bert and Krull ;)
        I check the other game and some roms were orphean so I attach them to the good game ;)

        normally it's ok now...

        (I still have to clean the DB and add stuff, but there is at least some info on media on each game in your list ;) )

        Let me know if it's ok ;)

        1 Reply Last reply Reply Quote 1
        • AndersHPA
          AndersHP
          last edited by AndersHP

          It looks like it worked, thanks @screech ! But I have another question:
          I rescraped my arcades folder, in the hope that it would just supplement the missing titles, but it scraped EVERY wheelart.png again, but with wheelart.jpg even though I had them already. In my pictures configuration I have chosen png, so why does it do this now?

          Edit: Even with "default" it still scrapes jpg wheelart - these doesn't look as crisp as png's, how do I force png if the png option doesnt make any difference?

          My "Bubble Bobble" Themed Bartop Arcade
          My Gameboy

          1 Reply Last reply Reply Quote 0
          • B
            BlockABoots
            last edited by

            Is there a way to speed this program up it seems super slow!. I have it currently sraping 4000 MAME rom files and it says its going to take 21hrs to complete!!!!

            1 Reply Last reply Reply Quote 0
            • hooperreH
              hooperre
              last edited by

              Hey, @screech . I have an issue with Dreamcast (about a month). It says it is testing the server, but then just goes until it times out. It times out with a message "Unable to allocate memory." Thanks.

              4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

              1 Reply Last reply Reply Quote 0
              • H
                hermit
                last edited by

                could the names of the files used by MESS be added to the database? thank you

                1 Reply Last reply Reply Quote 0
                • M
                  mastersetter
                  last edited by

                  This is a great app, but for some reason, when scraping videos, about 10 out of 50 dont work. They play but have a black screen and no sound, so i have to replace these with ones from mame packs and rename them to add the -video tag, the others work fine but its a bit of a hassle when some of my systems are over 100 roms. Any ideas? My log in is using 6 threads and is quick enough.

                  C 1 Reply Last reply Reply Quote 0
                  • spannernick1S
                    spannernick1
                    last edited by spannernick1

                    Hi Is there any way of changing the names of the images..? I ask because I have a Armiga and it don't have a scraper and it names the covers the name of the rom plus .adf.jpg so the rom name is say 1943.adf.jpg.

                    Its naming them at the moment 1943-image.jpg because I had to pick Retropie,would love this to support it,I can connect to the Armiga by FTP only. so I can transfer them over to the right folder.

                    E 1 Reply Last reply Reply Quote 0
                    • E
                      EctoOne @spannernick1
                      last edited by

                      @spannernick1 There might be if you edit the profile.xml that you're using. But I'm not sure, haven't done it myself. But you could use a different tool to remove the -image part and add the extension. I personally use AntRenamer Portable for such things.

                      1 Reply Last reply Reply Quote 0
                      • C
                        Carcayu @mastersetter
                        last edited by Carcayu

                        @mastersetter this is something that also happened to me. As soon as I converted all videos (mostly are 640x480 at 60hz and I changed it to 320x240 at 30hz to save space) it play all the videos, don't know why if it is because of resolution or codec

                        1 Reply Last reply Reply Quote 0
                        • paffleyP
                          paffley
                          last edited by

                          Hi, is there anyway to scrape video snaps at 320x240 (30hz) from within the scraper?

                          1 Reply Last reply Reply Quote 0
                          • hooperreH
                            hooperre
                            last edited by hooperre

                            Hello all. Is there any way to contribute roms/games to the screenscraper.fr site? I know there are millions of DOS games out there, but there is really no good way to scrape them at this point. Only DOOM works out of my collection. More work for ScummVM, but not all. Retropie uses a .svm file extension and on the site only .scummvm is listed.

                            Found the answer regarding auto-additions in the forum.

                            4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                            1 Reply Last reply Reply Quote 0
                            • paffleyP
                              paffley
                              last edited by

                              does anybody know the settings for handbrake (windows) to resize the scraped videos from 640x480 to 320x240 please?

                              M 1 Reply Last reply Reply Quote 0
                              • M
                                Mick2K @paffley
                                last edited by Mick2K

                                @paffley look at one of the original videos with Mediainfo and then recreate the settings in handbrake and change only the resolution.
                                That's what u would do.

                                1 Reply Last reply Reply Quote 0
                                • paffleyP
                                  paffley
                                  last edited by

                                  Hi @Mick2K yeh ive tried that, the new snap ended up bigger in size for some reason. I'll have to take another look and have a play, I think i'm missing something in the settings but cant fatham out what it is just yet.

                                  M 1 Reply Last reply Reply Quote 0
                                  • M
                                    Mick2K @paffley
                                    last edited by Mick2K

                                    @paffley i made a few tests and with the settings shown on the pictures you can reduce the size by almost 50%. The quality loss is visible but still okay in my eyes.

                                    2018-12-01 21_32_26-Window.png
                                    2018-12-01 21_40_45-Window.png
                                    2018-12-01 21_41_15-Window.png

                                    1 Reply Last reply Reply Quote 0
                                    • paffleyP
                                      paffley
                                      last edited by

                                      Thanks @Mick2K ill have a play with those settings, your a star thanks.

                                      1 Reply Last reply Reply Quote 0
                                      • hansolo77H
                                        hansolo77
                                        last edited by hansolo77

                                        Has something changed with the scraper or site? I'm trying to scrape NeoGeo, it looks like it picked up all the correct art but the gamelist doesn't include any "Names".


                                        Nevermind, looks like I fixed it. For some reason, the data in the fields for Language got erased, so it wasn't scraping the name and descriptions. All working now!

                                        Who's Scruffy Looking?

                                        1 Reply Last reply Reply Quote 0
                                        • hansolo77H
                                          hansolo77
                                          last edited by

                                          Back again! I don't think the scraper is working right when I'm scraping Dreamcast. I don't have a full set since the place I got mine from were in a mixed format (mostly cdi but some img, nrg, mdf, etc). Since the emulator can only read the cdi format of these, those are the ones I kept. Anyway, when I scrape the system, I get a lot of bad results. MANY games present the boxart of "Sonic Spinball". It even downloaded the videos for that game too. I thought maybe somebody had hacked the screenscraper.fr server, so I looked. Doesn't seem to be the case, as the few games I checked did have the correct box art available. Maybe it matched the wrong checksum? I'm not sure what happened. I'm about to go to bed and let it scrape overnight again. Just thought I'd post it here. Maybe somebody has seen this before or recently and knows whats up?

                                          Example: https://ibb.co/KDcvgsd

                                          Who's Scruffy Looking?

                                          mituM CarnivoreC 2 Replies Last reply Reply Quote 0
                                          • mituM
                                            mitu Global Moderator @hansolo77
                                            last edited by

                                            @hansolo77 I think there's something on the ScreenScraper side right now - a change in the API or something wonky on their search. I'm not sure UXS gets much activity lately, but one of its succesors is skraper.net. Try using Skraper and see if you get better results.

                                            hansolo77H 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.