RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 737.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      bunman
      last edited by

      Neo Geo Pocket and Color. There is a very good possibility it's just me! I'll check over my settings again. Thanks for getting back to me though.

      1 Reply Last reply Reply Quote 0
      • B
        bunman
        last edited by

        I started UXS from a scratch installation and it works perfectly. I did say it was probably me! I'm just wondering if I didn't reset the profile when I went from scraping for RetroPie to Recalbox?! Should have just stuck to one OS for both Pis ;O) Anyway, thanks again for UXS.

        1 Reply Last reply Reply Quote 0
        • screechS
          screech
          last edited by

          Normally you can swap from retropie to Recalbox easily, just change your profil ;)

          C mattrixkM 2 Replies Last reply Reply Quote 0
          • C
            Concat @screech
            last edited by Concat

            @screech
            Hey, for roms without a match, can I just send you the missing .txt file for each system after the scrape?

            I created an account on screenscraper.fr, but I can't find a way of submitting these. All I found was info on how to update Roms and Games that already exist on the site. If it makes your life easier, I can follow the website's process. Looks like I get extra threads this way too...

            Oh and if I haven't said it already, great tool. Thank you!

            1 Reply Last reply Reply Quote 0
            • B
              bunman
              last edited by

              I'm having problems when I try to scrape just a 2D box image. I select 'Box 2D' for the default picture setting and 'Screenshot' for the alternative picture setting, but I'm mostly only get screenshots. I know there are box images as they appeared when I used the Mix profile. I'm using the Recalbox V4 profile if that makes any difference. Some systems come up with no boxarts at all, like the Lynx, then some, like 32X get most as boxarts, but 6 or 7 as screenshots. But if I used the mix profile, all the 32X pictures have box and screenshot, so the boxarts must be available?!

              1 Reply Last reply Reply Quote 0
              • mattrixkM
                mattrixk @screech
                last edited by

                @screech: I'm having a similar problem to @bunman. When using the default "RetroPie" Scrape Profile, I have 5 snes roms and when I try to scrape box art, not all of them find it, even though the box art shows up when using the Standard (3img) Mix Profile on the same roms.

                This happens with wheel art as well, except only 2 of the 5 roms scrape wheel art.

                It doesn't matter if it's 2D or 3D box art, or normal/carbon/steel wheels.

                5 games, all scrape screenshots and fanart properly, but only 4 scrape box art and only 2 scrape wheel art.

                It's a tad frustrating because I know the images are there to be scraped, for some reason they just don't want to be.

                My ES themes: MetaPixel | Spare | Io | Indent

                1 Reply Last reply Reply Quote 0
                • screechS
                  screech
                  last edited by

                  Need to check My fallback on signle picture function :S

                  if it's work on MIX it should work on "single"... I'll check that tonight ;)

                  1 Reply Last reply Reply Quote 0
                  • mattrixkM
                    mattrixk
                    last edited by

                    Awesome, thanks @screech. I've managed to make my own Scrape Profile that downloads screenshot, box art, fan art, wheel art and video, appending "-screenshot", "-fanart" etc to the end of the filenames. It also spits out a gamelist.xml that has links to all of them like <screenshot>folder/folder/folder/aladdin-screenshot.jpg</screenshot>. It's great.

                    I do have another question though: is it possible to scrape different size images in the same scrape profile? At the top of the XML are the lines:

                    <Target_Image_Width>640</Target_Image_Width>
                    <Target_Image_Height>480</Target_Image_Height>
                    

                    This downloads every image at the same size. Is it possible to download the screenshot at 640x480, but download the fanart at 1280x720? Or do I have to do that in 2 separate Scrape Profiles?

                    My ES themes: MetaPixel | Spare | Io | Indent

                    1 Reply Last reply Reply Quote 0
                    • screechS
                      screech
                      last edited by

                      Humm... Need to modify some part of code ;) but I note that in my todo ;)

                      1 Reply Last reply Reply Quote 2
                      • daeksD
                        daeks
                        last edited by

                        I know it is a bit offtopic, but what would be really nice: Fully translated webpage. Most of the interesting parts are only available in french. (for example the webapi doc). Is there a way to get it translated?

                        mattrixkM 1 Reply Last reply Reply Quote 0
                        • mattrixkM
                          mattrixk @daeks
                          last edited by

                          @daeks: Chrome translate?

                          My ES themes: MetaPixel | Spare | Io | Indent

                          1 Reply Last reply Reply Quote 0
                          • screechS
                            screech
                            last edited by

                            @daeks we are working on translation (but like most French People we aren't so good in foreign language ^^)

                            You can see the % of translation just under the country flag ;) Right now we are at 75% of english tranlsation ^^

                            If you have question on the API part, don't hesitate to Ask. I'll try to answer you in my "bad english" ^^

                            1 Reply Last reply Reply Quote 0
                            • C
                              Concat
                              last edited by

                              Really I just want to know how to submit new roms to the site. heh...

                              1 Reply Last reply Reply Quote 0
                              • screechS
                                screech
                                last edited by

                                you can't directly to the web site...

                                Only Admin can (to avoid pollution ;) )

                                The easy way :

                                If you scrape with UXS, juste send me your missing.txt file ;) I will add it.

                                The little less easy way :

                                Use this software : http://ffulgore.free.fr/site/f-crc/us/download.htm
                                Don't forget to check the CRC and MD5 checkbox.
                                Calculate the file you want.
                                And send me the log file ;) I will add it.

                                For information :

                                There is an "autoassociation" process that associate rom to game. But it's not a 100% match.
                                So sometime Rom are orpheans. And you need to associate them (you can do this directly from the website)

                                For information Bis :

                                We take every rom IF they are comming from a well know source (no single user or particular rom).
                                Ziped if they are the original zip from the source (don't dezipe and rezip a file, it change the HASH checksum)

                                C 1 Reply Last reply Reply Quote 1
                                • C
                                  Concat @screech
                                  last edited by Concat

                                  @screech
                                  Thank you screech! I thought I could submit through the website and I just wasn't having luck looking through all the French instructions :)

                                  Do you have an email address I can send them to? What if I have made my own roms...? Are those not eligible? For example, repacking .bin PS1 games to PBP files.

                                  Another question - how can we submit requests to add or correct games (not roms)? For example, Hot Shots 1 & 2 for PS1 is listed as Everybody's Golf as the US version, but it's actually the European version. Ironically the art there is Hot Shots Golf... I've seen other similar examples but can't remember them now.

                                  1 Reply Last reply Reply Quote 0
                                  • screechS
                                    screech
                                    last edited by screech

                                    you can post a pastebin here ;)
                                    Or send me an email (screech @ free.fr)
                                    Or come to see us on IRC ( https://kiwiirc.com/client/irc.freenode.net/?theme=basic#Screenzone)

                                    To submit correction, it's easy ;) just create an account, log in, go to the game and submit new information ;) (or if it's an information you cannot submit like "duplicate", "bad rom association" leave a comment on the game page ;) )

                                    Don't know if you notice the flag on the upper left corner, you can choose the english one ;) 75% of the webiste is translated in english ;) )

                                    EDIT : And for PBP you can submit them. If you do it from "regular/common" rom it will be good ;)

                                    daeksD 1 Reply Last reply Reply Quote 0
                                    • daeksD
                                      daeks @screech
                                      last edited by

                                      @screech I have also a couple of missing roms, but they are all known by http://datomatic.no-intro.org/ - Do you also need them or will you add the DAT files from them in the future?

                                      1 Reply Last reply Reply Quote 0
                                      • screechS
                                        screech
                                        last edited by

                                        On wich system ? Give me the datomatic link to the dat ;) I will add it ;)

                                        daeksD 1 Reply Last reply Reply Quote 0
                                        • daeksD
                                          daeks @screech
                                          last edited by

                                          @screech I have dropped you a mail :)

                                          1 Reply Last reply Reply Quote 0
                                          • screechS
                                            screech
                                            last edited by screech

                                            Sorry :( don't receive it :S (screech @ free.fr ;) )

                                            Edit : I receiv a Mail from Gmail saying there is a Virus in the file... so I can't even grab it :S)

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.