RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 746.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mattrixkM
      mattrixk @mattrixk
      last edited by

      Oop, back now.

      My ES themes: MetaPixel | Spare | Io | Indent

      AndersHPA 1 Reply Last reply Reply Quote 0
      • AndersHPA
        AndersHP @mattrixk
        last edited by

        @mattrixk I'm still getting all 1kB images when scraping for MAME. Is it down again?

        My "Bubble Bobble" Themed Bartop Arcade
        My Gameboy

        mattrixkM 1 Reply Last reply Reply Quote 0
        • mattrixkM
          mattrixk @AndersHP
          last edited by

          @andershp I'm not scraping at the moment, but I'm having no trouble navigating around the site.

          My ES themes: MetaPixel | Spare | Io | Indent

          1 Reply Last reply Reply Quote 0
          • R
            red2blue
            last edited by

            k that IRC is completely dead never got a response.

            1 Reply Last reply Reply Quote 0
            • AndersHPA
              AndersHP
              last edited by

              I scraped NES games perfectly well but NeoGeo and MAME 1 minute later gives no results.

              My "Bubble Bobble" Themed Bartop Arcade
              My Gameboy

              1 Reply Last reply Reply Quote 0
              • hooperreH
                hooperre
                last edited by hooperre

                Are threads directly linked to how many things I can include in a mix profile?

                4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                1 Reply Last reply Reply Quote 0
                • hooperreH
                  hooperre
                  last edited by hooperre

                  1_1502035312464_Legend of Zelda, The (U) (PRG1) [!]-image.png 0_1502035312461_Bible Adventures (U) (V1.3)-image.png
                  3_1502035358317_WWF WrestleMania 2000 (U) [!]-image.png 2_1502035358316_Legend of Zelda, The - Majora's Mask (U) [!]-image.png 1_1502035358316_Donkey Kong 64 (U) [!]-image.png 0_1502035358316_All-Star Baseball 2001 (USA)-image.png

                  @screech I custom made these, but I think it would be pretty cool if this was an option automatically somehow! Or if there were carts that defaulted to this setting.

                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                  1 Reply Last reply Reply Quote 0
                  • hansolo77H
                    hansolo77
                    last edited by hansolo77

                    I don't think @screech follows his own thread anymore. So this actually goes out to everybody.

                    What is the best way to scrape MAME so I can have correct metadata? I've tried NOT scraping, and the built in metadata "works" but there's no artwork for it. If I use UXS, all I get is a big gamelist with multiple entries for different roms. Meaning, there are 3 entries of 1942, even though there are 3 different rom variants (1942, 1942a, 1942b). It's very annoying just seeing my gamelist having the same game listed 3 times, but each one pointing to a different file. Is there no way to have UXS generate a gamelist that distinguishes these? I've already tried all the different naming options Gamename, Gamename + Options, Gamename + Filename tag, Filename (without ext) They all generate the same list.

                    Does Sseph's working better for MAME? Can it do video's yet? If so, can I tell it where to save them? I don't want them on the SD card but on my hard drive.

                    Who's Scruffy Looking?

                    1 Reply Last reply Reply Quote 0
                    • screechS
                      screech
                      last edited by

                      Sorry ;) I'm Back.. (3 weeks Off the net ;) )

                      I'll will try to repost a globale answer to everyone in the morning ;)

                      AndersHPA 1 Reply Last reply Reply Quote 1
                      • AndersHPA
                        AndersHP @screech
                        last edited by

                        @screech my scraping of MAME problem has disappeared after a clean install of UXMLS.

                        My "Bubble Bobble" Themed Bartop Arcade
                        My Gameboy

                        1 Reply Last reply Reply Quote 0
                        • screechS
                          screech
                          last edited by

                          So, here we go ;)

                          Answer time ^^

                          @Panther7 : Yes, if your SSH Id aren't the "default one", you need to config them in the appropriate menu. For the marquee, look at the "option", you can select what you want (Screen, Marquee, Video)
                          @Jste84 : normally yes ;) in general config, you have a scrape option : "Full / Update / Image only"
                          @UDb23 and @hansolo77 : downloading picture directly from the website is possible, but not the best way to do it ;) the API (or scrape tools) are done for that ;)
                          @FlyingTomahawk and @mattrixk : Strange, normally, if you create a Mix with only the screenshot (for exemple) and put the Maximize flag correctly, it will enlarge (or reduce) the screenshot to the size asked... ( WIKI )
                          @red2blue : I saw you are a "financial contributor" have you got the "extra" thread ?
                          @everyone : Sorry for the down time :S
                          @hooperre : Things in MIX and thread are not linked ;) Thread mean : how many rom you can scrape at the same time. 1 scrape can mean a MIX with 20 elements in it if you want ;)
                          For your screen, what did you "custom" made ? a 4img Mix in photoshop because Picture are missing in the DB ? If it's the case, the easiest way is to add the missing to the DB ;) you will gain extra thread an participate to the comunity datas. And the best part, the mix will be done automatically at your next scrape ;)
                          @hansolo77 For mame, we have a big job to clean them all and to add "clone" information. But in your precise case, what do you want as title ?
                          1942, 1942a and 1942b are exactly the same game (clone) with "minor" differences. But the only "real" name for these 3 games is "1942" so if you have 3 roms cloned for this game and chose "Gamename", guess what ? you have 3 times "1942" in your gamelist ^^ it's normal. now you can choose "filename" so you will have each game with a different name (but a not so good name ;)
                          At least, the best way is to go to Screenscraper web site, and go to Mame Rom (not game, rom) and flag each clone as ... a clone ;) (you can event specify what type of clone) so when you scrape you can choose "Gamename+Options" and choose "clone" in option...
                          @AndersHP Nice ;) I think Marblemad make some correction to the API recently so maybe it help ;)

                          hooperreH 1 Reply Last reply Reply Quote 0
                          • hooperreH
                            hooperre @screech
                            last edited by

                            @screech The cartridge colors match the originals. For example, Wretlemania 2000 was always a black cart (I think), never a grey one. Same for Donkey Kong 64 being yellow (I think). But, when the program scrapes it will pull a grey cartridge always. IIRC, LOZ Ocarina of Time for example, came in gray and gold carts.

                            Would be cool if you had the option to change the color of the cartridge. I realize that y'all are working on a lot right now outside of aesthetic stuff like that, but it was just a suggestion I thought would add some more pizazz and realism to the MIX files.

                            4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                            1 Reply Last reply Reply Quote 0
                            • screechS
                              screech
                              last edited by

                              @hooperre So sad ^^ it's already possible (technically) directly on the web site (https://www.screenscraper.fr)
                              As an Admin of the website I can "modify" the color support.

                              Look here : https://www.screenscraper.fr/systemeinfos.php?plateforme=3&alpha=0&numpage=0

                              At the end of the page you will have "2D Support" and a lot's of different format/color... But no gold or blue one...
                              We need to "create" them, add them to the system possible carts, and "recheck" every game for matching the color ^^
                              A uge work to do... (and sources needed to have the good format/color matching country release. And I don't speak about multiple release ;) )
                              Actually the aim is to have a "uniform" scrape (a lot's of person think it's better to have "uniformity" than "historical reallity" in the scrape even if we try to be the most acurate).

                              Cartridge are automatically generated from the Label actually (with the "default" support)... and we have to modify each one after that :X

                              Maybe in future we can offer the possibility to contributor to modify this sort of detail ;) but it's not for now ^^ till so much work to do on the DB ;)

                              1 Reply Last reply Reply Quote 0
                              • screechS
                                screech
                                last edited by

                                @hooperre Just talk about it with the ScreenScraper Bigboss ;)

                                -> you can submit new 2D Support model directly in the "System"
                                -> You just have to leave a comment on the game you want to use this new model.

                                Exemple :
                                You can take the "Gray" Support, modify it with photoshop (or gimp or what you want) to give it a "golden" aspect.
                                Submit it in NES System
                                And finally post a comment on the Legend of Zelda Game asking to change the support to the golden one.
                                (And a moderator like me can validate it to make that)...

                                So it's up to you : doing it "manually" for each game only for you ;) or working for the comunity and add them directly to the DB so your scrape (and the others scrape) will be perfect ^^

                                1 Reply Last reply Reply Quote 1
                                • hooperreH
                                  hooperre
                                  last edited by

                                  @screech Nice! I've done a lot of stuff for myself, but I've been trying to give back to the community lately. So I can see what I can do! I'd love to help. It's an awesome service and website! Good work!

                                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                  1 Reply Last reply Reply Quote 0
                                  • screechS
                                    screech
                                    last edited by

                                    @hooperre

                                    MarbleMad as just tested on The Legend of Zelda : https://www.screenscraper.fr/gameinfos.php?plateforme=3&gameid=1250

                                    alt text

                                    So if you rescrape this game ;) it will be with the new cartdridge color ;)

                                    1 Reply Last reply Reply Quote 2
                                    • hooperreH
                                      hooperre
                                      last edited by hooperre

                                      It's beautiful :')

                                      I'm sure everyone is DYING to get their blue copy of Bible Adventures! I'll be working away tomorrow!

                                      alt text
                                      alt text

                                      I can try to add this guy too. I think the actual cartridge was a bit bigger, but that will mess up the whole label texture template and size.

                                      4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                      1 Reply Last reply Reply Quote 0
                                      • CybermenC
                                        Cybermen
                                        last edited by

                                        Hello, I noticed that the Scrapper does not represent the 3D cover in all of my Roms. Only the gameplay and the logo are displayed. Am I doing something wrong? I have seen the covers but are stored with screenscrapper.fr, the filenames I have changed as they are stored in screenscrapper.fr. Can someone help me or has the same problem?

                                        hooperreH 1 Reply Last reply Reply Quote 0
                                        • hooperreH
                                          hooperre @Cybermen
                                          last edited by

                                          @cybermen said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

                                          Hello, I noticed that the Scrapper does not represent the 3D cover in all of my Roms. Only the gameplay and the logo are displayed. Am I doing something wrong? I have seen the covers but are stored with screenscrapper.fr, the filenames I have changed as they are stored in screenscrapper.fr. Can someone help me or has the same problem?

                                          The box art for those haven't been added to the database yet. It's still growing.

                                          4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                          1 Reply Last reply Reply Quote 0
                                          • CybermenC
                                            Cybermen
                                            last edited by

                                            Ah okay understood. Then they have been uploaded, but have not been checked and loaded into the database?

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.