RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

    Scheduled Pinned Locked Moved Projects and Themes
    scrapescraperuxs
    728 Posts 111 Posters 746.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mattrixkM
      mattrixk @FlyingTomahawk
      last edited by mattrixk

      @flyingtomahawk said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

      It would be a big pain to go and download each image manually

      You have no idea. I'm currently manually creating MIX images and a gamelist for PSP because nothing scrapes it correctly. I have to get all the different images (and data) from numerous sources. It's painstaking.

      Edit: or you might have some idea. You may have gone through this before, I have no way of knowing.

      My ES themes: MetaPixel | Spare | Io | Indent

      1 Reply Last reply Reply Quote 1
      • R
        red2blue
        last edited by

        @screech hey man i submitted about 10 things on screenscraper and they've all been accepted yet i did not receive any new threads ???? I only received 2 from 2 days ago when i submitted one box art photo, but i didnt receive anything from the 10 things i submitted last night... but like i said they are all accepted and i got nothing in return. just that puzzle japan thing pieces

        FlyingTomahawkF 1 Reply Last reply Reply Quote 0
        • FlyingTomahawkF
          FlyingTomahawk @red2blue
          last edited by

          @red2blue

          Join their chat and tell them that you submited some stuff and haven't received any threads.

          R 1 Reply Last reply Reply Quote 0
          • R
            red2blue @FlyingTomahawk
            last edited by

            @flyingtomahawk said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

            Join their chat and tell them that you submited some stuff and haven't received any threads.

            can you give me link for chat?

            FlyingTomahawkF 1 Reply Last reply Reply Quote 0
            • FlyingTomahawkF
              FlyingTomahawk @red2blue
              last edited by FlyingTomahawk

              @red2blue

              On their website, top-left where it says CHAT IRC. Click on it.

              1 Reply Last reply Reply Quote 0
              • hansolo77H
                hansolo77
                last edited by

                Is the server down or having issues? I'm trying to re-scrape my GBA system, as it only currently has 2 videos. I have a complete romset, but after only scraping 2 games the program crashes. I'm not sure what could be causing it, because I've been able to completely scrape this system already to get boxart and screenshots (and metadata). So I'm just using the "Update Art" settings. I've also tried to use the "Create new XML" setting and that causes a program crash too (closing then checking microsoft for a solution to the problem).

                Who's Scruffy Looking?

                1 Reply Last reply Reply Quote 0
                • AndersHPA
                  AndersHP
                  last edited by

                  I just finished scraping my console games (SNES, NES, Megadrive) with success and wanted to scrape Neogeo and MAME, but every image in these categories are 1kB and black..
                  Is there something specific I have to do to scrape NeoGeo and MAME?

                  NeoGeo games are placed in the NeoGeo folder, and are all FBA versions off the 0.2.97.39 Romset, MAME is MAME2003 (0.78 romset)...

                  My "Bubble Bobble" Themed Bartop Arcade
                  My Gameboy

                  1 Reply Last reply Reply Quote 0
                  • mattrixkM
                    mattrixk
                    last edited by

                    screenscraper.fr is down at the moment. It was working fine last night.

                    My ES themes: MetaPixel | Spare | Io | Indent

                    mattrixkM 1 Reply Last reply Reply Quote 0
                    • mattrixkM
                      mattrixk @mattrixk
                      last edited by

                      Oop, back now.

                      My ES themes: MetaPixel | Spare | Io | Indent

                      AndersHPA 1 Reply Last reply Reply Quote 0
                      • AndersHPA
                        AndersHP @mattrixk
                        last edited by

                        @mattrixk I'm still getting all 1kB images when scraping for MAME. Is it down again?

                        My "Bubble Bobble" Themed Bartop Arcade
                        My Gameboy

                        mattrixkM 1 Reply Last reply Reply Quote 0
                        • mattrixkM
                          mattrixk @AndersHP
                          last edited by

                          @andershp I'm not scraping at the moment, but I'm having no trouble navigating around the site.

                          My ES themes: MetaPixel | Spare | Io | Indent

                          1 Reply Last reply Reply Quote 0
                          • R
                            red2blue
                            last edited by

                            k that IRC is completely dead never got a response.

                            1 Reply Last reply Reply Quote 0
                            • AndersHPA
                              AndersHP
                              last edited by

                              I scraped NES games perfectly well but NeoGeo and MAME 1 minute later gives no results.

                              My "Bubble Bobble" Themed Bartop Arcade
                              My Gameboy

                              1 Reply Last reply Reply Quote 0
                              • hooperreH
                                hooperre
                                last edited by hooperre

                                Are threads directly linked to how many things I can include in a mix profile?

                                4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                1 Reply Last reply Reply Quote 0
                                • hooperreH
                                  hooperre
                                  last edited by hooperre

                                  1_1502035312464_Legend of Zelda, The (U) (PRG1) [!]-image.png 0_1502035312461_Bible Adventures (U) (V1.3)-image.png
                                  3_1502035358317_WWF WrestleMania 2000 (U) [!]-image.png 2_1502035358316_Legend of Zelda, The - Majora's Mask (U) [!]-image.png 1_1502035358316_Donkey Kong 64 (U) [!]-image.png 0_1502035358316_All-Star Baseball 2001 (USA)-image.png

                                  @screech I custom made these, but I think it would be pretty cool if this was an option automatically somehow! Or if there were carts that defaulted to this setting.

                                  4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                  1 Reply Last reply Reply Quote 0
                                  • hansolo77H
                                    hansolo77
                                    last edited by hansolo77

                                    I don't think @screech follows his own thread anymore. So this actually goes out to everybody.

                                    What is the best way to scrape MAME so I can have correct metadata? I've tried NOT scraping, and the built in metadata "works" but there's no artwork for it. If I use UXS, all I get is a big gamelist with multiple entries for different roms. Meaning, there are 3 entries of 1942, even though there are 3 different rom variants (1942, 1942a, 1942b). It's very annoying just seeing my gamelist having the same game listed 3 times, but each one pointing to a different file. Is there no way to have UXS generate a gamelist that distinguishes these? I've already tried all the different naming options Gamename, Gamename + Options, Gamename + Filename tag, Filename (without ext) They all generate the same list.

                                    Does Sseph's working better for MAME? Can it do video's yet? If so, can I tell it where to save them? I don't want them on the SD card but on my hard drive.

                                    Who's Scruffy Looking?

                                    1 Reply Last reply Reply Quote 0
                                    • screechS
                                      screech
                                      last edited by

                                      Sorry ;) I'm Back.. (3 weeks Off the net ;) )

                                      I'll will try to repost a globale answer to everyone in the morning ;)

                                      AndersHPA 1 Reply Last reply Reply Quote 1
                                      • AndersHPA
                                        AndersHP @screech
                                        last edited by

                                        @screech my scraping of MAME problem has disappeared after a clean install of UXMLS.

                                        My "Bubble Bobble" Themed Bartop Arcade
                                        My Gameboy

                                        1 Reply Last reply Reply Quote 0
                                        • screechS
                                          screech
                                          last edited by

                                          So, here we go ;)

                                          Answer time ^^

                                          @Panther7 : Yes, if your SSH Id aren't the "default one", you need to config them in the appropriate menu. For the marquee, look at the "option", you can select what you want (Screen, Marquee, Video)
                                          @Jste84 : normally yes ;) in general config, you have a scrape option : "Full / Update / Image only"
                                          @UDb23 and @hansolo77 : downloading picture directly from the website is possible, but not the best way to do it ;) the API (or scrape tools) are done for that ;)
                                          @FlyingTomahawk and @mattrixk : Strange, normally, if you create a Mix with only the screenshot (for exemple) and put the Maximize flag correctly, it will enlarge (or reduce) the screenshot to the size asked... ( WIKI )
                                          @red2blue : I saw you are a "financial contributor" have you got the "extra" thread ?
                                          @everyone : Sorry for the down time :S
                                          @hooperre : Things in MIX and thread are not linked ;) Thread mean : how many rom you can scrape at the same time. 1 scrape can mean a MIX with 20 elements in it if you want ;)
                                          For your screen, what did you "custom" made ? a 4img Mix in photoshop because Picture are missing in the DB ? If it's the case, the easiest way is to add the missing to the DB ;) you will gain extra thread an participate to the comunity datas. And the best part, the mix will be done automatically at your next scrape ;)
                                          @hansolo77 For mame, we have a big job to clean them all and to add "clone" information. But in your precise case, what do you want as title ?
                                          1942, 1942a and 1942b are exactly the same game (clone) with "minor" differences. But the only "real" name for these 3 games is "1942" so if you have 3 roms cloned for this game and chose "Gamename", guess what ? you have 3 times "1942" in your gamelist ^^ it's normal. now you can choose "filename" so you will have each game with a different name (but a not so good name ;)
                                          At least, the best way is to go to Screenscraper web site, and go to Mame Rom (not game, rom) and flag each clone as ... a clone ;) (you can event specify what type of clone) so when you scrape you can choose "Gamename+Options" and choose "clone" in option...
                                          @AndersHP Nice ;) I think Marblemad make some correction to the API recently so maybe it help ;)

                                          hooperreH 1 Reply Last reply Reply Quote 0
                                          • hooperreH
                                            hooperre @screech
                                            last edited by

                                            @screech The cartridge colors match the originals. For example, Wretlemania 2000 was always a black cart (I think), never a grey one. Same for Donkey Kong 64 being yellow (I think). But, when the program scrapes it will pull a grey cartridge always. IIRC, LOZ Ocarina of Time for example, came in gray and gold carts.

                                            Would be cool if you had the option to change the color of the cartridge. I realize that y'all are working on a lot right now outside of aesthetic stuff like that, but it was just a suggestion I thought would add some more pizazz and realism to the MIX files.

                                            4B ~ RPi PSU 5.1V / 3.0A ~ 32GB SanDisk microSD ~ 128GB USB

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.