[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

hansolo77

Is the server down or having issues? I'm trying to re-scrape my GBA system, as it only currently has 2 videos. I have a complete romset, but after only scraping 2 games the program crashes. I'm not sure what could be causing it, because I've been able to completely scrape this system already to get boxart and screenshots (and metadata). So I'm just using the "Update Art" settings. I've also tried to use the "Create new XML" setting and that causes a program crash too (closing then checking microsoft for a solution to the problem).

AndersHP

I just finished scraping my console games (SNES, NES, Megadrive) with success and wanted to scrape Neogeo and MAME, but every image in these categories are 1kB and black..
Is there something specific I have to do to scrape NeoGeo and MAME?

NeoGeo games are placed in the NeoGeo folder, and are all FBA versions off the 0.2.97.39 Romset, MAME is MAME2003 (0.78 romset)...

mattrixk

screenscraper.fr is down at the moment. It was working fine last night.

mattrixk

Oop, back now.

AndersHP

@mattrixk I'm still getting all 1kB images when scraping for MAME. Is it down again?

mattrixk

@andershp I'm not scraping at the moment, but I'm having no trouble navigating around the site.

red2blue

k that IRC is completely dead never got a response.

AndersHP

I scraped NES games perfectly well but NeoGeo and MAME 1 minute later gives no results.

hooperre

Are threads directly linked to how many things I can include in a mix profile?

hooperre

1_1502035312464_Legend of Zelda, The (U) (PRG1) [!]-image.png 0_1502035312461_Bible Adventures (U) (V1.3)-image.png
3_1502035358317_WWF WrestleMania 2000 (U) [!]-image.png 2_1502035358316_Legend of Zelda, The - Majora's Mask (U) [!]-image.png 1_1502035358316_Donkey Kong 64 (U) [!]-image.png

@screech I custom made these, but I think it would be pretty cool if this was an option automatically somehow! Or if there were carts that defaulted to this setting.

hansolo77

I don't think @screech follows his own thread anymore. So this actually goes out to everybody.

What is the best way to scrape MAME so I can have correct metadata? I've tried NOT scraping, and the built in metadata "works" but there's no artwork for it. If I use UXS, all I get is a big gamelist with multiple entries for different roms. Meaning, there are 3 entries of 1942, even though there are 3 different rom variants (1942, 1942a, 1942b). It's very annoying just seeing my gamelist having the same game listed 3 times, but each one pointing to a different file. Is there no way to have UXS generate a gamelist that distinguishes these? I've already tried all the different naming options Gamename, Gamename + Options, Gamename + Filename tag, Filename (without ext) They all generate the same list.

Does Sseph's working better for MAME? Can it do video's yet? If so, can I tell it where to save them? I don't want them on the SD card but on my hard drive.

screech

Sorry ;) I'm Back.. (3 weeks Off the net ;) )

I'll will try to repost a globale answer to everyone in the morning ;)

AndersHP

@screech my scraping of MAME problem has disappeared after a clean install of UXMLS.

screech

So, here we go ;)

Answer time ^^

@Panther7 : Yes, if your SSH Id aren't the "default one", you need to config them in the appropriate menu. For the marquee, look at the "option", you can select what you want (Screen, Marquee, Video)
@Jste84 : normally yes ;) in general config, you have a scrape option : "Full / Update / Image only"
@UDb23 and @hansolo77 : downloading picture directly from the website is possible, but not the best way to do it ;) the API (or scrape tools) are done for that ;)
@FlyingTomahawk and @mattrixk : Strange, normally, if you create a Mix with only the screenshot (for exemple) and put the Maximize flag correctly, it will enlarge (or reduce) the screenshot to the size asked... ( WIKI )
@red2blue : I saw you are a "financial contributor" have you got the "extra" thread ?
@everyone : Sorry for the down time :S
@hooperre : Things in MIX and thread are not linked ;) Thread mean : how many rom you can scrape at the same time. 1 scrape can mean a MIX with 20 elements in it if you want ;)
For your screen, what did you "custom" made ? a 4img Mix in photoshop because Picture are missing in the DB ? If it's the case, the easiest way is to add the missing to the DB ;) you will gain extra thread an participate to the comunity datas. And the best part, the mix will be done automatically at your next scrape ;)
@hansolo77 For mame, we have a big job to clean them all and to add "clone" information. But in your precise case, what do you want as title ?
1942, 1942a and 1942b are exactly the same game (clone) with "minor" differences. But the only "real" name for these 3 games is "1942" so if you have 3 roms cloned for this game and chose "Gamename", guess what ? you have 3 times "1942" in your gamelist ^^ it's normal. now you can choose "filename" so you will have each game with a different name (but a not so good name ;)
At least, the best way is to go to Screenscraper web site, and go to Mame Rom (not game, rom) and flag each clone as ... a clone ;) (you can event specify what type of clone) so when you scrape you can choose "Gamename+Options" and choose "clone" in option...
@AndersHP Nice ;) I think Marblemad make some correction to the API recently so maybe it help ;)

hooperre

@screech The cartridge colors match the originals. For example, Wretlemania 2000 was always a black cart (I think), never a grey one. Same for Donkey Kong 64 being yellow (I think). But, when the program scrapes it will pull a grey cartridge always. IIRC, LOZ Ocarina of Time for example, came in gray and gold carts.

Would be cool if you had the option to change the color of the cartridge. I realize that y'all are working on a lot right now outside of aesthetic stuff like that, but it was just a suggestion I thought would add some more pizazz and realism to the MIX files.

screech

@hooperre So sad ^^ it's already possible (technically) directly on the web site (https://www.screenscraper.fr)
As an Admin of the website I can "modify" the color support.

Look here : https://www.screenscraper.fr/systemeinfos.php?plateforme=3&alpha=0&numpage=0

At the end of the page you will have "2D Support" and a lot's of different format/color... But no gold or blue one...
We need to "create" them, add them to the system possible carts, and "recheck" every game for matching the color ^^
A uge work to do... (and sources needed to have the good format/color matching country release. And I don't speak about multiple release ;) )
Actually the aim is to have a "uniform" scrape (a lot's of person think it's better to have "uniformity" than "historical reallity" in the scrape even if we try to be the most acurate).

Cartridge are automatically generated from the Label actually (with the "default" support)... and we have to modify each one after that :X

Maybe in future we can offer the possibility to contributor to modify this sort of detail ;) but it's not for now ^^ till so much work to do on the DB ;)

screech

@hooperre Just talk about it with the ScreenScraper Bigboss ;)

-> you can submit new 2D Support model directly in the "System"
-> You just have to leave a comment on the game you want to use this new model.

Exemple :
You can take the "Gray" Support, modify it with photoshop (or gimp or what you want) to give it a "golden" aspect.
Submit it in NES System
And finally post a comment on the Legend of Zelda Game asking to change the support to the golden one.
(And a moderator like me can validate it to make that)...

So it's up to you : doing it "manually" for each game only for you ;) or working for the comunity and add them directly to the DB so your scrape (and the others scrape) will be perfect ^^

hooperre

@screech Nice! I've done a lot of stuff for myself, but I've been trying to give back to the community lately. So I can see what I can do! I'd love to help. It's an awesome service and website! Good work!