[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture

AndersHP

@screech my scraping of MAME problem has disappeared after a clean install of UXMLS.

screech

So, here we go ;)

Answer time ^^

@Panther7 : Yes, if your SSH Id aren't the "default one", you need to config them in the appropriate menu. For the marquee, look at the "option", you can select what you want (Screen, Marquee, Video)
@Jste84 : normally yes ;) in general config, you have a scrape option : "Full / Update / Image only"
@UDb23 and @hansolo77 : downloading picture directly from the website is possible, but not the best way to do it ;) the API (or scrape tools) are done for that ;)
@FlyingTomahawk and @mattrixk : Strange, normally, if you create a Mix with only the screenshot (for exemple) and put the Maximize flag correctly, it will enlarge (or reduce) the screenshot to the size asked... ( WIKI )
@red2blue : I saw you are a "financial contributor" have you got the "extra" thread ?
@everyone : Sorry for the down time :S
@hooperre : Things in MIX and thread are not linked ;) Thread mean : how many rom you can scrape at the same time. 1 scrape can mean a MIX with 20 elements in it if you want ;)
For your screen, what did you "custom" made ? a 4img Mix in photoshop because Picture are missing in the DB ? If it's the case, the easiest way is to add the missing to the DB ;) you will gain extra thread an participate to the comunity datas. And the best part, the mix will be done automatically at your next scrape ;)
@hansolo77 For mame, we have a big job to clean them all and to add "clone" information. But in your precise case, what do you want as title ?
1942, 1942a and 1942b are exactly the same game (clone) with "minor" differences. But the only "real" name for these 3 games is "1942" so if you have 3 roms cloned for this game and chose "Gamename", guess what ? you have 3 times "1942" in your gamelist ^^ it's normal. now you can choose "filename" so you will have each game with a different name (but a not so good name ;)
At least, the best way is to go to Screenscraper web site, and go to Mame Rom (not game, rom) and flag each clone as ... a clone ;) (you can event specify what type of clone) so when you scrape you can choose "Gamename+Options" and choose "clone" in option...
@AndersHP Nice ;) I think Marblemad make some correction to the API recently so maybe it help ;)

hooperre

@screech The cartridge colors match the originals. For example, Wretlemania 2000 was always a black cart (I think), never a grey one. Same for Donkey Kong 64 being yellow (I think). But, when the program scrapes it will pull a grey cartridge always. IIRC, LOZ Ocarina of Time for example, came in gray and gold carts.

Would be cool if you had the option to change the color of the cartridge. I realize that y'all are working on a lot right now outside of aesthetic stuff like that, but it was just a suggestion I thought would add some more pizazz and realism to the MIX files.

screech

@hooperre So sad ^^ it's already possible (technically) directly on the web site (https://www.screenscraper.fr)
As an Admin of the website I can "modify" the color support.

Look here : https://www.screenscraper.fr/systemeinfos.php?plateforme=3&alpha=0&numpage=0

At the end of the page you will have "2D Support" and a lot's of different format/color... But no gold or blue one...
We need to "create" them, add them to the system possible carts, and "recheck" every game for matching the color ^^
A uge work to do... (and sources needed to have the good format/color matching country release. And I don't speak about multiple release ;) )
Actually the aim is to have a "uniform" scrape (a lot's of person think it's better to have "uniformity" than "historical reallity" in the scrape even if we try to be the most acurate).

Cartridge are automatically generated from the Label actually (with the "default" support)... and we have to modify each one after that :X

Maybe in future we can offer the possibility to contributor to modify this sort of detail ;) but it's not for now ^^ till so much work to do on the DB ;)

screech

@hooperre Just talk about it with the ScreenScraper Bigboss ;)

-> you can submit new 2D Support model directly in the "System"
-> You just have to leave a comment on the game you want to use this new model.

Exemple :
You can take the "Gray" Support, modify it with photoshop (or gimp or what you want) to give it a "golden" aspect.
Submit it in NES System
And finally post a comment on the Legend of Zelda Game asking to change the support to the golden one.
(And a moderator like me can validate it to make that)...

So it's up to you : doing it "manually" for each game only for you ;) or working for the comunity and add them directly to the DB so your scrape (and the others scrape) will be perfect ^^

hooperre

@screech Nice! I've done a lot of stuff for myself, but I've been trying to give back to the community lately. So I can see what I can do! I'd love to help. It's an awesome service and website! Good work!

screech

@hooperre

MarbleMad as just tested on The Legend of Zelda : https://www.screenscraper.fr/gameinfos.php?plateforme=3&gameid=1250

alt text

So if you rescrape this game ;) it will be with the new cartdridge color ;)

hooperre

It's beautiful :')

I'm sure everyone is DYING to get their blue copy of Bible Adventures! I'll be working away tomorrow!

alt text

I can try to add this guy too. I think the actual cartridge was a bit bigger, but that will mess up the whole label texture template and size.

Cybermen

Hello, I noticed that the Scrapper does not represent the 3D cover in all of my Roms. Only the gameplay and the logo are displayed. Am I doing something wrong? I have seen the covers but are stored with screenscrapper.fr, the filenames I have changed as they are stored in screenscrapper.fr. Can someone help me or has the same problem?

hooperre

@cybermen said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:

Hello, I noticed that the Scrapper does not represent the 3D cover in all of my Roms. Only the gameplay and the logo are displayed. Am I doing something wrong? I have seen the covers but are stored with screenscrapper.fr, the filenames I have changed as they are stored in screenscrapper.fr. Can someone help me or has the same problem?

The box art for those haven't been added to the database yet. It's still growing.

Cybermen

Ah okay understood. Then they have been uploaded, but have not been checked and loaded into the database?

screech

@Cybermen Have you some exemple I can check ?
@hooperre Just for information ;) I'm working on EA Game on Megadrive/Genesis :
New format of support Added :
alt text

Cybermen

The Game 'Z' for playstation. The Scrapper dont scrap the 3D Art

screech

The Z game for PSX only have the European Cover... (for now)
So if your Iso/bin/pbp/or what else is a US one it's normal...

But our Big boss is on a "Bot" to fill the PSX Data ;) so PSX will have a nice DB soon ;)

hooperre

@screech Looks beautiful! We spontaneously adopted a dog over the weekend so I've been too busy to work on them. :\

HAILtoSTARSCREAM

Using simple visual style, I have set default visual as 2d cover, alt visual as screenshot and videos enabled. I scraped a lot games and my problem is, for games when UXS downloaded a screenshot it writes the image in a different line in xms than the standard images (it creates an empty line for the standard images, and a second image line under it for the screenshot). I use the Mini NES Theme and it does not recognize those images (in fact none of my themes do). Is there a way to fix this, to make UXS use the standard line for alt visuals?

Edit:

It looks like this:

<image/>

<image>./images/X-Men (USA) (Proto)-image.jpg</image>

When it should look like this:

<image>./images/X-Men (USA) (Proto)-image.jpg</image>

Edit 2:

deleted the lines with <image/> and now alle the images work. did this for all my systems. Still an issue imo.

hooperre

@screech The positive part about a hurricane is I was able to finish up some of the n64 carts. I submitted them this morning. Do I have to wait until they are accepted to request certain games use them? I see the EA genesis/megadrive suggestions I made were done. They look wonderful... particularly Crue Ball :).

hooperre

Appears the changes have been accepted. Marblemad denied my changes oddly, but appears to have rendered his own. Looks like they should be live! Rescrape your N64 games! :)

screech

@HAILtoSTARSCREAM I'm aware of this issue :( but haven't the time to correct it (and don't know for the moment, why it duplicate the <image> tag :(
(Temporary solution : Replace "<image/>" by "" in a text editor sorry for that)

@hooperre Yes ;) Marblemad tell me that someone send N64 support to validation. But he isn't satisfyed by the final render (no offence, Marblemad can be very "pernickety" on some detail ;) (he wasen't even satisfyed by is own support... something about the left tiny hole in the cartridge ^^) So he created a lot's of new stuff,

On Megadrive :
EA
Grey Australian
Accolade
Sonic & Knuckles with insert
Codemaster
Codemaster with Jcart
Grey special virtua racing
Black special virtua racing
So normally we are good on "special support" for megadrive.
And Every game normally have been modified (if you found one who haven't send a comment ;) )

We also have work a lot's on MD system.
Lot's of new media for every country (a lot's of Bresilian, Corean, Australian media...)
So now if you scrape a bresilian version of rom, you will have the bresilian 3D/2D box and bresilian cardridge for exemple.
If you want you can even force it in UXS (General config, just delete the %COUNTRY% tag and put BR in first ;) )
Lot's of Media and info on Hack/Proto/translation Added too.

MarbleMad Also work on N64 Support :
Blue
Gold
Yellow
Black
Red
Green
Now we need to pass through each N64 game to change the support color ^^

hooperre

@screech From what I saw he nailed a lot of the big ones! I'll try to do a more exhaustive look later. The sonic and knuckles looks great! Haha I built my colored carts based on the default grey one and didn't change the resolution at all, so I was surprised to see they got denied. But I'm not at all offended haha.

For some reason with the newest UXS I'm unable to get the MIX to work properly. I'm just scraping a single box. Happens with all different MIX profiles. Any thought as to why?