[SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture
-
Oop, back now.
-
@mattrixk I'm still getting all 1kB images when scraping for MAME. Is it down again?
-
@andershp I'm not scraping at the moment, but I'm having no trouble navigating around the site.
-
k that IRC is completely dead never got a response.
-
I scraped NES games perfectly well but NeoGeo and MAME 1 minute later gives no results.
-
Are threads directly linked to how many things I can include in a mix profile?
-
@screech I custom made these, but I think it would be pretty cool if this was an option automatically somehow! Or if there were carts that defaulted to this setting.
-
I don't think @screech follows his own thread anymore. So this actually goes out to everybody.
What is the best way to scrape MAME so I can have correct metadata? I've tried NOT scraping, and the built in metadata "works" but there's no artwork for it. If I use UXS, all I get is a big gamelist with multiple entries for different roms. Meaning, there are 3 entries of 1942, even though there are 3 different rom variants (1942, 1942a, 1942b). It's very annoying just seeing my gamelist having the same game listed 3 times, but each one pointing to a different file. Is there no way to have UXS generate a gamelist that distinguishes these? I've already tried all the different naming options
Gamename
,Gamename + Options
,Gamename + Filename tag
,Filename (without ext)
They all generate the same list.Does Sseph's working better for MAME? Can it do video's yet? If so, can I tell it where to save them? I don't want them on the SD card but on my hard drive.
-
Sorry ;) I'm Back.. (3 weeks Off the net ;) )
I'll will try to repost a globale answer to everyone in the morning ;)
-
@screech my scraping of MAME problem has disappeared after a clean install of UXMLS.
-
So, here we go ;)
Answer time ^^
@Panther7 : Yes, if your SSH Id aren't the "default one", you need to config them in the appropriate menu. For the marquee, look at the "option", you can select what you want (Screen, Marquee, Video)
@Jste84 : normally yes ;) in general config, you have a scrape option : "Full / Update / Image only"
@UDb23 and @hansolo77 : downloading picture directly from the website is possible, but not the best way to do it ;) the API (or scrape tools) are done for that ;)
@FlyingTomahawk and @mattrixk : Strange, normally, if you create a Mix with only the screenshot (for exemple) and put the Maximize flag correctly, it will enlarge (or reduce) the screenshot to the size asked... ( WIKI )
@red2blue : I saw you are a "financial contributor" have you got the "extra" thread ?
@everyone : Sorry for the down time :S
@hooperre : Things in MIX and thread are not linked ;) Thread mean : how many rom you can scrape at the same time. 1 scrape can mean a MIX with 20 elements in it if you want ;)
For your screen, what did you "custom" made ? a 4img Mix in photoshop because Picture are missing in the DB ? If it's the case, the easiest way is to add the missing to the DB ;) you will gain extra thread an participate to the comunity datas. And the best part, the mix will be done automatically at your next scrape ;)
@hansolo77 For mame, we have a big job to clean them all and to add "clone" information. But in your precise case, what do you want as title ?
1942, 1942a and 1942b are exactly the same game (clone) with "minor" differences. But the only "real" name for these 3 games is "1942" so if you have 3 roms cloned for this game and chose "Gamename", guess what ? you have 3 times "1942" in your gamelist ^^ it's normal. now you can choose "filename" so you will have each game with a different name (but a not so good name ;)
At least, the best way is to go to Screenscraper web site, and go to Mame Rom (not game, rom) and flag each clone as ... a clone ;) (you can event specify what type of clone) so when you scrape you can choose "Gamename+Options" and choose "clone" in option...
@AndersHP Nice ;) I think Marblemad make some correction to the API recently so maybe it help ;) -
@screech The cartridge colors match the originals. For example, Wretlemania 2000 was always a black cart (I think), never a grey one. Same for Donkey Kong 64 being yellow (I think). But, when the program scrapes it will pull a grey cartridge always. IIRC, LOZ Ocarina of Time for example, came in gray and gold carts.
Would be cool if you had the option to change the color of the cartridge. I realize that y'all are working on a lot right now outside of aesthetic stuff like that, but it was just a suggestion I thought would add some more pizazz and realism to the MIX files.
-
@hooperre So sad ^^ it's already possible (technically) directly on the web site (https://www.screenscraper.fr)
As an Admin of the website I can "modify" the color support.Look here : https://www.screenscraper.fr/systemeinfos.php?plateforme=3&alpha=0&numpage=0
At the end of the page you will have "2D Support" and a lot's of different format/color... But no gold or blue one...
We need to "create" them, add them to the system possible carts, and "recheck" every game for matching the color ^^
A uge work to do... (and sources needed to have the good format/color matching country release. And I don't speak about multiple release ;) )
Actually the aim is to have a "uniform" scrape (a lot's of person think it's better to have "uniformity" than "historical reallity" in the scrape even if we try to be the most acurate).Cartridge are automatically generated from the Label actually (with the "default" support)... and we have to modify each one after that :X
Maybe in future we can offer the possibility to contributor to modify this sort of detail ;) but it's not for now ^^ till so much work to do on the DB ;)
-
@hooperre Just talk about it with the ScreenScraper Bigboss ;)
-> you can submit new 2D Support model directly in the "System"
-> You just have to leave a comment on the game you want to use this new model.Exemple :
You can take the "Gray" Support, modify it with photoshop (or gimp or what you want) to give it a "golden" aspect.
Submit it in NES System
And finally post a comment on the Legend of Zelda Game asking to change the support to the golden one.
(And a moderator like me can validate it to make that)...So it's up to you : doing it "manually" for each game only for you ;) or working for the comunity and add them directly to the DB so your scrape (and the others scrape) will be perfect ^^
-
@screech Nice! I've done a lot of stuff for myself, but I've been trying to give back to the community lately. So I can see what I can do! I'd love to help. It's an awesome service and website! Good work!
-
MarbleMad as just tested on The Legend of Zelda : https://www.screenscraper.fr/gameinfos.php?plateforme=3&gameid=1250
So if you rescrape this game ;) it will be with the new cartdridge color ;)
-
It's beautiful :')
I'm sure everyone is DYING to get their blue copy of Bible Adventures! I'll be working away tomorrow!
I can try to add this guy too. I think the actual cartridge was a bit bigger, but that will mess up the whole label texture template and size.
-
Hello, I noticed that the Scrapper does not represent the 3D cover in all of my Roms. Only the gameplay and the logo are displayed. Am I doing something wrong? I have seen the covers but are stored with screenscrapper.fr, the filenames I have changed as they are stored in screenscrapper.fr. Can someone help me or has the same problem?
-
@cybermen said in [SOFT] Universal XML Scraper V2 - Easy Scrape with High Quality picture:
Hello, I noticed that the Scrapper does not represent the 3D cover in all of my Roms. Only the gameplay and the logo are displayed. Am I doing something wrong? I have seen the covers but are stored with screenscrapper.fr, the filenames I have changed as they are stored in screenscrapper.fr. Can someone help me or has the same problem?
The box art for those haven't been added to the database yet. It's still growing.
-
Ah okay understood. Then they have been uploaded, but have not been checked and loaded into the database?
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.