Scraping MS-DOS games

gordonfreemanjr

@mitu Seriously, man, thanks. You’ve already provided me with ton of extremely valuable answers to my often entry/silly level problems. I greately appreciate your effort and your time. I’d buy you a drink if I could. Thank you.

gordonfreemanjr

@mitu Is that a common issue that I barely get any DOS scrapes? I got only 20/300 hits on all available sources (with an uncanny zero from Screenscraper), only games like Doom or Alone In The Dark got a match. The rest hasn’t been found for any reason. I’m using Skyscraper and my .conf names are pretty detailed (i.e. Batman Returns, Tom & Jerry, Mario Is Missing etc).

It’s not a deal breaker, I’m grateful to have bunch of working .conf files. It just feels weird. I got like 80% hits on mu ZX Spectrum library, and DOS? 20/300?

mitu

@gordonfreemanjr said in Scraping MS-DOS games:

@mitu Is that a common issue that I barely get any DOS scrapes?

I don't know - I don't have an large DOS library. Have you tried to use TheGamesDB as a source ? They might have more DOS games in their database - Batman Returns or Mario is Missing seem to scrape fine via Skyscraper.

gordonfreemanjr

@mitu I’ve tried all 4 of them. I have a membership on Screenscraper and it typically provides 90% of my scrapes. With DOS the result was zero.

Odd that a file named: Mario is Missing.conf doesn’t earn a scrape.

muldjord

@gordonfreemanjr Dos games can be hard to scrape with ScreenScraper. .sh and .conf files can vary a lot in content and filenames, so it will be hit n' miss and you will notice a lot less hits than with rom based platforms. That's just how ScreenScraper works.

But, if you name your script files like Precise Game Name.sh it should work pretty well with the thegamesdb source. Keep in mind that there's a limit of 3000 scrapes per IP on that source, so if you've run out of those, it won't give you any hits. If you prefer other filenames, you can also just use the aliasMap.csv file in /home/pi/.skyscraper. Adding aliases to this file will allow you to overwrite the search name used for filename based scraping modules such as TheGamesDb. Instructions are in the file.

gordonfreemanjr

@muldjord Thanks for this. Thanks to your other post I just found out, that Screenscraper scans whole file names, therefore it won’t work with .conf files.

But back to exact names and TheGamesDB: I thought that my file names are pretty accurate:

Batman Returns.conf
Mario is Missing.conf
Castlevania.conf
Tom & Jerry.conf

It would come across as pretty clear to me if I got no hits for file names such as: tomjerry.conf or mariomiss.conf, but these seem pretty accurate to me. That’s what puzzles me.

mitu

@gordonfreemanjr said in Scraping MS-DOS games:

Batman Returns.conf
Mario is Missing.conf

They worked for me, using TGDB:

#1/16 (T3) ---- Game 'Batman Returns' found! :) ----
Scraper:        thegamesdb
From cache:     YES (refresh from source with '--cache refresh')
Search match:   100 %
Compare title:  'Batman Returns'
Result title:   'Batman Returns' (thegamesdb)
Platform:       'PC' (thegamesdb)
Release Date:   '1992-01-01' (thegamesdb)
Developer:      'Spirit of Discovery' (thegamesdb)
Publisher:      'Konami' (thegamesdb)
Players:        '1' (thegamesdb)
Ages:           '' ()
Tags:           'Adventure' (thegamesdb)
Rating (0-1):   '' ()
Cover:          YES (thegamesdb)
Screenshot:     NO ()
Wheel:          NO ()
Marquee:        NO ()
...
#16/16 (T4) Pass 1 ---- Game 'Mario Is Missing' found! :) ----
Scraper:        thegamesdb
From cache:     NO
Search match:   100 %
Compare title:  'Mario Is Missing'
Result title:   'Mario is Missing CD-ROM Deluxe' ()
Platform:       'PC' ()
Release Date:   '1993-01-01' ()
Developer:      'The Software Toolworks' ()
Publisher:      'The Software Toolworks' ()
Players:        '1' ()
Ages:           'Not Rated' ()
Tags:           'Adventure, Platform' ()
Rating (0-1):   '' ()
Cover:          YES ()
Screenshot:     NO ()
Wheel:          NO ()
Marquee:        NO ()

Efriim

@gordonfreemanjr
Is there a way to rename a folder in /roms/pc/ to load as if it were a single file config?
Something like: /roms/pc/arkanoid.dos

I think there was some method do this for scummvm games.

quicksilver

@gordonfreemanjr said in Scraping MS-DOS games:

Thanks to your other post I just found out, that Screenscraper scans whole file names, therefore it won’t work with .conf files.

You can use skyscraper to scrape your .conf files using screenscraper as the source. You just need to name it 100% the same as how it is listed in the screenscraper database. The .conf extension won't matter. For example mario is missing needs to be named like this: Mario is Missing! (1992).conf in order to be found in the screenscraper database. You can look up the exact name that is needed by searching for the game on screenscrapers website then once you click on the name of the game, click on the roms/isos tab to see what the exact name should be.

gordonfreemanjr

@quicksilver Ok, so I get it with Mario is Missing. But Batman Returns?

https://www.screenscraper.fr/romsinfos.php?plateforme=135&alpha=B&numpage=1
https://www.screenscraper.fr/rominfos.php?romid=763503

It seems that the <official> Screenscraper name for Batman Returns is just Batman Returns. Yet, it’s not scraping.

muldjord

@gordonfreemanjr It's called Batman Returns.pc it seems like. ScreenScraper expects an exact filename match. Your file was called .conf right? That's not a match. :)

EDIT: I suggest using some other source. If you've run out of TheGamesDB requests you'll have to wait a month though. As @mitu tested it works fine with TheGamesDB, so I'm guessing you've simply run out of requests and that's why it won't work with TheGamesDB.

Only way to use ScreenScraper as source is to rename all of your files to match exactly one of the files listed under connected roms for each game. And it has to be a 100% match, including the suffix of the file. That's how ScreenScraper works with filename matching.

sirhenrythe5th

Maybe i am very wrong, but what i did with those hard-to-scrape games (MS-DOS, Amiga, some Arcade-Games and so on...): i opened the options menu for this game in the gamelist and choosed "edit metadata".
Then i started scraping this game with the result that no data was found.
After that i choosed the "manual input" and typed in logical names.
In Example: when the scraper did not find anything for "Leisure Suit Larry in the Land of the Lounge Wizards (VGA remastered / DOS)" i just typed in "Larry" or "Leisure".
After that i could choose a Larry-Game out of 8 known.
Of course you cant scrape dozens of games in a row, but in the end this way might be faster than changing dozens of filenames.

gordonfreemanjr

@muldjord I see. I was just referring to what @quicksilver wrote about using Screenscraper as a source nevertheless.

@sirhenrythe5th said in Scraping MS-DOS games:

Maybe i am very wrong, but what i did with those hard-to-scrape games (MS-DOS, Amiga, some Arcade-Games and so on...): i opened the options menu for this game in the gamelist and choosed "edit metadata".
Then i started scraping this game with the result that no data was found.
After that i choosed the "manual input" and typed in logical names.
In Example: when the scraper did not find anything for "Leisure Suit Larry in the Land of the Lounge Wizards (VGA remastered / DOS)" i just typed in "Larry" or "Leisure".
After that i could choose a Larry-Game out of 8 known.
Of course you cant scrape dozens of games in a row, but in the end this way might be faster than changing dozens of filenames.

I guess the built-in scraper is offline these days, no?

sirhenrythe5th

@gordonfreemanjr both? you can change between screenscraper and The GamesDB-Scraper also for single-scraping.

gordonfreemanjr

@sirhenrythe5th I meant the preset scraping engine withing Emulation Station. Or is it not what you've meant?

sirhenrythe5th

@gordonfreemanjr it is what i meant, but there are two scrapers to select within the ES-Menu.
When the "GamesDB Scraper" is down (what happens quite often) i use to change to the "Screenscraper".

gordonfreemanjr

@sirhenrythe5th Got it now. Indeed it works. Not for all DOS games, right now the hit ratio is roughly at the 40-50% level, but it’s better than before. Thanks!

quicksilver

@gordonfreemanjr Batman Returns (1992).conf worked for me on skyscraper with screenscraper set as the source. On the second link you posted you can see there is a "filename" tab, if you click on it you can see other filename aliases.