Scraping PC Engine Cd games ?

Charco

@Guy0me do your cue files have weird filenames like Gate_of_Thunder_USA.cue etc? If so, edit the metadata using the in built ES scraper to change the filename to Gate of Thunder, for example. This should help the scraper find the correct info.

If this doesn't work you can search online for the boxart, place it in the directory with your other working boxart, ensure it matches the title of your game, and edit the metadata using the same method to point it to that image.

Hope this helps, worked for me for all my Turbo CD games :)

Guy0me

@Charco
No , my files names are clean like Akumajou Dracula X - Chi no Rondo (J).cue or Gate of Thunder (J).cue
Also the Fatal Fury Special is missing in thegamedb .. it's sad..
Maybe i need to delete the TOC Files no ? but i don't think it's related to scraping things...
If i had to do manually all my games it's king of difficult maybe there is another way..

Guy0me

I think the scraper is looking in the wrong path for scraping the games cause there's a difference between http://thegamesdb.net/platform/turbografx-16/ and http://thegamesdb.net/platform/turbo-grafx-16-cd/
i think that's why it find nothing.. maybe i can edit somewhere a file to change this ?

sselph

I haven't made an effort to try and scrape the PC Engine CD, so if you are using my scraper it might not work well. There are some entries there that @BenWlson added but I don't know how complete it is. Also with cue files, it is just a text file with a list of files so if the names aren't exactly the same, things would not work.

Guy0me

Yes i can confirm, your scraper don't see the difference too between PC Engine roms and PC Engine CD.. unfortunately :-( i was hoping you do the effort lol but i understand it's a lot fo work ... :-)
Yes i know CUE files are just text file in it .. but with the Sega CD games i do the same thing and scrape only CUE files and it works fine ..
It's not a files problem i guess because the scraper from Retropie(emu station) find some games who look the same so it propose something but not the correct one ..
I can't have exactly the same names with ISO files because for all games i have 2 ISO files and OGG for the sound.. CUE and TOC.

Guy0me

@sselph
in fact the biggest problem with PC Engine is the rom files and the CD files are not separates.. like Sega CD and Megadrive/Genesis for exemple..
I see on other forum peoples who do some custom things on retropie to have them separate with logos and everything..
maybe on some next update we could have this :-)
and after that you could maybe do also separate command lines to scrape from "http://thegamesdb.net/platform/turbografx-16/" and "http://thegamesdb.net/platform/turbo-grafx-16-cd/"
i'm just saying lol it's an idea..

Jayzonious

Has anyone found a fix for this? I'm experiencing the same issue. The Sselph scraper fails and the built in scraper scans the .cue files and does not find any results. It would be awesome if a scraper could check the hash on the .bin files. My RetroPie is 100% scraped minus my Pc Engine CD games :(

sselph

@Jayzonious
My scraper checks the hash of the cue, if it matches it is done. If it doesn't match, it checks the hash of all the listed bin files. It only lists the cue file in the logs but it is checking everything. The issue is that I haven't added any of the hashes for PC Engine CD.

InsecureSpike

@Guy0me said in Scraping PC Engine Cd games ?:

@sselph
in fact the biggest problem with PC Engine is the rom files and the CD files are not separates.. like Sega CD and Megadrive/Genesis for exemple..
I see on other forum peoples who do some custom things on retropie to have them separate with logos and everything..
maybe on some next update we could have this :-)
and after that you could maybe do also separate command lines to scrape from "http://thegamesdb.net/platform/turbografx-16/" and "http://thegamesdb.net/platform/turbo-grafx-16-cd/"
i'm just saying lol it's an idea..

i've done this in my unreleased theme, i'm willing to share it!, the only issue is i've edited my es_system.cfg which you'll need too, and you'll have to re-edit it or re-name your folders....

thats only if you wanna try it

keith.f.kelly

@sselph - What's the master data source for the hashes that your scraper compares against? Is it thegamesdb.com? Because I see tons of my TG16 CD-ROM games present in thegamesdb.com, but your scraper still doesn't pick them up. If that's not the master data source that your scraper uses, and your scraper requires you to instead curate and maintain your own data source, that doesn't sound like a good recipe for scalability and longevity of your implementation.

I'm still struggling to figure out how to scrape all the data and images from thegamesdb.com for all my TG16 CD-ROM games. I've grepped around in the various scripts and configuration files that make up your scraper and EmulationStation's built-in scraper, but I can't seem to find where the URL template is defined that either scraper uses to hit thegamesdb.com to look up games for each platform. I was hoping I could at least temporarily modify some human-editable script or configuration file to point to the "TurboGrafx CD" section of thegamesdb.com so that I could run a one-time scrape to at least populate all my local data, but so far I haven't been able to find anything that looks promising. Any chance I'm just overlooking something obvious?

keith.f.kelly

I finally figured out a workaround. You need to manually edit es_systems.cfg to temporarily change the "pcengine" system to specify "unknown" for the <platform> node, then restart EmulationStation. Now you can at least manually scrape each CD-ROM game using ES's built-in scraper and choose the correct result from the list. Bulk scraping is a no-go though; it would require a code change to PlatformId.h and PlatformId.cpp in the EmulationStation source code. If I get super-motivated, I may code up a fix for it and submit a pull request.