RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping PC Engine Cd games ?

    Scheduled Pinned Locked Moved Help and Support
    13 Posts 6 Posters 7.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CharcoC
      Charco @Guy0me
      last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • CharcoC
        Charco @Guy0me
        last edited by Charco

        @Guy0me do your cue files have weird filenames like Gate_of_Thunder_USA.cue etc? If so, edit the metadata using the in built ES scraper to change the filename to Gate of Thunder, for example. This should help the scraper find the correct info.

        If this doesn't work you can search online for the boxart, place it in the directory with your other working boxart, ensure it matches the title of your game, and edit the metadata using the same method to point it to that image.

        Hope this helps, worked for me for all my Turbo CD games :)

        Guy0meG 1 Reply Last reply Reply Quote 0
        • Guy0meG
          Guy0me @Charco
          last edited by

          @Charco
          No , my files names are clean like Akumajou Dracula X - Chi no Rondo (J).cue or Gate of Thunder (J).cue
          Also the Fatal Fury Special is missing in thegamedb .. it's sad..
          Maybe i need to delete the TOC Files no ? but i don't think it's related to scraping things...
          If i had to do manually all my games it's king of difficult maybe there is another way..

          1 Reply Last reply Reply Quote 0
          • Guy0meG
            Guy0me
            last edited by

            I think the scraper is looking in the wrong path for scraping the games cause there's a difference between http://thegamesdb.net/platform/turbografx-16/ and http://thegamesdb.net/platform/turbo-grafx-16-cd/
            i think that's why it find nothing.. maybe i can edit somewhere a file to change this ?

            1 Reply Last reply Reply Quote 1
            • S
              sselph
              last edited by

              I haven't made an effort to try and scrape the PC Engine CD, so if you are using my scraper it might not work well. There are some entries there that @BenWlson added but I don't know how complete it is. Also with cue files, it is just a text file with a list of files so if the names aren't exactly the same, things would not work.

              Auto-scraper: https://github.com/sselph/scraper
              Donate to Extra-Life 2018 and help save lives: https://goo.gl/diu5oU

              Guy0meG 2 Replies Last reply Reply Quote 0
              • Guy0meG
                Guy0me @sselph
                last edited by Guy0me

                Yes i can confirm, your scraper don't see the difference too between PC Engine roms and PC Engine CD.. unfortunately :-( i was hoping you do the effort lol but i understand it's a lot fo work ... :-)
                Yes i know CUE files are just text file in it .. but with the Sega CD games i do the same thing and scrape only CUE files and it works fine ..
                It's not a files problem i guess because the scraper from Retropie(emu station) find some games who look the same so it propose something but not the correct one ..
                I can't have exactly the same names with ISO files because for all games i have 2 ISO files and OGG for the sound.. CUE and TOC.

                1 Reply Last reply Reply Quote 0
                • Guy0meG
                  Guy0me @sselph
                  last edited by

                  @sselph
                  in fact the biggest problem with PC Engine is the rom files and the CD files are not separates.. like Sega CD and Megadrive/Genesis for exemple..
                  I see on other forum peoples who do some custom things on retropie to have them separate with logos and everything..
                  maybe on some next update we could have this :-)
                  and after that you could maybe do also separate command lines to scrape from "http://thegamesdb.net/platform/turbografx-16/" and "http://thegamesdb.net/platform/turbo-grafx-16-cd/"
                  i'm just saying lol it's an idea..

                  InsecureSpikeI 1 Reply Last reply Reply Quote 0
                  • J
                    Jayzonious
                    last edited by

                    Has anyone found a fix for this? I'm experiencing the same issue. The Sselph scraper fails and the built in scraper scans the .cue files and does not find any results. It would be awesome if a scraper could check the hash on the .bin files. My RetroPie is 100% scraped minus my Pc Engine CD games :(

                    S 1 Reply Last reply Reply Quote 0
                    • S
                      sselph @Jayzonious
                      last edited by

                      @Jayzonious
                      My scraper checks the hash of the cue, if it matches it is done. If it doesn't match, it checks the hash of all the listed bin files. It only lists the cue file in the logs but it is checking everything. The issue is that I haven't added any of the hashes for PC Engine CD.

                      Auto-scraper: https://github.com/sselph/scraper
                      Donate to Extra-Life 2018 and help save lives: https://goo.gl/diu5oU

                      K 1 Reply Last reply Reply Quote 0
                      • InsecureSpikeI
                        InsecureSpike @Guy0me
                        last edited by

                        @Guy0me said in Scraping PC Engine Cd games ?:

                        @sselph
                        in fact the biggest problem with PC Engine is the rom files and the CD files are not separates.. like Sega CD and Megadrive/Genesis for exemple..
                        I see on other forum peoples who do some custom things on retropie to have them separate with logos and everything..
                        maybe on some next update we could have this :-)
                        and after that you could maybe do also separate command lines to scrape from "http://thegamesdb.net/platform/turbografx-16/" and "http://thegamesdb.net/platform/turbo-grafx-16-cd/"
                        i'm just saying lol it's an idea..

                        i've done this in my unreleased theme, i'm willing to share it!, the only issue is i've edited my es_system.cfg which you'll need too, and you'll have to re-edit it or re-name your folders....

                        thats only if you wanna try it

                        RPi 3 - RetroPie + 500gb HDD [consoles] + Razer Onza Tournament
                        RPi 3 - RetroPie + 32gb USB [computers] + Keyboard
                        both with AttractMode + FuzzBoxx Layout

                        1 Reply Last reply Reply Quote 0
                        • K
                          keith.f.kelly @sselph
                          last edited by keith.f.kelly

                          @sselph - What's the master data source for the hashes that your scraper compares against? Is it thegamesdb.com? Because I see tons of my TG16 CD-ROM games present in thegamesdb.com, but your scraper still doesn't pick them up. If that's not the master data source that your scraper uses, and your scraper requires you to instead curate and maintain your own data source, that doesn't sound like a good recipe for scalability and longevity of your implementation.

                          I'm still struggling to figure out how to scrape all the data and images from thegamesdb.com for all my TG16 CD-ROM games. I've grepped around in the various scripts and configuration files that make up your scraper and EmulationStation's built-in scraper, but I can't seem to find where the URL template is defined that either scraper uses to hit thegamesdb.com to look up games for each platform. I was hoping I could at least temporarily modify some human-editable script or configuration file to point to the "TurboGrafx CD" section of thegamesdb.com so that I could run a one-time scrape to at least populate all my local data, but so far I haven't been able to find anything that looks promising. Any chance I'm just overlooking something obvious?

                          K 1 Reply Last reply Reply Quote 0
                          • K
                            keith.f.kelly @keith.f.kelly
                            last edited by

                            I finally figured out a workaround. You need to manually edit es_systems.cfg to temporarily change the "pcengine" system to specify "unknown" for the <platform> node, then restart EmulationStation. Now you can at least manually scrape each CD-ROM game using ES's built-in scraper and choose the correct result from the list. Bulk scraping is a no-go though; it would require a code change to PlatformId.h and PlatformId.cpp in the EmulationStation source code. If I get super-motivated, I may code up a fix for it and submit a pull request.

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post

                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.