RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Am I Scraping Media in the Best Way Possible?

    Scheduled Pinned Locked Moved Help and Support
    scrap
    2 Posts 2 Posters 497 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A
      AlphaBetaPie
      last edited by

      Hey folks, I'm trying to come up with a better way to save time when organizing my media for my rom sets. So far, my current process is a bit time consuming, but if it's the only/best way, then I'm OK with that. But before I devote too much more time with it, I want to first make sure there isn't a better way that could save time and yield better results.

      Let's take my NES collection for example. I have about 764 ROMs curated from a no-intro set that represents the perfect (in my opinion) US retail collection. I'm in a desktop environment, so I have been using the latest beta build of SkraperUI. It pulls everything from the Screen Scraper database. My results have been decent thus far. I find everything within about 5-6 games that are missing. So I have to find those manually. No big deal. But videos are a little more challenging, and usually take a little more time. THEN I notice that some of the regions are not right. For instance, I might end up with a PAL cover or European cart design, instead of only English/US region (like I have it set).

      Having to check all these for over 700+ games for just one collection (then multiply that by over 10-20 other sets I'd have to do this for), I'm in for quite the tedious amount of checking and tweaking to get the media just right.

      My question is as stated above; is there a better way? Is there another database or program I can use that will yield better or more accurate results, without as much need to curate on my end after the fact? Should I build a pie and let the EmulationStation scrapers that are popular right now do it instead (I heard they are pretty hardcore). Or is this a pretty good representation of what anyone should expect when scraping this much media, and am I only getting pretty much as good as I'm going to get?

      1 Reply Last reply Reply Quote 0
      • ClydeC
        Clyde
        last edited by

        Did you read Validating, Rebuilding, and Filtering ROM Collections? If not, it could help you understand the basics and some specifics about building a romset. The article uses a MAME romset for example, but you can use most if not all of the tools mentioned there also for console romsets.

        I use RomCenter with full no-intro romsets (i.e. with all regions in them) and Parent-Clone XML no-intro dats to build a regional mix of my liking. RomCenter can priorize the regions, e.g. use the US version of a game if available. If it's not, use the Japanese version, then the Australian, than the European and so on.

        1 Reply Last reply Reply Quote 0
        • First post
          Last post

        Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

        Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.