• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

Which Is The Most Accurate Scraper?

Scheduled Pinned Locked Moved Help and Support
scrapescrape datauxssselph
6 Posts 5 Posters 10.3k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • M
    mattrixk
    last edited by 29 May 2017, 12:59

    I've been using UXS to get some fantastic looking Mix images, but I've noticed that a lot of games have incorrect Genres listed, they have the wrong number of players listed, or they're missing other data such as descriptions, release date or ratings.

    I've been considering scraping with UXS to get the cool Mix images, scraping a second time with SSelph to get the correct metadata and then merging the 2. It's more work than I was wanting to do, but it's pretty much just a find-and-replace in the gamelist...

    Anyway, my question is: Is it worth it to do this? How accurate is the data you get from the SSelph scraper? Am I better off just staying with the UXS data? Or even trying the built-in scraper*?

    * I'm not a fan of the built-in scraper. It takes too long and you have to verify each game manually, else it gets most of them wrong.

    My ES themes: MetaPixel | Spare | Io | Indent

    D 1 Reply Last reply 31 May 2017, 05:34 Reply Quote 0
    • D
      DarkWolf @mattrixk
      last edited by 31 May 2017, 05:34

      @mattrixk Yeah, I noticed it too... The images you get with UXS are awesome! But it seems like SSelph scrapes better metadata (because of the different database), I'm not sure how accurate it is, but the games I played have correct metadata (not playing a lot of games, just a few I like at the moment).
      If you use the command line version of SSelph I think there was a "file addition" tag or something so the images got "-image" at the end...
      So basically I scraped images with UXS and with SSelph and put those together

      System: Raspberry 3 Model B, RetroPie 4.2.1
      Storage: 16gb Micro SD, 64gb USB Drive
      Theme: Updated NBBA

      Documentation solves many problems: https://retropie.org.uk/docs/

      A 1 Reply Last reply 31 May 2017, 05:38 Reply Quote 0
      • A
        AlexMurphy Banned @DarkWolf
        last edited by 31 May 2017, 05:38

        @DarkWolf Hmm, I don't use metadata but the images that SSelph scraped for some MAME stuff was awful. Like most people I use a mix of the 3 main scrapers plus custom art too.

        D 1 Reply Last reply 31 May 2017, 05:41 Reply Quote 0
        • D
          DarkWolf @AlexMurphy
          last edited by DarkWolf 31 May 2017, 05:41

          @AlexMurphy Yeah, the MAME ones are quit ugly, I'am using UXS images with the arcade machine with the screenshot on the screen and the wheel on the top
          Otherwise I'am using SSelphs scraped images to fill the games with no image and the inbuild one for systems like atari2600/5200 (UXS and SSelph not scraping any of these)

          System: Raspberry 3 Model B, RetroPie 4.2.1
          Storage: 16gb Micro SD, 64gb USB Drive
          Theme: Updated NBBA

          Documentation solves many problems: https://retropie.org.uk/docs/

          1 Reply Last reply Reply Quote 0
          • S
            sselph
            last edited by 31 May 2017, 05:52

            By default my scraper won't ever re-download media that has the same path as expected. So if you scrape from screenscraper.fr using mix3/mix4 images with videos and marquees. You can technically run it again against thegamesdb and use the metadata from thegamesdb, and since the media won't be re-downloaded it will only update the metadata.

            Auto-scraper: https://github.com/sselph/scraper
            Donate to Extra-Life 2018 and help save lives: https://goo.gl/diu5oU

            1 Reply Last reply Reply Quote 1
            • S
              screech
              last edited by 31 May 2017, 10:38

              For information, Screenscraper is a "young" DB ;) (a little more than 1 year old and already one of the most if it isn't the most "complete" DB ;) ).
              All data aren't referenced, and some mistake may pass throught the moderator validation (we are human after all ^^)

              If you found "wrong" information, or a "missing" information, don't hesitate to propose or comment the error directly on the website.
              Information are from the community... If every one participate, we can have a nice DB ;)

              1 Reply Last reply Reply Quote 0
              1 out of 6
              • First post
                1/6
                Last post

              Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

              Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                This community forum collects and processes your personal information.
                consent.not_received