RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scrapping Speed and Alternative Databases

    Scheduled Pinned Locked Moved Help and Support
    scraperthegamesdbslow
    6 Posts 4 Posters 3.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • trigger_deathT
      trigger_death
      last edited by trigger_death

      Pi Model: Raspberry Pi 3 - Model B
      Power Supply: CanaKit 5V 2.5A Raspberry Pi 3 Power Supply / Adapter / Charger
      RetroPie Version: 4.1
      Built From: Pre made SD image. (Boots on Micro SD, filesystem is on Flash Drive)

      I've noticed scraping from thegamesdb is horrendously slow, I'd like the use thearchive but the first game on my list (Asteroids) doesn't even show any results.

      Is there any better way to scrape that won't take over an hour?

      1 Reply Last reply Reply Quote 0
      • screechS
        screech
        last edited by

        You can try Sselph scraper
        Fastscraper from Paradadf
        Or Universal XML Scraper (from me ^^)

        Just do a search on the forum, you will find tone of post about it ;)

        columboscoatC 1 Reply Last reply Reply Quote 3
        • columboscoatC
          columboscoat Banned @screech
          last edited by

          @screech Just to say UXMLS is a great tool for RetroPie. Merci beaucoup, mon ami.

          1 Reply Last reply Reply Quote 0
          • C
            Concat
            last edited by

            You're not alone. The built-in scraper is stupendously slow right now, and archive DB doesn't find anything anymore.

            Universal XML Scraper is fast if you scrape by name only. But if you scrape by CRC or whatever, it can take hours for disc games. Just be aware that you should set up the utility config properly before scraping, otherwise it can create files on your Pi all over the place :)

            SSelph is pretty speedy as well and I think it has an extra option for database. I prefer XML ever since trying it out a few days ago, primarily because of the profiles like Arcade cabinet and mix profile.

            columboscoatC 1 Reply Last reply Reply Quote 1
            • columboscoatC
              columboscoat Banned @Concat
              last edited by

              @Concat yeah, I definitely prefer the 3 image mix and the arcade cab to the 2D boxart and game flyers.

              1 Reply Last reply Reply Quote 0
              • screechS
                screech
                last edited by

                FYI
                Other MIX Template is downloadable from the menu configuration.
                You can create you own MIX template ( https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/[TUTO]-Making-a-MIX-Template) And if you want PR them to the github repository ;)

                1 Reply Last reply Reply Quote 1
                • First post
                  Last post

                Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.