• Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
RetroPie forum home
  • Recent
  • Tags
  • Popular
  • Home
  • Docs
  • Register
  • Login
Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

Steven Selph's scraper vs EmuStation Scraper, what's the difference?

Scheduled Pinned Locked Moved Help and Support
scraperselphs scraperemustation
18 Posts 12 Posters 22.9k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • D
    DIY_glenn
    last edited by 10 Sept 2016, 21:18

    Hi!
    I just bought a RPi3 and burned RetroPie. I am impressed with how finished it is! I was expecting installing emulators, configuring etc, but everything is there! It's now syncing roms automatically from my home server - perfect!

    I like the scraper functionality, but I was a bit confused from the the wiki, as there are two scraping options. Using Steven Selph's scraper, I had to quit EmuStation and run it manually (connect a keyboard etc).
    But with the EmuStation option I could control everything from gamepad, which for me makes much more sense. EmuStation also cleaned up the names which Selph's didn't. ("Bubble Bobble (EUROPE)" -> Bubble Bobble").

    What's the deal here, any reason for using one over the other?

    1 Reply Last reply Reply Quote 0
    • 3
      3lric
      last edited by 3lric 9 Oct 2016, 23:23 10 Sept 2016, 22:22

      Selph scraper gets metadata via hash. The built in scraper gets it via system and game name.

      Normally i use the Selph scraper first and then fill in the blanks with the built in scraper.

      D 1 Reply Last reply 10 Sept 2016, 22:44 Reply Quote 0
      • D
        DIY_glenn @3lric
        last edited by 10 Sept 2016, 22:44

        @3lric Thanks!
        How about the names, can Selph's be configured to remove the "(EUROPE)" ++ tags behind the actual name?

        3 R 2 Replies Last reply 10 Sept 2016, 23:11 Reply Quote 0
        • M
          meleu
          last edited by 10 Sept 2016, 23:03

          I stopped to use the ES scraper because of the issues I exposed here: https://retropie.org.uk/forum/topic/85/scraper-optimization
          And then started to use the sselph scraper.

          If your raspi is connected to your LAN you can log into it via SSH and then use the sselph scraper (don't forget to exit/kill emulationstation anyway).

          I think that rename the roms is unnecessary. But if you really want it, maybe it's better to use a custom shellscript.

          • Useful topics
          • joystick-selection tool
          • rpie-art tool
          • achievements I made
          3 1 Reply Last reply 10 Sept 2016, 23:15 Reply Quote 0
          • 3
            3lric @DIY_glenn
            last edited by 10 Sept 2016, 23:11

            @DIY_glenn
            type scraper -help

            use_no_intro_names
            or something like that might be what you are looking for. I normally just copy the gamelist over to an excel doc after im done scraping and replace all

            (*)</name> to just </name>

            this is somewhat sloppy and youd still have to fine tune. another way would be to make a batch file to list all files in a directory (to rename the files themselves rather than what the gamelist calls them, which isnt exactly ideal) and then another to rename from one name to another, but that has its annoyances as well since you have to copy the lists to seperate documents until you finish making your changes and then put them together with a rename before hand. such as

            rename "things (year).sms" "things.sms"
            exit

            I used to do this to rename everything at once but I'm sure there are better ways, as both of these still take a bit of time.

            1 Reply Last reply Reply Quote 1
            • R
              robertybob @DIY_glenn
              last edited by robertybob 9 Nov 2016, 00:13 10 Sept 2016, 23:12

              @DIY_glenn said in Steven Selph's scraper vs EmuStation Scraper, what's the difference?:

              @3lric Thanks!
              How about the names, can Selph's be configured to remove the "(EUROPE)" ++ tags behind the actual name?

              Can't edit, but if you start again you can use the flag

              -use_nointro_name=false

              https://github.com/sselph/scraper/wiki/Flags

              1 Reply Last reply Reply Quote 0
              • 3
                3lric @meleu
                last edited by 10 Sept 2016, 23:15

                @meleu
                renaming isnt necessary with the selph scraper. since its done via hash. the problem i have is that quite a few systems are not yet supported, and dreamcast is only gdi support, not cdi, as well as a few other things.

                I mainly just use the ES Scraper to fill in the blanks that Selph Scraper didnt find.

                1 Reply Last reply Reply Quote 1
                • D
                  DIY_glenn
                  last edited by 12 Sept 2016, 08:17

                  Thanks!

                  Are there any plans on integrating the scraper into RetroPie instead of having to use commands with EmuStation stopped?

                  H 1 Reply Last reply 12 Sept 2016, 12:44 Reply Quote 0
                  • H
                    herb_fargus administrators @DIY_glenn
                    last edited by 12 Sept 2016, 12:44

                    @DIY_glenn you don't need to use commands, it's already integrated in the setup script: https://github.com/retropie/retropie-setup/wiki/scraper

                    If you read the documentation it will answer 99% of your questions: https://retropie.org.uk/docs/

                    Also if you want a solution to your problems read this first: https://retropie.org.uk/forum/topic/3/read-this-first

                    D 1 Reply Last reply 12 Sept 2016, 15:03 Reply Quote 1
                    • T
                      tehswiftone
                      last edited by 12 Sept 2016, 14:03

                      The Emulation Station scraper does a really good job at miss naming games as well. Do not use it.

                      1 Reply Last reply Reply Quote 0
                      • D
                        DIY_glenn @herb_fargus
                        last edited by 12 Sept 2016, 15:03

                        @herb_fargus
                        Yeah, but when I choose "Scrape", it seems to be using EmuStations scraper instead.

                        I'm trying to make it a bit more kid-friendly, so it's easier for them to scrape when new games are added.

                        L S 2 Replies Last reply 12 Sept 2016, 15:14 Reply Quote 0
                        • L
                          Lyle_JP @DIY_glenn
                          last edited by 12 Sept 2016, 15:14

                          @DIY_glenn If your kids are already tech-savvy enough to add their own rom files, I bet they could learn the ins and outs of both scrapers with little trouble. Kids aren't afraid of tech and pick it up pretty quick in my experience.

                          1 Reply Last reply Reply Quote 0
                          • S
                            sselph @DIY_glenn
                            last edited by 14 Sept 2016, 05:02

                            @DIY_glenn If you are adding a couple games and want to scrape those then it might be easiest to use the scraper in ES. You can tell it(or might be the default) to only get games that don't already have an image so would only get the new games and then you could work with it to have it grab the right data. The link @herb_fargus provided shows the options for my scraper and you could choose append and set the naming like you like and save those settings so it could be set up but has more overhead to exit ES, etc.

                            The differences in my scraper and the one in ES as mentioned above are how the matches take place. They use the same data source but my scraper hashes the ROM data and matches that against a mapping to the ID in thegamesdb instead of using the name as a search parameter. So my scraper is great at quickly and with very little false positives matching lots of ROMs. ES scraper is much better for interactive searching but it is slower and if you just let it run unsupervised you will not be happy.

                            Auto-scraper: https://github.com/sselph/scraper
                            Donate to Extra-Life 2018 and help save lives: https://goo.gl/diu5oU

                            1 Reply Last reply Reply Quote 1
                            • allenpieA
                              allenpie
                              last edited by 14 Sept 2016, 05:38

                              I guess I'm doing it the chump way I have been googling the full game name and doing a full rename

                              One thing I noticed it if it's a game is 2 put it at II and it will find it better
                              Example Ninja Turtles II will find a copy of the game art
                              Ninja Turtles 2 won't find the game art

                              I tend to run both build in the 4.02 I'm only missing Neo Geo as I'm unsure if it's able to pull those?

                              Retro Pie and Chill

                              FloobF 1 Reply Last reply 14 Sept 2016, 12:09 Reply Quote 0
                              • FloobF
                                Floob @allenpie
                                last edited by 14 Sept 2016, 12:09

                                @allenpie Yes, it can process Neo Geo, it will use the filename (opposed to a hash) as they are effectively Arcade/MAME games.

                                Please read the Docs before asking a new question.
                                RetroPie Help Guides: https://goo.gl/3gcNsT

                                1 Reply Last reply Reply Quote 0
                                • V
                                  virg1
                                  last edited by 5 Oct 2016, 03:57

                                  Quick question, I saw somewhere that Selphs's scraper will not work on external USB drives. If the drive is "properly mounted" using the instructions on the git hub site, will the scraper then work properly? I have not manually changed any folders paths like many have done with some to little success, and I believe ES knows all files are stored on the external USB. Want to try to scraper but affraid to after seeing that note Herb's link a few replies above. Thanks for
                                  Assistance

                                  BuZzB 1 Reply Last reply 6 Oct 2016, 12:05 Reply Quote 0
                                  • BuZzB
                                    BuZz administrators @virg1
                                    last edited by 6 Oct 2016, 12:05

                                    @virg1 it should be fine

                                    To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                                    V 1 Reply Last reply 6 Oct 2016, 12:28 Reply Quote 0
                                    • V
                                      virg1 @BuZz
                                      last edited by 6 Oct 2016, 12:28

                                      Thank you BuZz! Going to try the scraper today.

                                      1 Reply Last reply Reply Quote 0
                                      • First post
                                        Last post

                                      Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                      Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.

                                        [[user:consent.lead]]
                                        [[user:consent.not_received]]