RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scrape roms on USB Drive

    Scheduled Pinned Locked Moved Help and Support
    7 Posts 4 Posters 7.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • G
      geneworld
      last edited by

      Hey Guys I have an issue when it comes to scraping games that are on a usb drive and I haven't found a solution online yet. I have games in '/home/pi/RetroPie/roms/nes' and that are all scraped just fine. I also have nes games on a flash drive and through a menu I made in emulationstation I am able to switch between the original directory and '/media/usb/roms/nes' through changing the roms path in '/home/pi/.emulationstation/es_systems.cfg'.

      When I tried to scape the roms on the drive with SSelphs Scraoer through 'sudo /home/pi/RetroPie-Setup/retropie_setup.sh' it scrapes the roms in '/home/pi/RetroPie/roms/nes' instead of '/media/usb1/roms/nes'

      Does anyone know how I can scrape the directory I want? I was looking here https://github.com/retropie/retropie-setup/wiki/scraper and see all the parameter and know the program is located at '/opt/retropie/supplementary/scraper'. Do I need to do it through command line or is there a way I can edit the rom directory in the 'retropie_setup.sh' program?

      1 Reply Last reply Reply Quote 0
      • R
        Russelkm
        last edited by

        I have the same problem. I have a harddisk with a lot of psx, n64, full romsets of mame, etc, but scraping never has worked. This HD is used for other purpose too, films , series, photes, then I cant' mount directly on roms folder in RetroPie. In addition to this, I want to have a bunch of roms in sd (roms folder) and other biger rom files in HD, because, If I want to play with friends in other place, I just get my raspberry and move (with out hard disk) but, in home, I want to have all roms available.

        Then, I tried with symbolic links. I was able to play perfectly but, no scraping. Then I tried with bind mount, but it was most dificult to implement and didn't work too. Right now I trying another atttempt, and I've discovered that if I make a symbolic link for a each file, I can play and scraping a rom, and the metadata keeps later than reboot. well, it's something, now, I must sort my files in HD to make a script for create simlinks masively for each rom.

        I hope I help you.

        1 Reply Last reply Reply Quote 0
        • G
          geneworld
          last edited by

          Thanks for the reply, I was thinking about using a symbolic link but for each file that could take a lot of time! from the github I found the parameters and put a command together for the terminal but I'm not sure about a few things. I have:

          /opt/retropie/supplementary/scraper/scraper add_not_found=true append=false ownload_images=true extra_ext=".nes,.NES" gdb_img="b" image_dir="/home/pi/.emulationstation/downloaded_images/nes" image_path="/home/pi/.emulationstation/downloaded_images/nes" image_suffix="-image" img_format="jpg" img_workers=??? max_width=400 missing="/home/pi/.emulationstation/downloaded_images/nes/missing.txt" nested_img_dir=true output_file="gamelist.xml" output_file="/home/pi/.emulationstation/gamelist/gamelist.xml" overview_len=??? refresh=false retries=2 rom_dir="/media/usb1/roms/nes" rom_path="/media/usb1/roms/nes" scrape_all=false skip_check=false start_pprof=false strip_unicode=true thumb_only=false use_gdb=true version=false workers=4

          I'm not sure about:
          img_workers=???
          overview_len=???
          refresh=false???
          start_pprof=false???
          workers=4???

          I also found this file '/home/pi/RetroPie-Setup/scriptmodules/supplementary/scraper.sh'
          https://github.com/RetroPie/RetroPie-Setup/blob/master/scriptmodules/supplementary/scraper.sh
          And I wasn't sure how it is used since it isn't set up as an executable or where it is installed to.

          When I have more time I can play with the file and even grab the parameters from it but if there's an simpler solution I'm all for it!

          1 Reply Last reply Reply Quote 0
          • S
            sselph
            last edited by

            The simplest way is to

            cd /media/usb1/roms/nes
            /opt/retropie/supplementary/scraper/scraper
            

            You can optionally add -thumb_only -workers 4 to speed things up.

            Auto-scraper: https://github.com/sselph/scraper
            Donate to Extra-Life 2018 and help save lives: https://goo.gl/diu5oU

            1 Reply Last reply Reply Quote 0
            • G
              geneworld
              last edited by

              Oh that seems a lot simpler than what I was thinking! Thanks @sselph I'll have to try that out tonight. :D

              1 Reply Last reply Reply Quote 0
              • G
                geneworld
                last edited by

                After a few failed attempts I finally got this all sorted out. For anyone interested I used the following command to get all my roms in /media/usb1/roms/nes/ to scrape as well as the sub-directories correctly without having to edit any other file.

                pi@raspberrypi:~ $ /opt/retropie/supplementary/scraper/scraper -output_file="/home/pi/emulationstation/gamelists/nes/gamelist.xml" -missing="/home/pi/.emulationstation/gamelists/nes_missing.txt" -image_dir="/home/pi/.emulationstation/downloaded_images/nes" -image_path="/home/pi/.emulationstation/downloaded_images/nes" -rom_dir="/media/usb1/roms/nes" -rom_path="." -thumb_only -workers 4

                the nes_missing.txt I though would be useful so that I can find which I need to manually edit.

                1 Reply Last reply Reply Quote 1
                • N
                  Necrym
                  last edited by

                  This post is deleted!
                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post

                  Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                  Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.