cannot install scraper via ./retropie_setup.sh

crazyleo

Ok, so I've setup retropie 3.8.1 on my raspberry pi (model B) and most things are working well so far. One of the issues I've encountered so far is that I'm unable to install scraper module. I'm killing the GUI and running the 'retropie_setup.sh' script via console. I have also updated the setup script before doing that. Once I select option "822" scraper under 'setup/tools' menu it tries to install system dependencies. However, it then gets stuck at "Getting sources for scraper" stage and does not go any further. I've tried updating and rebooting and running the script again but everytime it gets stuck at the same stage. Is there another way to get this working? Or maybe I need to remove the partial install (if there is any considering I've attempted it 3-4 times already). What command I need to remove any footprints/install files and try again? Please help.

sselph

I can't remember the behavior but I think the newer versions will attempt to build the scraper from source. I can't imagine why it is failing. If there are any errors, those would be helpful. I also don't know what you mean by "822" but not really familiar with using the option in the retropie_setup. Regardless, you can install from a binary following https://github.com/sselph/scraper#install-from-my-binaries the current release is v1.1.5

My recommendation in the README is to run the scraper in a way that places everything in the rom directory. I did this because I like the portability. Aloshi (ES author) preferred not mixing the the metadata and rom data. The default behavior of running from the retropie_setup is to mimic the ES behavior so if you want to do that you'll need a lot more flags passed in.

this is an example of that for nes.
scraper -image_dir ~/.emulationstation/downloaded_images/nes -image_path ~/.emulationstation/downloaded_images/nes -output_file ~/.emulationstation/gamelists/nes/gamelist.xml -rom_dir ~/RetroPie/roms/nes -workers 4 -thumb_only

crazyleo

Thanks mate, you're a legend. I was able to install it manually from binaries as per the article. I'm not sure if one can invoke a GUI from a binary install. It'd be pretty handy for noobs like me. It'd also be great if there was a command line guide for running this from console; one that explains all the options/flags that can be used. I tried it yesterday from console but got a lot of errors on roms (Hash not matched or something). However, I didn't use any flags like the example from your post.

"822" is the menu option under "setup/tools" for scraper utility. There are no errors as it actually doesn't fail but gets stuck at "getting sources" stage.

rbaker

@crazyleo I recommend watching

excellent video from @Floob . It's all still relevant for the scraper and it's the way I got it to work. Also, with regard to parameters, look at this page. It has all the info that you seek, especially the parameter list.

Basically, change to the roms directory you wish to scrape then invoke the scraper:

$ cd ~/RetroPie/roms/<rom_dir>
$ scraper -thumb_only

This works for all your console stuff. For arcade games, just use:

$ cd ~/RetroPie/roms/<rom_dir>
$ scraper -thumb_only -mame

for MAME, NEO-GEO and FBA emulators.

herb_fargus

@crazyleo https://github.com/sselph/scraper/wiki

sselph

@crazyleo Hash not found is when I can't find a matching hash in my DB so it skips the ROM, you can ignore those. The hashes are from No-Intro sets so it will only match the known good rom. If you have roms that are bad or hacked or something like that it won't match those

crazyleo

@rbaker
thanks mate, that was quite helpful. I have scraped my genesis and fba collection. however, there are quite a lot of roms that came with "hash not found error". I'm pretty sure that it's a working rom with correct name.

crazyleo

@sselph
thanks, just saw your post after replying to rbaker's post. that makes sense now. One more question on a side note: are the duplicates filtered automatically or you have to remove them from the list manually?

sselph

My scraper will just make 2 entries if it finds 2 identical files with different names. If you wanted them filtered out you'd have to do that manually or with another tool.