@mitu nice one... My concern is about heavily customized setups (for example mine) where I have one directory per Arcade manufacturer (although they use the same emulator, they have a different theme setup for example), and directories do not necessarily match the system name, but I guess I can consider that as an edge case.

Thanks Again!

It's an upstream problem, caused by one its dependencies. Use Skyscraper instead.

@10vorne said in Adding Scraper to Emulationstation:

Can I read out with one command how much of the daily limit I have left?

If you scrape a title from command-line, it's reported in the cache output after each game is scraped:

pi@retropie:~ $ Skyscraper -p arcade -s screenscraper ~/RetroPie/roms/arcade/frogger.zip [...] Cache output: Video conversion: Success! 'screenscraper' requests remaining: 19999 #1/1, (1/0) Elapsed time : 00:00:22 Est. time left : 00:00:00

@KpCollins hi, could I ask you to try with the scraper I'm developing?
https://github.com/zayamatias/retroscraper
It should be working with dragon 32, although I have not tested it, so some testing would be appreciated.

Thanks!

*** Edit: just tried myself and it took less than 2 minutes to scan +530 ROMs, +400 succesfully found and video/image downloaded...

@rasp_renegade said in Scraper crashes ES:

. I had swapped gamelists and forgot, so disregard the part about old files. Anything else useful in that log?

I don't see any issues in the log.

TheGamesDB site is now back online, scraping should work again with this source in EmulationStation.

Thanks for all the suggestions. I should have no problem scraping the region artwork I'm after now.

There are no plans to 'retire' the built-in scraper, improvements are always welcomed.

@iandaemon
ok great info I didnt realize that
thank you

@exarkuniv , sounds good…thanks.

Put this in your /usr/local/bin folder and make it executable with chmod +x <filename>. Run it from your video folder. Your video files will not be overwritten. New files are saved to ./converted; to use them, you must move or copy one level up to replace the original files. Repeat for each system.

You may need to install ffmpeg first with sudo apt update && sudo apt install ffmpeg.

#! /bin/bash # Script provided by Clyde mkdir -p converted # create the folder "converted" if it doesn't exist for f in *.mp4 # process all videos in the current directory do echo "$(pwd)/$f" # show the processed file's name c=$(ffprobe "$f" 2>&1 | grep -c yuv444p) # (-c)ount no. of "444p" if [ "$c" -gt 0 ] # if 444p is present, then # convert to 420p ffmpeg -i "$f" -y -pix_fmt yuv420p -strict experimental converted/"$f" fi done

@edillenback said in Skyscraper / Steven Selph's Scraper working on some builds and not others???:

@drdave79 Just wish I had better news for you. I'm still having issues with both command line scrapers on anything but my existing build. The built-in GUI scraper does work and isn't bad after I took @mitu 's advice of unchecking the 'user decides on conflict' but that won't help you with videos.

Has to be something about the build process on my end but I'm doing pure vanilla installs and still have no idea what it could be.

Have you tried Skyscraper?

Yes, I've tried both. Same result.

UPDATE: I was wrong. The Windows version is also failing with the same error. I thought it was successful but it was actually using arcadeitalia as the source.

FYI…the Windows EXE version still works so I guess I can at least use that for now.

@sleve_mcdichael
Thanks for your answer! I was trying to create the script and I couldn't cause I'm a newbie haha. But I figured out that I was using wifi + ethernet cable, I thought it could be the wifi connection, so I disconected it. After that I used the purge option and re-scrape again some platforms and it worked. Got almost every platform working, but I couldnt do it with nintendo 64, it just wont work. When I was scrapping, i got these error messages saying the servers were overloaded, but its okay for me.
Thank you again !

@emulatre71 said in Scraper not working when attempting to scrape games for descriptions and boxarts.:

I do have a question about those with bin/cue file formats for PS1. It appears like this because the folders are in the ps1 rom folder, I did not take the contents and just throw them straight into the directory because I like to keep things organized. Are they supposed to be in a folder with their respective bin/cue files?
You don't see the scraper/boxart info until you click on it, this is how they appear so far.

You can convert .bin/.cue sets to .chd using the CHDMAN tool, to clean up your folders to one file per disc (and potentially also save some space.) This will allow you to keep them all in the root psx folder without being too cluttered up with .bin's and .cue's. After this (you might need to re-scrape your games so it associates the new filenames), the menu art should again work as expected: https://retropie.org.uk/docs/CHD-files/#creating-chds-from-cd-roms

Then, for multi-disc games, you can rename the .chd's to .cd1, .cd2 etc. (to hide them from the gamelist) and use .m3u playlist files to clean up your game list menu to one menu item per game. Another advantage of this is on-the-fly disc swapping through the Retroarch menu, and easier save file management (one save file per game, named after the .m3u playlist, instead of a separate file for each disc named after the disc): https://retropie.org.uk/docs/Playstation-1/#m3u-playlists-for-cue-bins-or-chds

@jmcdra I must have fixed something. It works

If you're using the EmulationStation scraper, then press Select on the game you want to scrape and select 'Edit this game's metadata', which opens a dialog that has the scrape option.

If you're using an external scraper, easiest would be to leave your favorites in the MAME folder or just move then to an arcade folder and scrape the folder. You can then add back the rest of the games.

@mitu thank you, that was the problem yes