RetroPie forum home
    • Register
    • Login
    • Search
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    1. Home
    2. Tags
    3. scraper
    Log in to post
    • All categories
    • kiro

      Detecting if retropie is installed on a remote machine
      Help and Support • scraper ssh detection • • kiro

      13
      0
      Votes
      13
      Posts
      72
      Views

      kiro

      @mitu nice one... My concern is about heavily customized setups (for example mine) where I have one directory per Arcade manufacturer (although they use the same emulator, they have a different theme setup for example), and directories do not necessarily match the system name, but I guess I can consider that as an edge case.

      Thanks Again!

    • 10vorne

      Could not install Scraper (Steven Selph)
      Help and Support • scraper • • 10vorne

      2
      0
      Votes
      2
      Posts
      56
      Views

      mitu

      It's an upstream problem, caused by one its dependencies. Use Skyscraper instead.

    • 10vorne

      Adding Scraper to Emulationstation
      Help and Support • scraper emulationstaton • • 10vorne

      14
      0
      Votes
      14
      Posts
      230
      Views

      sleve_mcdichael

      @10vorne said in Adding Scraper to Emulationstation:

      Can I read out with one command how much of the daily limit I have left?

      If you scrape a title from command-line, it's reported in the cache output after each game is scraped:

      pi@retropie:~ $ Skyscraper -p arcade -s screenscraper ~/RetroPie/roms/arcade/frogger.zip [...] Cache output: Video conversion: Success! 'screenscraper' requests remaining: 19999 #1/1, (1/0) Elapsed time : 00:00:22 Est. time left : 00:00:00
    • KpCollins

      Dragon 32 Scraper issues
      Help and Support • dragon32 scraper • • KpCollins

      6
      0
      Votes
      6
      Posts
      71
      Views

      kiro

      @KpCollins hi, could I ask you to try with the scraper I'm developing?
      https://github.com/zayamatias/retroscraper
      It should be working with dragon 32, although I have not tested it, so some testing would be appreciated.

      Thanks!

      *** Edit: just tried myself and it took less than 2 minutes to scan +530 ROMs, +400 succesfully found and video/image downloaded...

    • rasp_renegade

      Scraper crashes ES
      Help and Support • scraper • • rasp_renegade

      8
      0
      Votes
      8
      Posts
      143
      Views

      mitu

      @rasp_renegade said in Scraper crashes ES:

      . I had swapped gamelists and forgot, so disregard the part about old files. Anything else useful in that log?

      I don't see any issues in the log.

    • joe_Ch1p

      Scraping: “No Games Fit That Criteria”
      Help and Support • scraper • • joe_Ch1p

      4
      0
      Votes
      4
      Posts
      101
      Views

      mitu

      TheGamesDB site is now back online, scraping should work again with this source in EmulationStation.

    • Floob

      Scraping artwork on different regions EU/US/JPN
      Help and Support • region 50hz pal 1g1r scraper • • Floob

      6
      0
      Votes
      6
      Posts
      113
      Views

      Floob

      Thanks for all the suggestions. I should have no problem scraping the region artwork I'm after now.

    • atfrase

      Scraper UI development
      Ideas and Development • development scraper • • atfrase

      2
      0
      Votes
      2
      Posts
      111
      Views

      mitu

      There are no plans to 'retire' the built-in scraper, improvements are always welcomed.

    • Edgecrusher

      Emustation scraper/kid mode malfunction
      Help and Support • scraper kid mode emustation • • Edgecrusher

      3
      0
      Votes
      3
      Posts
      106
      Views

      Edgecrusher

      @iandaemon
      ok great info I didnt realize that
      thank you

    • fretman

      Is re-scraping a straight-forward process?
      Help and Support • scraper videos re-scraping setup • • fretman

      11
      0
      Votes
      11
      Posts
      297
      Views

      fretman

      @exarkuniv , sounds good…thanks.

    • nerevarine

      Selph Scraper Video Previews not working - yuv420p vs yuv444p?
      Help and Support • scraper video previews • • nerevarine

      2
      0
      Votes
      2
      Posts
      126
      Views

      sleve_mcdichael

      Put this in your /usr/local/bin folder and make it executable with chmod +x <filename>. Run it from your video folder. Your video files will not be overwritten. New files are saved to ./converted; to use them, you must move or copy one level up to replace the original files. Repeat for each system.

      You may need to install ffmpeg first with sudo apt update && sudo apt install ffmpeg.

      #! /bin/bash # Script provided by Clyde mkdir -p converted # create the folder "converted" if it doesn't exist for f in *.mp4 # process all videos in the current directory do echo "$(pwd)/$f" # show the processed file's name c=$(ffprobe "$f" 2>&1 | grep -c yuv444p) # (-c)ount no. of "444p" if [ "$c" -gt 0 ] # if 444p is present, then # convert to 420p ffmpeg -i "$f" -y -pix_fmt yuv420p -strict experimental converted/"$f" fi done
    • edillenback

      Skyscraper / Steven Selph's Scraper working on some builds and not others???
      Help and Support • scraper @skyscraper @coverart @rominfo stevenselph • • edillenback

      6
      0
      Votes
      6
      Posts
      360
      Views

      Drdave79

      @edillenback said in Skyscraper / Steven Selph's Scraper working on some builds and not others???:

      @drdave79 Just wish I had better news for you. I'm still having issues with both command line scrapers on anything but my existing build. The built-in GUI scraper does work and isn't bad after I took @mitu 's advice of unchecking the 'user decides on conflict' but that won't help you with videos.

      Has to be something about the build process on my end but I'm doing pure vanilla installs and still have no idea what it could be.

      Have you tried Skyscraper?

      Yes, I've tried both. Same result.

    • johnodon

      sselph scraper still not working
      Help and Support • sselph scraper • • johnodon

      2
      0
      Votes
      2
      Posts
      179
      Views

      johnodon

      UPDATE: I was wrong. The Windows version is also failing with the same error. I thought it was successful but it was actually using arcadeitalia as the source.

      FYI…the Windows EXE version still works so I guess I can at least use that for now.

    • Misfitz

      Video scrape doesn't show videos
      Help and Support • video scrape retropie steven selph sc scraper scraper video • • Misfitz

      3
      0
      Votes
      3
      Posts
      218
      Views

      Misfitz

      @sleve_mcdichael
      Thanks for your answer! I was trying to create the script and I couldn't cause I'm a newbie haha. But I figured out that I was using wifi + ethernet cable, I thought it could be the wifi connection, so I disconected it. After that I used the purge option and re-scrape again some platforms and it worked. Got almost every platform working, but I couldnt do it with nintendo 64, it just wont work. When I was scrapping, i got these error messages saying the servers were overloaded, but its okay for me.
      Thank you again !

    • enforcer

      Scraper - Some of your selected systems do not have a platform set
      Help and Support • emulationstaton scraper dragon32 xroar • • enforcer

      1
      0
      Votes
      1
      Posts
      197
      Views

      No one has replied

    • Emulatre71

      Scraper not working when attempting to scrape games for descriptions and boxarts.
      Help and Support • scrape issues scraper error database raspberry pi 4 • • Emulatre71

      10
      0
      Votes
      10
      Posts
      1390
      Views

      sleve_mcdichael

      @emulatre71 said in Scraper not working when attempting to scrape games for descriptions and boxarts.:

      I do have a question about those with bin/cue file formats for PS1. It appears like this because the folders are in the ps1 rom folder, I did not take the contents and just throw them straight into the directory because I like to keep things organized. Are they supposed to be in a folder with their respective bin/cue files?
      You don't see the scraper/boxart info until you click on it, this is how they appear so far.

      You can convert .bin/.cue sets to .chd using the CHDMAN tool, to clean up your folders to one file per disc (and potentially also save some space.) This will allow you to keep them all in the root psx folder without being too cluttered up with .bin's and .cue's. After this (you might need to re-scrape your games so it associates the new filenames), the menu art should again work as expected: https://retropie.org.uk/docs/CHD-files/#creating-chds-from-cd-roms

      Then, for multi-disc games, you can rename the .chd's to .cd1, .cd2 etc. (to hide them from the gamelist) and use .m3u playlist files to clean up your game list menu to one menu item per game. Another advantage of this is on-the-fly disc swapping through the Retroarch menu, and easier save file management (one save file per game, named after the .m3u playlist, instead of a separate file for each disc named after the disc): https://retropie.org.uk/docs/Playstation-1/#m3u-playlists-for-cue-bins-or-chds

    • jmcdra

      Adding custom box art to retropie?
      Help and Support • custom box art scraper • • jmcdra

      2
      0
      Votes
      2
      Posts
      122
      Views

      jmcdra

      @jmcdra I must have fixed something. It works

    • Agrajag

      Is it possible to use Scraper for one ROM only?
      Help and Support • scraper • • Agrajag

      2
      0
      Votes
      2
      Posts
      123
      Views

      mitu

      If you're using the EmulationStation scraper, then press Select on the game you want to scrape and select 'Edit this game's metadata', which opens a dialog that has the scrape option.

      If you're using an external scraper, easiest would be to leave your favorites in the MAME folder or just move then to an arcade folder and scrape the folder. You can then add back the rest of the games.

    • Gorf

      Having some problems scraping my SNES and MegaDrive collection
      Help and Support • megadrive scraper snes • • Gorf

      1
      0
      Votes
      1
      Posts
      134
      Views

      No one has replied

    • Patapain33

      Games scraped succesfuly but images and text won't show up
      Help and Support • scraper issue • • Patapain33

      3
      0
      Votes
      3
      Posts
      149
      Views

      Patapain33

      @mitu thank you, that was the problem yes