RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Rescrape Everything?

    Scheduled Pinned Locked Moved Help and Support
    sselph scraper
    3 Posts 2 Posters 756 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • J
      Jaxel
      last edited by

      I am using SSelph Scraper through the command line to scrape my ROM directories... This is what I am currently using:

      /opt/retropie/supplementary/scraper/scraper
       -workers="6"
       -missing="missing.txt"
       -use_nointro_name="false"
       -ss_user="**********"
       -ss_password="**********"
       -console_src="ss"
       -console_img="b"
       -download_images="true"
       -download_marquees="true"
       -download_videos="true"
       -image_dir="boxarts"
       -image_path="./boxarts"
       -image_suffix=""
       -img_format="png"
       -marquee_dir="marquees"
       -marquee_path="./marquees"
       -marquee_format="png"
       -marquee_suffix=""
       -video_dir="videos"
       -video_path="./videos"
       -video_suffix=""
      

      It works reasonably well enough for most consoles. Downloads boxes, screenshots and videos. However, for some consoles, such as the GBA, 50% of the games don't have boxarts or videos. I assume this is because the data is still being populated by the community and that stuff takes time. Because of this, every month or so, I plan on rerunning the scrape to download what is missing.

      What would be the best way to do this? The simplest way would be to delete all the images and gamelist.xml and scrape again. However, for the games I already have boxarts, screenshots and videos, I would rather not redownload those. Is there something I can do to have it rescrape all the meta data, but don't download assets it already has?


      Another problem I am having... For a lot of my games, they are using the wrong titles. For instance, for Resident Evil 2 for the N64, its listing the game as Biohazard 2 instead. For Paper Mario, its listing it as Mario Story. Why is it using the foreign names, even though it should be using the English names?

      jonnykeshJ 1 Reply Last reply Reply Quote 0
      • jonnykeshJ
        jonnykesh @Jaxel
        last edited by

        @jaxel -append If the gamelist file already exist skip files that are already listed and only append new files.
        https://retropie.org.uk/forum/topic/4227/how-to-scrape-using-sselph-scraper-tutorial-with-command-examples/2

        J 1 Reply Last reply Reply Quote 0
        • J
          Jaxel @jonnykesh
          last edited by Jaxel

          @jonnykesh but the game is already in the gamelist... its only images/video which are missing. Wouldn't -append skip the game completely, and not check to see if it has new images/videos?

          1 Reply Last reply Reply Quote 0
          • First post
            Last post

          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.