RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Retropie wont scrape anything

    Scheduled Pinned Locked Moved Help and Support
    scraper problemretropie 4.7.1
    8 Posts 3 Posters 1.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      copywizard
      last edited by

      Hello i,am new to this forum and seek help.

      I have played around years back with retopie and just now picked it up again.

      I,am using a raspberry pi 4 (4GB) and the latest version of retropie (4.7.1) downloaded from this website.

      I did a clean install and updated retropie thru the setup script to the latest build.

      Then i added my games i have a NAS where i store all my roms in my own directly structure.

      So after adding this rom folder using this link [https://retropie.org.uk/docs/Running-ROMs-from-a-Network-Share/](link url)

      Then i edited the es_systems.cfg to match my roms directories so far so good everything works great i added all bios files and all 27 systems work fine for now i can play games and do everything until.... i try to scrape anything using any scraper available.

      So when i try to use the build in scraper it finds nothing not with gamesdb nor with screenscraper and this is for all systems no exceptions.

      then i tried Steven scraper with no luck and same goes for skyscrapper none of the scrappers work.

      So my question is i would really like to have the build in scraper work for me to get those nice images for retropie.

      if you need anything from my setup i would be happy to provide you with it like logs or error messages if there are any.

      just to be sure the share on the NAS is set to read/write i have tested this by creating a directory myself (i needed sudo to do it but it worked) furthermore after installing some additional emulators like redream the es_systems.cfg was updates to include dreamcast after a reboot and the directory named dreamcast was added by retropie to my NAS.
      I have changed this again in the es_systems.cfg to be "sega dreamcast" instead of dreamcast but this makes me think if retropie can create a directory then it must have write access to my share on my NAS so i thinks its not a rights issue.

      Any help would be appreciated!

      Pi Model or other hardware: Raspberry Pi 4 4GB
      Power Supply used: 3A power supply
      RetroPie Version Used: 4.7.1
      Built From: retropie-buster-4.7.1-rpi4_400.img
      USB Devices connected: Rapoo wireless keyboard
      Controller used: 8Bitdo sn30 Pro
      Error messages received: No games were scraped
      Verbose log (if relevant): No idea where to find this?
      Guide used: multiple
      Emulator: all

      1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator
        last edited by

        @copywizard said in Retropie wont scrape anything:

        Then i edited the es_systems.cfg to match my roms directories so far so good everything works great i added all bios files and all 27 systems work fine for now i can play games and do everything until.... i try to scrape anything using any scraper available.

        That may be the cause for your issue, the scrapers use the system's name (folder) to know which system to query on the source site. Keep the default system names and try to scrape again - do you get the same errors ?

        C 1 Reply Last reply Reply Quote 0
        • C
          copywizard @mitu
          last edited by

          @mitu

          Thank you for the quick reply!

          I have tested this but changing the name back from like Nintendo Snes to just Snes in the es_systems.cfg did nothing.

          But apparently it fixed itself this morning I tried to scrape some games using de games DB and I got the same results but when I switched to screenscraper it worked!

          I think because I did to much requests to screenscraper because of stevens scraper of sky scraper I was blocked from there api?

          Anyway I also created an account on the screenscraper site is there anyway to add this account to the build in retropie scraper? Or is this only possible using skyscraper or Steven scraper?

          Anyway thanks alot for this great product!

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @copywizard
            last edited by

            @copywizard said in Retropie wont scrape anything:

            But apparently it fixed itself this morning I tried to scrape some games using de games DB and I got the same results but when I switched to screenscraper it worked!

            Yeah, magically.

            I think because I did to much requests to screenscraper because of stevens scraper of sky scraper I was blocked from there api?

            Scraping sources have limits, ScreenScraper has a daily quota, GamesDB has a monthly one (last time I looked).

            Anyway I also created an account on the screenscraper site is there anyway to add this account to the build in retropie scraper? Or is this only possible using skyscraper or Steven scraper?

            I'm not sure if Steven's scraper supports user/password, but for Skyscraper you can add the user/password in the configuration file - https://github.com/muldjord/skyscraper/blob/master/docs/CONFIGINI.md.

            I 1 Reply Last reply Reply Quote 0
            • I
              IGA @mitu
              last edited by

              @mitu Hello
              Could you say in which file \config contains path of pictures (preview \ thumbnails)?

              Аs a result of some of my actions, I've lost pictures of half of my systems, but their files are still located in /opt/retropie/configs/all/emulationstation/downloaded_images/megadrive for example... But the not displayed emustation menu

              mituM 1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator @IGA
                last edited by

                @iga How is this related to the current topic ?

                I 1 Reply Last reply Reply Quote 0
                • I
                  IGA @mitu
                  last edited by IGA

                  @mitu i thought this discussion about scrapper problems....
                  (cause i can't scraped it again - it's not saved)

                  mituM 1 Reply Last reply Reply Quote 0
                  • mituM
                    mitu Global Moderator @IGA
                    last edited by

                    @iga Please open your own new topic.

                    1 Reply Last reply Reply Quote 0
                    • First post
                      Last post

                    Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                    Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.