RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping totally fails

    Scheduled Pinned Locked Moved Help and Support
    skyscraperscraperthegamesdbscreenscraper
    17 Posts 9 Posters 3.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • QuackwalksQ
      Quackwalks @beppi
      last edited by

      @beppi What I do Is back up my roms directory into a windows folder. In Skraper, you can change the settings to use the windows directory and it'll still output game lists that work for retropie. I just put my game lists in my rom directories, then a folder in each system for the snaps and box arts. After you're done scraping, transfer your game lists and scraped media to your raspberry pi where they should go.

      Sorry I can't help with the details, but I know this method works with enough tinkering.

      B CrushC 2 Replies Last reply Reply Quote 1
      • B
        beppi @Quackwalks
        last edited by beppi

        @Quackwalks this is indeed the only solution i found so far, but it's not a complete solution because some information is missing, for example the information about the location of videos and screenshots, and Skyscraper was also creating a composition with the box for the screenshot that was integrated with the theme. Of course it's not a big deal but I would like to understand why Skyscraper cannot connect from raspi.
        I feel that I could fix this problem if I only had some kind of log, monitor, or anything else, do you know if there is a log somewhere? I could not find it.

        YFZdudeY 1 Reply Last reply Reply Quote 0
        • YFZdudeY
          YFZdude @beppi
          last edited by YFZdude

          @beppi
          There should be logs anytime something fails to scrape with skyscraper in the /home/pi/.skyscraper folder.

          B 1 Reply Last reply Reply Quote 0
          • CrushC
            Crush @Quackwalks
            last edited by Crush

            @Quackwalks said in Scraping totally fails:

            @beppi What I do Is back up my roms directory into a windows folder. In Skraper, you can change the settings to use the windows directory and it'll still output game lists that work for retropie. I just put my game lists in my rom directories, then a folder in each system for the snaps and box arts. After you're done scraping, transfer your game lists and scraped media to your raspberry pi where they should go.

            Sorry I can't help with the details, but I know this method works with enough tinkering.

            Just make a network drive on windows out of \\retropie\roms so you can scrape using screenscraper on windows directly instead of having to transfer back and forth.

            QuackwalksQ 1 Reply Last reply Reply Quote 0
            • B
              beppi @YFZdude
              last edited by beppi

              @YFZdude thank you, unfortunately there's nothing, because there's no error in Skyscraper: it just receives the information "not found", appearantly. I watched by capturing in real time written files both on .skyscraper directory, and on /var/log, and no log is being generated.

              B 1 Reply Last reply Reply Quote 0
              • B
                beppi @beppi
                last edited by

                Thanks all for answering me, unfortunately there's no solution right now.
                I make you just one question: are you able to scrape with Skyscraper from inside raspberry, on screenscraper.fr or do you get the same error "game not found"? thank you

                kiroK 1 Reply Last reply Reply Quote 0
                • kiroK
                  kiro @beppi
                  last edited by

                  @beppi trybtjis, it may work...https://github.com/zayamatias/retroscraper

                  1 Reply Last reply Reply Quote 0
                  • FloobF
                    Floob @beppi
                    last edited by

                    @beppi
                    FWIW I use Skraper and scrape on windows, then just copy across the files.
                    I do that so I can copy it across to any destination quickly - so you only need to scrape once really.
                    The paths are all relative, so you dont need to change them

                    For example:
                    <image>./media/boxart2d/3-D Tic-Tac-Toe (USA).png</image> <marquee>./media/wheel/3-D Tic-Tac-Toe (USA).png</marquee> <video>./media/videos/3-D Tic-Tac-Toe (USA).mp4</video>

                    So in Skraper, the video path would be:
                    %ROMROOTFOLDER%\media\videos

                    Same as @Quackwalks really.

                    Please read the Docs before asking a new question.
                    RetroPie Help Guides: https://goo.gl/3gcNsT

                    B 1 Reply Last reply Reply Quote 1
                    • B
                      beppi @Floob
                      last edited by

                      @Floob i fixed the problem. On retropie it still fails, but I mounted a disk in a Linux distribution and using the bind option I recreated the needed directory tree and run Skyscraper from there. It works, so it's obvious that there is a problem on my raspberry but I don't have any tool to address it. Thank you

                      kiroK 1 Reply Last reply Reply Quote 0
                      • kiroK
                        kiro @beppi
                        last edited by

                        @beppi could it be a permissions issue in your rpi? Pi user does not have write rights on the mount ?

                        1 Reply Last reply Reply Quote 0
                        • QuackwalksQ
                          Quackwalks @Crush
                          last edited by

                          @Crush That is also an option, but sometimes I'd rather get everything scraped on a separate hard drive. Just makes me feel more secure in various ways. I'm probably just silly.

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post

                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.