RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Built in scrapper hit or miss?

    Scheduled Pinned Locked Moved Help and Support
    scraper
    21 Posts 5 Posters 645 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • T
      tackett1980 @quicksilver
      last edited by

      @quicksilver

      Roger that. That’s what I suspected, just wanted to confirm.

      1 Reply Last reply Reply Quote 0
      • T
        tackett1980 @quicksilver
        last edited by

        @quicksilver

        Well, that sucked

        I installed skyscraper and it doesn’t work. It just gives me a red error message something about “non-registered users” and just goes back to the setup screen.

        What gives?

        quicksilverQ 1 Reply Last reply Reply Quote 0
        • quicksilverQ
          quicksilver @tackett1980
          last edited by

          @tackett1980 sign up for a free account on screenscrapers website. Then edit the skyscraper config.ini and add your new login info. When the screenscraper website is overloaded it will deny requests from unregistered users.

          T 1 Reply Last reply Reply Quote 0
          • T
            tackett1980 @quicksilver
            last edited by tackett1980

            @quicksilver

            Is that screenscraper.fr?

            Never mind I got it. Thanks.
            Now to figure out how to get skyscraper to actually take my authentication.

            quicksilverQ 1 Reply Last reply Reply Quote 0
            • quicksilverQ
              quicksilver @tackett1980
              last edited by quicksilver

              @tackett1980 go to the skyscraper config.ini and add

              [screenscraper]
              userCreds="user:password"
              

              When you start scraping from screenscraper you should notice text pop up that you are logged in under your user name

              T 1 Reply Last reply Reply Quote 0
              • T
                tackett1980 @quicksilver
                last edited by

                @quicksilver

                Thanks sir. I got it figured out thanks to you.

                Unfortunately, though it seemed like it was working and it ran all day long scraping without any errors, I don’t see where it actually did anything.

                My games are still blank, there are no videos downloaded that I can see.

                Just like most of the things with retropie.... I can say, “what did I screw up this time?”

                Btw I used the etaprime tutorial video on YouTube to do this.

                quicksilverQ nightbirdmediaN 2 Replies Last reply Reply Quote 0
                • quicksilverQ
                  quicksilver @tackett1980
                  last edited by

                  @tackett1980 did you generate your gameslist after you scraped?

                  T 1 Reply Last reply Reply Quote 0
                  • T
                    tackett1980 @quicksilver
                    last edited by

                    Yeah and when I do it’s saying “game xxxx not found”

                    And it’s not like they obscure games.

                    One line says “game ‘pacman’ not found. I find that difficult to understand.

                    1 Reply Last reply Reply Quote 0
                    • T
                      tackett1980
                      last edited by

                      I think it has something to do with my sub folder setup.

                      When I scraped my NES roms directory it did every single one no issue.

                      1 Reply Last reply Reply Quote 0
                      • GreenHawk84G
                        GreenHawk84
                        last edited by

                        I was actually able to scrape with the internal scraper last night via Screenscraper. I was beyond happy at that moment.

                        T 1 Reply Last reply Reply Quote 0
                        • T
                          tackett1980 @GreenHawk84
                          last edited by

                          @GreenHawk84

                          Actually it didn’t work.

                          It downloaded some descriptions but not videos.

                          I wonder if I’m out of space.

                          mituM 1 Reply Last reply Reply Quote 0
                          • mituM
                            mitu Global Moderator @tackett1980
                            last edited by

                            @tackett1980 said in Built in scrapper hit or miss?:

                            It downloaded some descriptions but not videos.

                            The built-in scraper doesn't download videos, only artwork and information (description, genre, title, rating, publisher, etc.)

                            T 1 Reply Last reply Reply Quote 2
                            • T
                              tackett1980 @mitu
                              last edited by

                              @mitu

                              I was referring to skyscraper. Sorry for the confusion.

                              quicksilverQ 1 Reply Last reply Reply Quote 0
                              • quicksilverQ
                                quicksilver @tackett1980
                                last edited by

                                @tackett1980 it doesn't download videos by default, did you turn the option on to download videos?

                                T 1 Reply Last reply Reply Quote 0
                                • T
                                  tackett1980 @quicksilver
                                  last edited by

                                  @quicksilver

                                  Yeah I did it seems like it only downloaded a few videos from my arcade folder up to about “P” and stopped.

                                  I need to back up and punt here I think...

                                  I need to get all these roms organized before I start worrying about scraping them .

                                  1 Reply Last reply Reply Quote 1
                                  • nightbirdmediaN
                                    nightbirdmedia @tackett1980
                                    last edited by

                                    @tackett1980 said in Built in scrapper hit or miss?:

                                    It's not you. I just ran it myself and it did nothing, In fact it actually removed some of my artwork I had previously for games. lol

                                    None of the scrapers have been working for me for a week now. I even tried to add manual artwork to my games but that wasn't working like it should have either.

                                    T 1 Reply Last reply Reply Quote 0
                                    • T
                                      tackett1980 @nightbirdmedia
                                      last edited by tackett1980

                                      @nightbirdmedia

                                      Yeah I’m starting to get the feeling that this screenscraper database source is just spotty.

                                      I ran skyscraper again last night and it looks like it just randomly decided which ones it wanted to do and which ones it didn’t.

                                      Then I tried to run the internal scraper and now it’s not working again either. Everything just says no games found.

                                      I’m going to start looking for a windows scraper that might use a more reliable database.

                                      quicksilverQ 1 Reply Last reply Reply Quote 0
                                      • quicksilverQ
                                        quicksilver @tackett1980
                                        last edited by

                                        @tackett1980 are you using a login when scraping from screenscraper?

                                        T 1 Reply Last reply Reply Quote 0
                                        • T
                                          tackett1980 @quicksilver
                                          last edited by

                                          @quicksilver

                                          Yes I made an account a while back and it’s in the skyscraper config.

                                          1 Reply Last reply Reply Quote 0
                                          • First post
                                            Last post

                                          Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                          Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.