RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    Scraping Ports and PSX not working in RetroPie Steven Selph Scraper

    Scheduled Pinned Locked Moved Help and Support
    steven selph scscraping ports
    7 Posts 2 Posters 2.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      DestructiveBurn
      last edited by DestructiveBurn

      Hello.

      I have been having an unusual issue with Scraper v(Git) by Steven Selph. I know that the source thegamesdb longer works. So I use ScreenScraper as it scrapes everything else.
      So my issue is I cannot scrape PSX (PS1) games or the Ports. The scraper acts like those folders don't exist. So when you click on (Scrape all systems) those two don't show in the list.

      Just to make clear of what I did I'll explain.

      1. I pressed F4 to exit Emulationstation
      2. Entered sudo RetroPie-Setup/retropie_setup.sh into the terminal
      3. Gone to: Manage packages / Manage optional packages / scraper / Configuration / Options

      It will scrape in this order on what I have added. (Scrape all systems) Steven Selph
      atari2600/gb/gba/fds/megadrive/mastersystem/megadrive/n64/nes/pc/arcade/psp/snes/virtualboy

      As you can see it doesn't try to scrape Ports or PSX it just say's (ROMS have been scraped). Also, it apparently does megadrive twice.

      Things I have tried.
      Changed Arcade Source, Console Source, ROM Names, Enabled/Disabled Use roms folder, Scrape chosen systems,
      Deleted the scraper and all contents including the gameslist.XML files and images,
      sudo-apt get update
      sudo-apt get upgrade
      Update RetroPie-Setup script
      Update scraper to the latest version

      Nothing works. I've done all these multiple times and the results are always the same. Like I said. Everything else scrapes with images and meta but those two.

      Right now I manually made my own gameslist.xml files and images folder and that works but that's only a temporary solution.
      Everything else on the Raspberry Pi 3B works like a charm including the Desktop. It's just this scraper that has this issue.

      Almost forgot. It won't scrape RetroPie when you have it set to Roms folder. So that was another I did manually.
      When your in RetroPie and you bring up MAIN MENU / SCRAPER that does not work anymore. It does say SCRAPE FROM THEGAMESDB. It won't let me change it so I take it that's why it won't work.

      I added the log. rps_2018-07-16_100513.log
      rps_2018-07-16_100513.log

      The only things I changed in this log was:
      I deleted all the games it scraped but only one in that category and changed them to say (NAME_OF_ROM)
      everything else is exactly how it was created including the blank
      2018/07/16 10:06:48 arcade srcs: ss
      2018/07/16 10:06:48 console srcs:
      Sections.

      Logs were found in.
      /home/pi/RetroPie-Setup/logs/rps_2018-07-16_002735.log.gz

      So I'm at a loss. Is it possible that something is missing for the scraper to read a line to command it to scrape that section??
      Because when it scrapes it say's arcade srcs: ss then console srcs: then scrapes that section. Maybe it's missing? If this is the case, how can I command it to do it?

      Thanks for taking the time to read my issue. I hope this is a simple fix.

      mituM 1 Reply Last reply Reply Quote 0
      • mituM
        mitu Global Moderator @DestructiveBurn
        last edited by

        @destructiveburn Ports are not supported by the scraper and for the PSX you need to have the games in .bin/.cue format. How are your PS1 games stored ? The log file you provided shows not psx folder.

        1 Reply Last reply Reply Quote 0
        • D
          DestructiveBurn
          last edited by DestructiveBurn

          Hello. @mitu

          I installed a fresh copy of Retropie (completely updated), and before installing the fresh copy, it was scraping Ports and PSX.
          The Meta for Ports and PSX (gamelist.xml) files and images are actual copies of the old install it scraped. I used them because the scraper on this install is not doing its job.

          PSX games are stored in /home/pi/RetroPie/roms/psx
          In there is the gamelist.xml, images folder, and games. As I said before. It's not even attempting to find the folder. It did scrape, .PBP before this copy. I have tried bin, cue, iso and it still won't attempt to find the folder as you can see in the log I provided.

          Is there a file to till the scraper to look for that folder?

          mituM 1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @DestructiveBurn
            last edited by

            @destructiveburn You could run the scraper from the command line - manually - and force it to check the psx folder. More details are in the scraper's wiki pages of the project - https://github.com/sselph/scraper/wiki.

            D 1 Reply Last reply Reply Quote 0
            • D
              DestructiveBurn @mitu
              last edited by

              @mitu Instructions are not clear on that.
              I have no idea how.

              mituM 1 Reply Last reply Reply Quote 0
              • mituM
                mitu Global Moderator @DestructiveBurn
                last edited by

                @destructiveburn said in Scraping Ports and PSX not working in RetroPie Steven Selph Scraper:

                @mitu Instructions are not clear on that.
                I have no idea how.

                In this case, use the default built-in scraper.

                1 Reply Last reply Reply Quote 0
                • D
                  DestructiveBurn
                  last edited by

                  I was following instructions to it. https://github.com/sselph/scraper

                  Rpi v2
                  $ wget https://github.com/sselph/scraper/releases/download/<release_name>/scraper_rpi2.zip
                  $ sudo unzip scraper_rpi2.zip scraper -d /usr/local/bin/

                  cd RetroPie
                  cd roms
                  ls (shows directory)
                  cd psx
                  scraper -thumb_only

                  It appears that thegamesdb.net isn't up. If you are sure it is use -skip_check to bypass this error.
                  No sources available (As I already know this was an issue some time ago)

                  I saw he posted 3 days ago
                  Thanks for the heads-up. It looks like it has changed. I'll convert the
                  code over this weekend.
                  https://github.com/sselph/scraper/issues/230

                  So I'm going to do a bit of waiting and see.

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post

                  Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                  Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.