Scraping Ports and PSX not working in RetroPie Steven Selph Scraper
-
Hello.
I have been having an unusual issue with Scraper v(Git) by Steven Selph. I know that the source thegamesdb longer works. So I use ScreenScraper as it scrapes everything else.
So my issue is I cannot scrape PSX (PS1) games or the Ports. The scraper acts like those folders don't exist. So when you click on (Scrape all systems) those two don't show in the list.Just to make clear of what I did I'll explain.
- I pressed F4 to exit Emulationstation
- Entered sudo RetroPie-Setup/retropie_setup.sh into the terminal
- Gone to: Manage packages / Manage optional packages / scraper / Configuration / Options
It will scrape in this order on what I have added. (Scrape all systems) Steven Selph
atari2600/gb/gba/fds/megadrive/mastersystem/megadrive/n64/nes/pc/arcade/psp/snes/virtualboyAs you can see it doesn't try to scrape Ports or PSX it just say's (ROMS have been scraped). Also, it apparently does megadrive twice.
Things I have tried.
Changed Arcade Source, Console Source, ROM Names, Enabled/Disabled Use roms folder, Scrape chosen systems,
Deleted the scraper and all contents including the gameslist.XML files and images,
sudo-apt get update
sudo-apt get upgrade
Update RetroPie-Setup script
Update scraper to the latest versionNothing works. I've done all these multiple times and the results are always the same. Like I said. Everything else scrapes with images and meta but those two.
Right now I manually made my own gameslist.xml files and images folder and that works but that's only a temporary solution.
Everything else on the Raspberry Pi 3B works like a charm including the Desktop. It's just this scraper that has this issue.Almost forgot. It won't scrape RetroPie when you have it set to Roms folder. So that was another I did manually.
When your in RetroPie and you bring up MAIN MENU / SCRAPER that does not work anymore. It does say SCRAPE FROM THEGAMESDB. It won't let me change it so I take it that's why it won't work.I added the log. rps_2018-07-16_100513.log
rps_2018-07-16_100513.logThe only things I changed in this log was:
I deleted all the games it scraped but only one in that category and changed them to say (NAME_OF_ROM)
everything else is exactly how it was created including the blank
2018/07/16 10:06:48 arcade srcs: ss
2018/07/16 10:06:48 console srcs:
Sections.Logs were found in.
/home/pi/RetroPie-Setup/logs/rps_2018-07-16_002735.log.gzSo I'm at a loss. Is it possible that something is missing for the scraper to read a line to command it to scrape that section??
Because when it scrapes it say's arcade srcs: ss then console srcs: then scrapes that section. Maybe it's missing? If this is the case, how can I command it to do it?Thanks for taking the time to read my issue. I hope this is a simple fix.
-
@destructiveburn Ports are not supported by the scraper and for the PSX you need to have the games in .bin/.cue format. How are your PS1 games stored ? The log file you provided shows not
psx
folder. -
Hello. @mitu
I installed a fresh copy of Retropie (completely updated), and before installing the fresh copy, it was scraping Ports and PSX.
The Meta for Ports and PSX (gamelist.xml) files and images are actual copies of the old install it scraped. I used them because the scraper on this install is not doing its job.PSX games are stored in /home/pi/RetroPie/roms/psx
In there is the gamelist.xml, images folder, and games. As I said before. It's not even attempting to find the folder. It did scrape, .PBP before this copy. I have tried bin, cue, iso and it still won't attempt to find the folder as you can see in the log I provided.Is there a file to till the scraper to look for that folder?
-
@destructiveburn You could run the scraper from the command line - manually - and force it to check the
psx
folder. More details are in the scraper's wiki pages of the project - https://github.com/sselph/scraper/wiki. -
@mitu Instructions are not clear on that.
I have no idea how. -
@destructiveburn said in Scraping Ports and PSX not working in RetroPie Steven Selph Scraper:
@mitu Instructions are not clear on that.
I have no idea how.In this case, use the default built-in scraper.
-
I was following instructions to it. https://github.com/sselph/scraper
Rpi v2
$ wget https://github.com/sselph/scraper/releases/download/<release_name>/scraper_rpi2.zip
$ sudo unzip scraper_rpi2.zip scraper -d /usr/local/bin/cd RetroPie
cd roms
ls (shows directory)
cd psx
scraper -thumb_onlyIt appears that thegamesdb.net isn't up. If you are sure it is use -skip_check to bypass this error.
No sources available (As I already know this was an issue some time ago)I saw he posted 3 days ago
Thanks for the heads-up. It looks like it has changed. I'll convert the
code over this weekend.
https://github.com/sselph/scraper/issues/230So I'm going to do a bit of waiting and see.
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.