Scraper not getting all.

Clyde · 31 Dec 2018, 15:35

@ucald4amarine In addition to @mitu's request, can you give us the output of ffprobe with one of the videos in question? Example:

ffprobe /home/pi/RetroPie/roms/arcade/images/005-video.mp4

If you can't copy the output from Retropie's console easily, you could redirect the output to a text file by adding 2> textfile.txt to the command.

ffprobe /home/pi/RetroPie/roms/arcade/images/005-video.mp4 2> textfile.txt

Then you could access that file to show us its contents.

ucald4amarine · 31 Dec 2018, 17:24

@mitu just tried running the command. And was given the message: permission denied. (I started in emulation station, hit f4, and typed the command there.)

ucald4amarine · 31 Dec 2018, 17:27

@Clyde can't seem to get those commands to work. An additional mystery, every time Ive started the arcade up before running the scraper, it would play a random video on startup. (Set it on random and gave it 5 vids to go through. ) Now, after running the scraper, it will only play the one video, and the sound is really bad. Dunno if it has anything to do with this. But it seems odd.

mitu · 31 Dec 2018, 17:29

@ucald4amarine That's not a command, but a file. You're suppose to get its contents uploaded to pastebin.com, not to execute it. Copy it to your ROMs folder and then open it from your PC with Notepad and upload it to pastebin.com

cp ~/.emulationstation/es_log.txt ~/RetroPie/roms

Clyde · 31 Dec 2018, 17:29

@ucald4amarine Mitu didn't give you a command. Do you mean mine?

However, please be more elaborate about how you "can't seem to get those commands to work".

May you have mistyped them? What errors came up?

ucald4amarine · 31 Dec 2018, 17:30

@mitu correction on my part. I thought arcade games were playing on the menu. I was wrong. Fba games were playing, but NOTHING from arcade will display. Almost like the scraper didn't collect dfeom there at all.

ucald4amarine · 31 Dec 2018, 17:32

@mitu ahh. Sorry mitu. I'll try to find that in a bit. Kids are up and hungry.

Clyde · 31 Dec 2018, 17:35

@ucald4amarine said in Scraper not getting all.:

Fba games were playing, but NOTHING from arcade will display. Almost like the scraper didn't collect dfeom there at all.

Are there any video files in arcade/images?

Is there a text file named gamelist.xml in arcade?

If so, are there <video> tags for the videos in the gamelist.xml file?

ucald4amarine · 31 Dec 2018, 17:54

@Clyde I think I saw a game list file, don't remember the rest. I'll check on that asap

ucald4amarine · 31 Dec 2018, 21:08

@Clyde On that, it just popped up with: Permission Denied. That was all.

ucald4amarine · 31 Dec 2018, 21:13

@Clyde In answer to your question on the video files. There is indeed a game list. and an image file. The image file is full of images for the game. As far as the gamelist.xml, it is there. And the <video> tag is there as well. Ill copy and paste it below:

<marquee>./images/aburner-marquee.png</marquee>
	<video>./images/aburner-video.mp4</video>
	<cloneof>aburner2</cloneof>

Thats what your looking for correct?

ucald4amarine · 31 Dec 2018, 21:17

@mitu Im not sure how to go about your instructions. Am I litterally supposed to copy cp ~/.emulationstation/es_log.txt ~/RetroPie/roms into the roms file?
Once again, please forgive my lack of knowledge.

ucald4amarine · 31 Dec 2018, 22:09

Just out of interest, I went ahead and pulled up the scraper again and told it to scrape the games using alternate sources. (Screenscraper, Arcadetalia, Etc.) and I watched the system do its thing. I observed that it blasted through the entire arcade listing, didnt throw a single error message. Whereas the games in other systems that it had skipped over previously, (battletoads in the megadrive for example.) it showed an error message and skipped to the next.

ucald4amarine · 1 Jan 2019, 00:14

new info to share. Ive pulled 3 different videos from the Pi and put them on my computer to watch.
1, bubsy, works. And Im able to view it as an mp4.
2, afterburner, calls itself a mp4, will play sound, but no more.
3, battletoads, again, an mp4, when I try to play it comes up with an error stating that the file is unsupported, or the file is corrupt.

ucald4amarine · 1 Jan 2019, 04:43

@ucald4amarine solved! Deleted all videos, rescrapped from the source: screenscraper. And, it still doesn't have all games. But it has enough that I'm happy. Or, happier.

Clyde · 1 Jan 2019, 08:41

@ucald4amarine That's nice to hear. Some games can be missing because their checksum isn't included in the scraping source. You could try to scrape them manually from within Emulation Station. It doesn't scrape videos, though. So, you would have to add them manually from YouTube etc.

Happy new year!

ucald4amarine · 1 Jan 2019, 20:17

@Clyde that's an idea. There really aren't many missing. But a simple scrape from an alternate source wouldn't take more than a hour or so of my time. That's great! Thanks everyone!

Clyde · 1 Jan 2019, 20:49

@ucald4amarine said in Scraper not getting all.:

@Clyde But a simple scrape from an alternate source wouldn't take more than a hour or so of my time.

Then it remains an option for those games which aren't included in any of the online databases. Glad that you like it. :)