Scraping newly added games

mediamogul

You can run it again and it'll just overwrite everything. Personally, I just ran Steven Selph's scraper the one time and have been using Emulation Station's built-in scraper as I add ROMs.

cyperghost

@chigundo Or let scripts do the work for you.
the runcommand-onend.sh can help to automatically scrape every game started. You just have to setup a small script ...

Some examples of what can be done with these scripts:
In the Take and Scrape Your Own Screenshots wiki there are two methods to achieve the same goal. In method 1 the runcommand-onstart.sh is used to automatically set some configurations in the system specific retroarch.cfg file. In method 2 the runcommand-onend.sh is used to check if you have a screenshot for the game you are leaving, and if yes, it will make the most recent screenshot be the emulationstation image for this game.

Clyde

@mediamogul said in Scraping newly added games:

@chigundo

You can run it again and it'll just overwrite everything.

Isn't that only the case if the option "Gamelist" is set to "Overwrite"? Set to "Append", it should only scrape the missing roms, or do I miss something?

mediamogul

@clyde

I would think so. When I last scraped my collection two years ago, overwrite was the default behavior.

Clyde

@mediamogul Yes, Overwrite being the default is what I remember, too. Thanks for the quick answer.

@chigundo So, changing the Gamelist option in the scraper menu to Append should do the trick. But backup your gamelist.xml file(s) first to be on the safe side.

chigundo

Okay making progress. New questions. Using Selph's scraper, I managed to scrape everything with videos. Initially I used ArcadeItalia as the database for the arcade games, which worked mostly but not with the hardware accelerator on, I then re-scraped with ScreenScraper and most of them work perfectly now. However, there are several games I've found missing the art, description, and video. How do I troubleshoot these? I'll use Indiana Jones Temple of Doom as example.

<game>
<path>./indytemp.zip</path>
<name>Indiana Jones and the Temple of Doom</name>
<desc>long description here..

</desc>
<image>./images/indytemp-image.jpg</image>
<video>./images/indytemp-video.mp4</video>
<rating>0.7</rating>
<releasedate>19850101T000000</releasedate>
<developer>Atari</developer>
<publisher>Atari</publisher>
<genre>Fight / Action / Labyrinth / Action</genre>
<players>2</players>
<playcount>3</playcount>
<lastplayed>20180117T125228</lastplayed>
</game>

I've confirmed those two files, indytemp-image.jpg and indytemp-video.mp4 are in the appropriate images folder with the roms directory. Any advice?

Clyde

@chigundo: If some videos are only missing when you use the hardware accelerated OMX player, it may be that those videos are encoded in a format that OMX can't play. A common format that's not supported by OMS is yuv444p.

See these threads for scripts that convert all of your yuv444p videos into the omx-supported yuv420p:

https://retropie.org.uk/forum/topic/15362/here-s-a-script-to-batch-convert-yuv-4-4-4-videos-to-yuv-4-2-0-in-retropie-linux (converts only yuv444p into yuv420p)

https://retropie.org.uk/forum/topic/15764/script-retropie-convert-videos (converts [some format] in [some other format])

Apart from that, did you check if the images and videos in question are valid, e.g. by viewing them on your PC?

chigundo

Yes I checked them on my pc and they work. Which is concerning because if I try to convert the videos, what’s the explanation for a simple Jpg not showing.

Clyde

@chigundo said in Scraping newly added games:

Yes I checked them on my pc and they work. Which is concerning because if I try to convert the videos, what’s the explanation for a simple Jpg not showing.

If there is a video for the game, the image won't be shown. If the video isn't supported by OMX player, it might play just a black video. So, you may see the image if you delete or rename the video, or delete the <video> tag in the gamelist.xml.

I suggest that you check that before you conclude that there's a problem with the image.

hiulit

In case anyone in this thread is interested, I just released v2.1.0 of RetroPie Convert Videos.