Scraping Mame roms using skyscraper v3.3.5
-
Hi
Pi Model or other hardware: Raspberry Pi 3B+
Power Supply used: Official Pi Power Supply
RetroPie Version Used 4.5.1
Skyscraper v3.3.5My question is regarding to scraping rom names and videos.
Rom names are listed as name.zip etc
When rom images are scraped it changes the names to the official name plus the version eg Robocop (Japan) , 19XX: The War Against Destiny (USA 951207) , 1942 (First Version)
When rom videos are scraped it changes it to just the name eg Robocop , 1942 etc so there would be three or four roms with the same name.
Is there any settings in Skyscraper which can scrape the name and version with the videos?
Or do I just need to go through and edit the gamelist.xml manuallyRegards
Jimi
-
This post is deleted! -
Are you using the
--symlink
option? Then that might be the reason.EDIT: No, that's probably not it. I have been rummaging through the code for the video export and it uses the complete basename + video format suffix as filename. I have no idea how you have managed to make it save it without that.
EDIT2: Actually, rereading your question again, I am not sure exactly what you are asking. Are you talking about filenames or gamelist names? If you are talking about gamelist names, what do you mean by:
When rom videos are scraped it changes it to just the name eg Robocop , 1942 etc so there would be three or four roms with the same name.
? What does it change? The video export filename? Or the gamelist filename? And if so, what does that have to do with the video file? I am confused.
-
@muldjord I'll try and explain it a bit better.
So I basically scraped Roms using just the image option.
I then ran the create gamelist
When I load retropie and view the mame list it displays the Rom names with the type after.
E.g. 1942 (japan) and shows a picture of the gameThen I rename the gamelist.xml file
I run the scraper with the video option.
It scrapes the game names and downloads the game videos.
When I view the mame list it shows the video and displays the Rom name without the type after e.g. 1942.It may not be the scraper itself but where it gets the info from.
Hope this helps
Thanks
Jimi -
You must have something set up that I am unaware of. I just tested it with and without the
--videos
option and i get, for instance,<name>Mortal Kombat III (Europe)</name>
both with and without that option. Do you perhaps use the--nobrackets
option somewhere? That will remove everything inside()
and[]
. But this is unrelated to the--videos
option. Maybe there's an error in the RetroPie script that add the--nobrackets
option whenever the--videos
option is enabled. Do you run it from command-line or from the RetroPie script? -
I gave it a test trying to reproduce an error and I don't see anything related to videos to alter the default behavior. I.e.
- have 2 different ROMs -
1942.zip
and1942w.zip
- scraping (with or without videos) results in them having the title changed to
1942
- video path is different, based on the ROMset name:
<path>/home/pi/RetroPie/roms/arcade/1942.zip</path> <name>1942</name> <cover /> <image>/home/pi/RetroPie/roms/arcade/media/screenshots/1942.png</image> <marquee>/home/pi/RetroPie/roms/arcade/media/marquees/1942.png</marquee> <video>/home/pi/RetroPie/roms/arcade/media/videos/1942.mp4</video> <rating>0.8</rating> <desc>"1942" is a vertically-scrolling shoot-em-up set in the Pacific theatre during World War II, in which the goal is to reach Tokyo and destroy the entire Japanese air fleet. The player pilots a plane dubbed the "Super Ace" (its appearance is that of a Lockheed P-38 Lightning) and has to shoot down waves of enemy planes while avoiding incoming enemy fire. The 'Super Ace' can perform a limited number of rolls or 'loop-the-loops' to evade enemy planes and shots. During the game, waves of red enemy planes periodically appear. If the player manages to destroy a red wave, a power-up, in the form of a 'POW' symbol, will be dropped and can be picked up. The power-up will award either increased fire-power (doubling the player's guns from two to four), a smart bomb that destroys all on-screen enemy planes the instant it's collected, two wingmen planes that flank the Super Ace and increase fire power, or simply extra points. At the end of each stage the 'Super Ace' lands on an aircraft carrier and bonus points are awarded based on player performance. "1942" differs from other games in that its levels are numbered in reverse order, so the game begins at stage 32 and ends at stage 1.</desc> <releasedate>19840101T000000</releasedate> <developer>Capcom</developer> <publisher>Capcom</publisher> <genre>Shoot'em up / Vertical, Shoot'em Up</genre> <players>2</players> <kidgame>true</kidgame> </game> <game> <path>/home/pi/RetroPie/roms/arcade/1942w.zip</path> <name>1942</name> <cover /> <image>/home/pi/RetroPie/roms/arcade/media/screenshots/1942w.png</image> <marquee>/home/pi/RetroPie/roms/arcade/media/marquees/1942w.png</marquee> <video>/home/pi/RetroPie/roms/arcade/media/videos/1942w.mp4</video> <rating>0.8</rating> <desc>"1942" is a vertically-scrolling shoot-em-up set in the Pacific theatre during World War II, in which the goal is to reach Tokyo and destroy the entire Japanese air fleet. The player pilots a plane dubbed the "Super Ace" (its appearance is that of a Lockheed P-38 Lightning) and has to shoot down waves of enemy planes while avoiding incoming enemy fire. The 'Super Ace' can perform a limited number of rolls or 'loop-the-loops' to evade enemy planes and shots. During the game, waves of red enemy planes periodically appear. If the player manages to destroy a red wave, a power-up, in the form of a 'POW' symbol, will be dropped and can be picked up. The power-up will award either increased fire-power (doubling the player's guns from two to four), a smart bomb that destroys all on-screen enemy planes the instant it's collected, two wingmen planes that flank the Super Ace and increase fire power, or simply extra points. At the end of each stage the 'Super Ace' lands on an aircraft carrier and bonus points are awarded based on player performance. "1942" differs from other games in that its levels are numbered in reverse order, so the game begins at stage 32 and ends at stage 1.</desc> <releasedate>19840101T000000</releasedate> <developer>Capcom</developer> <publisher>Capcom</publisher> <genre>Shoot'em up / Vertical, Shoot'em Up</genre> <players>2</players> <kidgame>true</kidgame> </game>
So, if the problem is the title (name) change, then this is the default - the title from the scraping site (stored in the cache) is added to the gamelist.
@Jimi007 did you use different scraping sources for the 2 scraping sessions ? Maybe one scraper has the title as is (i.e. including regional info), while ScreenScraper (which I've used) does not include Region info in the title (since it's stored separately).
- have 2 different ROMs -
-
I may have to test again. Not sure why the names turned out different.
I am using the Screenscraper source for both options.
Two roms below 1942a.zip and 1942b.zip@muldjord - I used the Retropie GUI to perform the scraping. First I used the option and had videos disabled
2nd run I enabled the video option and I used Screenscraper for bothBelow is my results first from scraping without videos just images
<game> <path>/home/pi/RetroPie/roms/mame-libretro/1942a.zip</path> <name>1942 (Revision A)</name> <cover /> <image>/home/pi/.emulationstation/downloaded_media/mame-libretro/screenshots/1942a.png</image> <marquee>/home/pi/.emulationstation/downloaded_media/mame-libretro/marquees/1942a.png</marquee> <video /> <rating>0.8</rating> <desc>This Arcade Video game was published 35 years ago: 1942 (c) 1984 Capcom. 1942 is a vertically-scrolling shoot-em-up set in the Pacific theatre during World War II, in which the goal is to reach Tokyo and destroy the entire Japanese air fleet. The player pilots a plane dubbed the "Super Ace" (its appearance is that of a Lockheed P-38 Lightning) and has to shoot down waves of enemy planes while avoiding incoming enemy fire. The 'Super Ace' can perform a limited number of rolls or 'loop-the-loops' to evade enemy planes and shots. During the game, waves of red enemy planes periodically appear. If the player manages to destroy a red wave, a power-up, in the form of a 'POW' symbol, will be dropped and can be picked up. The power-up will award either increased fire-power (doubling the player's guns from two to four), a smart bomb that destroys all on-screen enemy planes the instant it's collected, two wingmen planes that flank the Super Ace and increase fire power, or simply extra points. At the end of each stage the 'Super Ace' lands on an aircraft carrier and bonus points are awarded based on player performance. 1942 differs from other games in that its levels are numbered in reverse order, so the game begins at stage 32 and ends at stage 1.</desc> <releasedate>19840101T000000</releasedate> <developer>Capcom</developer> <publisher>Capcom</publisher> <genre>Shooter / Flying Vertical</genre> <players>2</players> <kidgame>true</kidgame> </game> <game> <path>/home/pi/RetroPie/roms/mame-libretro/1942.zip</path> <name>1942 (Revision B)</name> <cover /> <image>/home/pi/.emulationstation/downloaded_media/mame-libretro/screenshots/1942.png</image> <marquee>/home/pi/.emulationstation/downloaded_media/mame-libretro/marquees/1942.png</marquee> <video /> <rating>0.8</rating> <desc>This Arcade Video game was published 35 years ago:
2nd one below is from the scrape with the video option
<releasedate>19870101T000000</releasedate> <developer /> <publisher /> <genre /> <players /> </game> <game> <path>/home/pi/RetroPie/roms/mame-libretro/1942b.zip</path> <name>1942</name> <cover /> <image>/home/pi/.emulationstation/downloaded_media/mame-libretro/screenshots/1942b.png</image> <marquee>/home/pi/.emulationstation/downloaded_media/mame-libretro/marquees/1942b.png</marquee> <video>/home/pi/.emulationstation/downloaded_media/mame-libretro/videos/1942b.mp4</video> <rating>0.8</rating> <desc>"1942" is a vertically-scrolling shoot-em-up set in the Pacific theatre during World War II, in which the goal is to reach Tokyo and destroy the entire Japanese air fleet. The player pilots a plane dubbed the "Super Ace" (its appearance is that of a Lockheed P-38 Lightning) and has to shoot down waves of enemy planes while avoiding incoming enemy fire. The 'Super Ace' can perform a limited number of rolls or 'loop-the-loops' to evade enemy planes and shots. During the game, waves of red enemy planes periodically appear. If the player manages to destroy a red wave, a power-up, in the form of a 'POW' symbol, will be dropped and can be picked up. The power-up will award either increased fire-power (doubling the player's guns from two to four), a smart bomb that destroys all on-screen enemy planes the instant it's collected, two wingmen planes that flank the Super Ace and increase fire power, or simply extra points. At the end of each stage the 'Super Ace' lands on an aircraft carrier and bonus points are awarded based on player performance. "1942" differs from other games in that its levels are numbered in reverse order, so the game begins at stage 32 and ends at stage 1.</desc> <releasedate>19840101T000000</releasedate> <developer>Capcom</developer> <publisher>Capcom</publisher> <genre>Shoot'em up / Vertical, Shoot'em Up</genre> <players>2</players> <kidgame>true</kidgame> </game> <game> <path>/home/pi/RetroPie/roms/mame-libretro/1942a.zip</path> <name>1942</name> <cover /> <image>/home/pi/.emulationstation/downloaded_media/mame-libretro/screenshots/1942a.png</image> <marquee>/home/pi/.emulationstation/downloaded_media/mame-libretro/marquees/1942a.png</marquee> <video>/home/pi/.emulationstation/downloaded_media/mame-libretro/videos/1942a.mp4</video> <rating>0.8</rating>
For some reason the 2nd run lost the revision of the names.
Regards
Jimi
-
I have no clue what is going on. The only thing that I can think of that can cause that is the
--nobrackets
option. I can't reproduce it here on my setup, so I can't even help you beyond what I've already mentioned I'm afraid.EDIT: I'm not sure how advanced you are ready to go with this (I don't know your technical skill level), but it would be useful to have a look at your cache to see where those
()
actually come from. Running Skyscraper from command-line you can get a listing of all resources connected to the file. It is documented here. Please read the first few paragraphs on how to run it from command-line since you've installed it from the RetroPie script, and check further down for the--cache edit <FILENAME>
description. It will allow you to list all resources connected to the file. Of course all of this will have to be done through an ssh session or from a local terminal.EDIT2: The output of
-p fba --cache show
for the platform might also be useful -
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.