• 0 Votes
    4 Posts
    616 Views
    D

    @sleve_mcdichael said in 32x Game Titles showing rom symbols after scraping:

    Are you running SS through the setup script or from the command-line? If script, do you have generate options >> remove bracket info (enabled)? (This is global, but maybe if 32x is the only system you've scraped since it changed or something.)

    Beyond that, the contents of your /home/pi/.skyscraper/config.ini file might shed some light on what's happening. You can post it here if you can't make sense of it.

    ``` Use code blocks (start and end with three backticks on a new line) so special symbols aren't interpreted as formatting. _*[{}]*_ Or upload it to (edit:spelling) pastebin.com if it's very long. ```

    Yep toggling that option on solved it. Thanks!

  • Skyscraper cannot purge cache?

    Help and Support
    3
    0 Votes
    3 Posts
    736 Views
    ClassicGMRC

    I'd swear I did that... must have missed it. Will do first thing in the morning. :)

    EDIT: I just did the update. All good. Thanks @mitu !

  • 0 Votes
    9 Posts
    1k Views
    D

    @mitu Yep, same result as you. API issue. I'll wait it out. I'm sure they are trying to get their servers to behave.

    ------------------------------------------- Running Skyscraper v3.6.12 by Lars Muldjord ------------------------------------------- Platform: 'pcengine' Scraping module: 'screenscraper' Input folder: '/home/pi/RetroPie/roms/pcengine' Game list folder: '/home/pi/.emulationstation/gamelists/pcengine' Covers folder: '/home/pi/.emulationstation/downloaded_media/pcengine/covers' Screenshots folder: '/home/pi/.emulationstation/downloaded_media/pcengine/screenshots' Wheels folder: '/home/pi/.emulationstation/downloaded_media/pcengine/wheels' Marquees folder: '/home/pi/.emulationstation/downloaded_media/pcengine/marquees' Cache folder: 'cache/pcengine' Fetching limits for user 'devildog820', just a sec... Setting threads to 8 as allowed for the supplied user credentials. Reading and parsing quick id xml, please wait... Done! Reading and parsing resource cache, please wait... Done! Successfully parsed 0 resources! Looking for optional 'priorities.xml' file in cache folder... Found! Priorities loaded successfully! Trying to parse and load existing game list metadata... Success! Starting scraping run on 94 files using 8 threads. Sit back, relax and let me do the work! :) #12/94 (T3) Pass 1 ---- Game 'Bonk's Adventure (USA)' found! :) ---- Scraper: screenscraper From cache: NO Search match: 100 % Compare title: 'Bonk's Adventure' Result title: 'Bonk's Adventure' () Platform: 'PC Engine' () Release Date: '1990-01-01' () Developer: 'Atlus' () Publisher: 'Hudson' () Players: '1' () Ages: '' () Tags: 'Platform' () Rating (0-1): '0.8' () Cover: NO () Screenshot: NO () Wheel: NO () Marquee: NO () Description: () 'Bonk's Adventure is a prehistoric platform game where you are in control of a large bald headed caveman, guiding him through the levels taking out all manner of strange prehistoric creatures that get in your way including King Drools henchmen - all in effort to free the captured/controlled residents of Moonland (bosses) - including the Princess Za from King Drool attempted take over. The game is not unlike other platform games of the era. Though it's unique in that you can climb walls and swing on rope with your teeth and your only method of attack is head butting enemies - straight forward or dive bomb style. The game starts off with simplistic point A to point B style, but focuses more on exploration in the later stages, which include finding hidden bonus areas. The game is also known for its trademark gameplay mechanism of 'spin attack', where Bonk floats through the air if you have the turbo button on. This can be used to float around the level and reach areas for extra/hidden items, but also as a method of attack as well. The game starts you off with 3 hearts, but allows you to increase this number when you find special heart container items, allowing Bonk to take a number of hits before dying. A variety of bonus stages can be found throughout the game, which provide bonus points upon completion and thus resulting in accumulating extra lives. Enemies themselves can be 'milked' for points in that you can keep 'bonking' their dead bodies and not letting them hit the ground. Spin attack is another method for doing this.' 'screenscraper' requests remaining: 37193 #12/94, (12/0) Elapsed time : 00:00:42 Est. time left : 00:04:49
  • Mame-libretro marquee issue

    Help and Support
    3
    0 Votes
    3 Posts
    779 Views
    C

    @sleve_mcdichael said in Mame-libretro marquee issue:

    Theme: "TMNTurtleGuy/ComicBook" (/etc/emulationstation/themes/ComicBook). Same issue in "Arcade" (arcade/theme.xml and mame-libretro/theme.xml are identical).

    I think I found it. Edit your mame-libretro/theme.xml file with:

    sudo nano /etc/emulationstation/themes/ComicBook/mame-libretro/theme.xml

    Step 1, line 46:

    <image name "classic_logo" extra "false">

    Change "false" to "true".

    Step 2: comment or remove the "marquee" section from lines 60-64. Comment html with <!-- and -->, as in:

    <!-- <image name "md_marquee"> <pos>0.74 0.086</pos> <maxSize>0.26 0.1</maxSize> <origin>0.5 0.5</origin> </image> -->

    With these two changes, save the file and restart EmulationStation; you should be all set!

    arcade/theme.xml has a "marquee" section that genesis/theme.xml, for example, lacks. However, commenting out this section, while it did remove the marquee game logo, also removed the system logo from behind it.

    In addition, line 46 is set differently between the two. Changing this from "false" to "true" restored the system logo.

    Additional notes:

    I think wheels and marquees are enabled by default, so you need to explicitly make them "false" (not just comment out the "true") in config.ini if you don't want to download them.

    You have marquees disabled in the command-line options; however, while that game logo is called "marquee" by EmulationStation, it's the "wheel" art from the scraper that goes here. So if you wanted to disable these logos, you need to disable "wheels" in the scraper instead of "marquees." Then you'll need to purge your cache of the already-downloaded wheel arts.

    Of course, this isn't necessary now that you know how to fix the theme, but just for general knowledge.

    I appreciate you helping me understand the difference between the marquees and wheel arts. I did what you said there and it fixed it! Thank you!

    I've updated my config.ini to not cache marquees and wheelarts for now. Thank you again!

  • Skyscraper help

    Help and Support
    2
    0 Votes
    2 Posts
    404 Views
    muldjordM

    @aaronc75 Could you provide more information about how you have setup Skyscraper? That path to the media looks strange. It seems you have relative paths turned on, but I don't understand why it says ./downloaded_images as the media path.

    What are the permissions of the ./downloaded_images folder itself?

  • Skyscraper request: tg16 platform

    Help and Support
    6
    0 Votes
    6 Posts
    767 Views
    S

    I got it working, basically. inputFolder=, et al, were the answer.

    .skyscraper/config.ini:

    # ... [pcengine] # use "tg16" folders for pce/tg16 titles inputFolder="/home/pi/RetroPie/roms/tg16" gameListFolder="/home/pi/.emulationstation/gamelists/tg16" mediaFolder="/home/pi/.emulationstation/downloaded_media/tg16" cacheFolder="/home/pi/.skyscraper/cache/tg16" # importFolder="/home/pi/.skyscraper/import/tg16" # ...

    Then I moved everything around in my filesystem to match these changes.

    This allowed me to point .emulationstation/es_systems.cfg at the roms/tg16 folder and still have the gamelists display correctly in ES. I did have to clear out the tg16 videos from my media folder (symlinked to ones in cache/pcengine that no longer exist) and build the gamelist one more time to fix the links but after that, it works fine!

    cacheFolder and importFolder don't really affect the gamelist end result, I just included them so that if a proper tg16 platform ever is added, everything will already be in the right place. (Edit: Setting importFolder gave me an error that the path does not exist when I tried to --cache edit on a rom. Even though it doesn't exist for any of the other systems either, but since this one is defined specifically I guess it really wants it to exist. Commenting out that line eliminated the error.)

    There was one more hitch. The runcommand launch art doesn't use the <image> file defined in the gamelist, but rather looks for a file matching the rom's name, in a folder matching the system name called by the run command (in es_systems.cfg). The original solution, that I had done with Genesis/Megadrive, was just to symlink the media folder to one matching the run command named system. But in the interest of completeness, I now decided to go the other route and just change the run command to call the proper system instead. So I changed _SYS_ pcengine to _SYS_ tg16 and then all I had to do was copy the /opt/retropie/configs/pcengine folder to tg16 (symlinked, so as not to duplicate data unnecessarily. I could have just renamed them, but keeping the links intact for the config and rom folders, allows me to retain the dual nature of the systems, while simultaneously keeping it hidden beneath the surface.)

    Now I guess the only problem is it works so well on the surface, I keep forgetting and trying to use -p tg16 by accident :-S

    Edit: well there was a little more under the hood work involved in getting the system(s) fully switched over. Both emulators.cfg and retroarch.cfg reference a system folder, so I scrapped the symlinks and just renamed the config folders, then replaced all instances of "megadrive" or "pcengine" with "genesis" and "tg16" in those files. Bonus: I learned about the sed command:

    sed 's/<old_text>/<new_text>/g' <file>

    e.g.

    sed 's/\/pcengine\//\/tg16\//g' emulators.cfg

    ...prints the result to stdout. (I wanted to match the string /pcengine/ and not just pcengine just in case it was in an emulator's name or something. It looks like they all just said "pce" but it doesn't hurt to make sure.)

    You can pipe it to an output file with > <file> e.g.

    sed 's/\/pcengine\//\/tg16\//g' emulators.cfg > emulators.cfg.new

    ...or

    sed -i 's/\/pcengine\//\/tg16\//g' emulators.cfg

    ...modifies the original file with -i or --in-place.

  • 0 Votes
    2 Posts
    384 Views
    muldjordM

    @sleve_mcdichael Thanks for the detailed report. It has been fixed and will be in the next release.

  • 0 Votes
    10 Posts
    2k Views
    M

    @sleve_mcdichael Already there! ;). Keep the community alive!

  • 0 Votes
    12 Posts
    562 Views
    S

    @muldjord said in Skyscraper two ways: games beginning with "The", and config.ini settings not working:

    The cache saving issue I believe to be a problem on your end. As mentioned I haven't touched that code, and it works fine here.

    I believe the cache-saving error was closely related to the video-conversion error. The resource that couldn't be saved to the cache was the video that didn't get converted/copied. I only saw them together, and only in 3.6.8. Neither were present in 3.6.7, nor after today's 3.6.9 update, thank you!

    pi@retropie:~ $ Skyscraper -p arcade -s screenscraper /home/pi/RetroPie/roms/arcade/1942.zip --verbosity 3 ------------------------------------------ Running Skyscraper v3.6.9 by Lars Muldjord ------------------------------------------ Platform: 'arcade' Scraping module: 'screenscraper' Input folder: '/home/pi/RetroPie/roms/arcade' Game list folder: '/home/pi/.emulationstation/gamelists/arcade' Covers folder: '/home/pi/.emulationstation/downloaded_media/arcade/covers' Screenshots folder: '/home/pi/.emulationstation/downloaded_media/arcade/screenshots' Wheels folder: '/home/pi/.emulationstation/downloaded_media/arcade/wheels' Marquees folder: '/home/pi/.emulationstation/downloaded_media/arcade/marquees' Videos folder: '/home/pi/.emulationstation/downloaded_media/arcade/videos' Cache folder: 'cache/arcade' DID YOU KNOW: With the '--cache show' command line option, you can check the status of the resources that are cached for the platform you are scraping. Fetching limits for user 'REDACTED', just a sec... Setting threads to 2 as allowed for the supplied user credentials. Reading and parsing quick id xml, please wait... Done! Reading and parsing resource cache, please wait... Done! Successfully parsed 1700 resources! Resource cache stats for selected platform: 'esgamelist' module Titles : 72 Platforms : 72 Descriptions : 72 Publishers : 72 Developers : 71 Ages : 0 Tags : 72 Ratings : 71 ReleaseDates : 72 Covers : 0 Screenshots : 0 Wheels : 0 Marquees : 0 Videos : 0 'import' module Titles : 0 Platforms : 7 Descriptions : 0 Publishers : 0 Developers : 0 Ages : 0 Tags : 0 Ratings : 0 ReleaseDates : 0 Covers : 3 Screenshots : 3 Wheels : 3 Marquees : 2 Videos : 7 'screenscraper' module Titles : 73 Platforms : 73 Descriptions : 73 Publishers : 73 Developers : 72 Ages : 11 Tags : 73 Ratings : 72 ReleaseDates : 73 Covers : 72 Screenshots : 73 Wheels : 73 Marquees : 73 Videos : 72 Looking for optional 'priorities.xml' file in cache folder... Found! Priorities loaded successfully! Adding files from subdir: '/home/pi/RetroPie/roms/arcade/fbneo' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/memcard' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/nvram' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/ctrlr' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/hi' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/diff' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/comment' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/ini' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/input' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/image' Adding files from subdir: '/home/pi/RetroPie/roms/arcade/mame2010/cfg' Trying to parse and load existing game list metadata... Success! Starting scraping run on 1 files using 2 threads. Sit back, relax and let me do the work! :) cover: '2149208' > '323270', choosing resize for optimal result! marquee: '158970' > '107347', choosing resize for optimal result! #1/1 (T1) Pass 1 ---- Game '1942' found! :) ---- Scraper: screenscraper From cache: NO Search match: 100 % Compare title: '1942' Result title: '1942' () Platform: 'Capcom Classics' () Release Date: '1984-01-01' () Developer: 'Capcom' () Publisher: 'Capcom' () Players: '2' () Ages: '1+' () Tags: 'Shoot'em Up, Shoot'em up / Vertical' () Rating (0-1): '0.7' () Cover: YES () Screenshot: YES () Wheel: YES () Marquee: YES () Video: YES () Description: () '"1942" is a vertically-scrolling shoot-em-up set in the Pacific theatre during World War II, in which the goal is to reach Tokyo and destroy the entire Japanese air fleet. The player pilots a plane dubbed the "Super Ace" (its appearance is that of a Lockheed P-38 Lightning) and has to shoot down waves of enemy planes while avoiding incoming enemy fire. The 'Super Ace' can perform a limited number of rolls or 'loop-the-loops' to evade enemy planes and shots. During the game, waves of red enemy planes periodically appear. If the player manages to destroy a red wave, a power-up, in the form of a 'POW' symbol, will be dropped and can be picked up. The power-up will award either increased fire-power (doubling the player's guns from two to four), a smart bomb that destroys all on-screen enemy planes the instant it's collected, two wingmen planes that flank the Super Ace and increase fire power, or simply extra points. At the end of each stage the 'Super Ace' lands on an aircraft carrier and bonus points are awarded based on player performance. "1942" differs from other games in that its levels are numbered in reverse order, so the game begins at stage 32 and ends at stage 1.' Cache output: Video conversion: %i: '/opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4' %o: '/opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/tmpfile_769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4' Running command: 'videoconvert.sh /opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4 /opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/tmpfile_769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4' Converting video... Source: /opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4 Dest: /opt/retropie/configs/all/skyscraper/cache/arcade/videos/screenscraper/tmpfile_769ccf601a52d89cec19168a8bf3df6351a9a0f5.mp4 Video is in correct 420p format. Copying as is... Success! Debug output: Tried with: 'crc=F52D7D3C&md5=89625F073887A5915C3CE2E2E4DA8875&sha1=BF332AC22C7FDB5470AFF4172A9051555E6E1266&romnom=1942.zip&romtaille=106788' Platform: arcade #1/1, (1/0) Elapsed time : 00:00:11 Est. time left : 00:00:00 ---- Resource gathering run completed! YAY! ---- Writing quick id xml, please wait... Done! Writing 1700 (0 new) resources to cache, please wait... Done! ---- And here are some neat stats :) ---- Total completion time: 00:00:11 Average search match: 100% Average entry completeness: 100% Total number of games: 1 Successfully processed games: 1 Skipped games: 0 (Filenames saved to '/home/USER/.skyscraper/skipped-arcade-screenscraper.txt') pi@retropie:~ $

    No apparent errors. Thanks again!

  • 0 Votes
    3 Posts
    1k Views
    S

    @drdave79
    You've already enabled OMX player, right? First guess then would be the videos have downloaded, but are in another format like yuv444p while they need to be in yuv420p (or at least that is one that is known to work.) If so, there's a simple script that can convert them for you when downloaded.

    Check first: locate a game that doesn't show a video. Navigate to where the video should be, at:

    /home/pi/.emulationstation/downloaded_media/<platform>/videos/<romname>.mp4

    If the file exists, check it out with ffprobe (may require sudo apt install ffmpeg first):

    ffprobe "filename.mp4" 2>&1 | grep Stream

    Output will look something like:

    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv444p, 360x480 [SAR 1:1 DAR 3:4], 349 kb/s, 30 fps, 30 tbr, 15360 tbn, 60 tbc (default) Stream #0:1(und): Audio: mp3 (mp4a / 0x6134706D), 24000 Hz, stereo, fltp, 64 kb/s (default)

    See in the Video stream where it says yuv444p, 360x480? That's bad, we want it to say yuv420p instead.

    Sounds like you? Good. This post on GitHub discusses the solution. TL;DR version after:

    https://github.com/muldjord/skyscraper/issues/222

    The quick version:

    Edit your /home/pi/.skyscraper/config.ini to include the line:

    videoConvertCommand="videoconvert.sh %i %o"

    Script provided by jgcobra on the GitHub thread:

    #! /bin/bash # Script provided by jgcobra echo Converting video... echo Source: $1 echo Dest: $2 # Check if the video is already in 420p format c=$(ffprobe "$1" 2>&1 | grep -c yuv420p) if [ "$c" -eq 0 ] then echo Incorrect source video format detected. Converting video to 420p format... ffmpeg -i "$1" -y -pix_fmt yuv420p -acodec copy -strict experimental "$2" else echo Video is in correct 420p format. Copying as is... cp "$1" "$2" fi

    Place the script in your system path or in /home/pi/.skyscraper and make it executable with chmod +x videoconvert.sh. If you want to see the script's output when run by Skyscraper, I think you need to put verbosity="3" in your config.ini.

    I think this check/conversion only happens on initial caching of the video, so re-scrape your roms with --cache refresh to force a re-download and, for maximum efficiency, you can use --flags skipexistingcovers and similar to avoid unnecessarily redownloading those media.

    This solved probably 90% of my problem videos. There were a handful that didn't take and I had to do a little extra fiddling, but this should get you started.

    Don't forget to rebuild your gamelist.

  • Skyscraper messing up game names

    Help and Support
    11
    0 Votes
    11 Posts
    1k Views
    T

    @sleve_mcdichael thanks for taking the time to explain this :)

  • 0 Votes
    4 Posts
    1k Views
    E

    @sleve_mcdichael @mitu thanks for the help. I reversed all the changes I made except for the location of the cache, just like in @sleve_mcdichael's example. Everything seems to be working now.

  • 0 Votes
    3 Posts
    441 Views
    S

    @mitu said in runcommand launch art and Skyscraper images:

    Are you sure you're modifying the right file ? The file in the $HOME/Retropie-Setup is not used at runtime, it's just the source, when installed it's copied in /opt/retropie/supplementary/runcommand - which is used to for launching.

    Aha, yes I was modifying the one in $HOME. I’ll try the one in /opt tomorrow and see if that does the trick.

    Edit: I snuck a peek while closing up for the night and that was it, thanks for the tip! Now I wonder if there’s a way to get the transparent background to display as black instead of that light grey...

  • 0 Votes
    14 Posts
    2k Views
    muldjordM

    @sleve_mcdichael

    Default will skip roms that have any piece of data from this source, and “only missing” will skip roms that have any piece of data from any source?

    Yes, I had actually forgotten that point, it's quite an important distinction.

    And you're welcome. Have fun with it!

  • 0 Votes
    3 Posts
    2k Views
    muldjordM

    @iron-magus said in Running skyscraper from command line and need help[:

    (Also, you MIGHT not need the trailing “nes” in the gamelist and media folders, I think it’s implied. At least it is when setting them via config.ini in the main section, but not in a platform section. If your xml shows up in “gamelists/nes/nes” go ahead and just point them at “gamelists”/“downloaded_media”; it should automatically use a “<platform>” subfolder for each different one.)

    When setting them on command-line the nes part is required. :) It is similar to setting it in a [nes] section in /home/USER/.skyscraper/config.ini.

    @Gorf The credentials in /home/USER/.skyscraper/config.ini will be used if they are added using this exact formar:

    [screenscraper] userCreds="USER:PASSWORD"

    I would also set the following which allows you to leave out the -g and -o part of your command:

    [main] gameListFolder="/home/pi/.emulationstation/gamelists" mediaFolder="/home/pi/.emulationstation/downloaded_media"

    Setting those in [main] will automatically add the /nes part to the end of them as @iron-magus explained.

    Lastly, you don't need the -t 2 option when using ScreenScraper. It will overwrite it anyway. It is usable with other sources though.

  • 0 Votes
    17 Posts
    2k Views
    hawkes_84H

    @mitu yes in this case "tweaking" does refer to uncommenting all the lines which I read was necessary when doing this. I'll re-comment them and see what happens . Thanks!

  • Skyscraper .ini editing for network share.

    Help and Support
    4
    0 Votes
    4 Posts
    270 Views
    mituM

    @raulitob said in Skyscraper .ini editing for network share.:

    And that works great but my question is do I need to add that to the skyscraper config file as well?

    No, you don't need to.

  • 0 Votes
    7 Posts
    875 Views
    mituM

    I tried using inputFolder for both [nes] and [atari2600], but neither seemed to do much

    The scraping dialog that you start from RetroPie-Setup doesn't read your .ini file to look for folders, but expects the standard RetroPie folder structure.

    If you changed the folder in the .ini file, run the scraper manually:

    /opt/retropie/supplementary/skyscraper/Skyscraper -p nes -s screenscraper ... other flags ...

    EDIT: just to make it easier, you can probably symlink the folders from your SMB mounted drive to the actual RetroPie folders, i.e.

    /mount/network/Arcade -> $HOME/RetroPie/roms/arcade /mount/Consoles/Atari Xyx -> $HOME/RetroPie/roms/atari5200 /mount/Consoles/Nintendo Entertainment System -> $HOME/RetroPie/roms/nes etc.
  • 0 Votes
    4 Posts
    324 Views
    muldjordM

    @maschine You need to import them into the Skyscraper cache before regenerating the gamelists. Read how to do that here.

    EDIT: Haha, just noticed you already commented about that yourself. Oh well.