@tomfury said in Skyscraper: Recommended workflow for skipping roms that does not exist on scraper source:

If I change the filename for a rom, then I would have to manually edit the gamelist.xml (and cache/<platform>/quickid.xml) to keep the mappings intact?

You can do that if you are interested in keeping any details in the gamelist.xml such as play count in tact.

Skyscraper should just add a new lines for the new names in the quickid.xml and the old names would just become irrelevant. I recently transferred the quickid.xml files from one system to another along with the cache folder to avoid having to re-scrape my roms. Then I realized I had some different rom files on the second system and Skyscraper just made extra lines for the files it didn't recognize and didn't try to scrape the ones that didn't exist anymore.

@mitu

Wow! At some point I did disable the save on exit setting. Thank you.

@waitingmoon I've adapted the changes submitted by @Zigurana and eagle0wl and submitted a new PR, which was accepted recently.

If you're using RetroPie, you can install the emulationstation-dev package (from the experimental packages section) and try it out.

@mitu said in EmulationStation Marquee Bug (with work-around):

EDIT: Try the Magazine Madness theme, it has support for marquees in Detailed view.

You're correct @mitu. Just tried in both Detailed and Automatic views and without videos referenced, the marquees do indeed appear.

For each theme I used that exhibits the problem, the marquee section is under <view name = "video">. Updating the themes, including Carbon, by moving the marquee section under <view name = "Detailed"> works (and would seem to be a more common scenario).

Seems that many themes used Carbon as a baseline and have marquee under the video view section. Easy to fix (or change, if it was what the author intended).

Thank you, as always.

Please add some info about your setup, as detailed in https://retropie.org.uk/forum/topic/3/read-this-first.

Did you run a scrape before trying to generate the gamelist ? Do you have any amiga data (art/text) in your cache ?

@johnodon PR created: https://github.com/RetroPie/EmulationStation/pull/767

johnodon created this issue in RetroPie/EmulationStation closed Update FileSystemUtil.cpp - Allow for multilevel absolute paths in gamelist.xml #767

Most likely the .xml you created is not correct. If you look in the es_log.txt logfile (you can find it in \\retropie\configs\all\emulationstation) you'll see any errors from parsing the gamelist.xml (careful, not gamelink.xml).

Post the gamelist.xml on pastebin.com to take a look.

@muldjord
Thank you for your answer. And congratulations on your fantastic work on the Skyscraper, the best multi-platform scraping tool, in my opinion.

Actually, I'm not very comfortable with the process of adding a .m3u file to each of my 2500+ individual Amstrad CPC games (or to every game in my other retro-collections).

And, @mitu, I'm not comfortable neither with the idea of adding a non-standard extension to my games, just to have ES showing the .m3u playlists only. I understand that ".cd1", ".cd2", etc. are like a standard now in PSX multi-disc games, but I suspect a home-made ".dsm", ".disk1" or whatever I could invent in my room for Amstrad CPC/MSX/other Libretro would drive me to a lot of issues when I update/scrape/configure something in the future. The same applies to hidden folders: if I want to update the scraping info, I would have to rename the folder before, re-hide the folder after... Even the idea to manage ".disk1" or ".disk2" sounds laborious when you have hundreds of folders, thousands of files...

But, I still think one scrapped entry in ES for a multi-disc game sounds like the most elegant solution.

So, I share here the solution I took:
1- As mentioned before, I create a .m3u playlist for each multi-disc game and put all the files, including the .m3u, inside a folder with the same basename (I do this with the script in my first post)

2- As @mitu told me, I edit the Skyscraper's config.ini to add the .m3u extension at the platform I want to scrap.

3- I scrap everything. So regular files, regular files in subfolders, and .m3u files get an image+description in gamelist.xml.

4- I duplicate the information related to the .m3u files in the gamelist.xml to create new <folder> sections with the same scraped information. Here is the command lines I used to do this:

# extract the XML sections about .m3u files to a new tmp.xml file perl -ne 'BEGIN{$/="</game>\n";} print m|(<game>.*m3u.*$/)|ms' gamelist.xml >> tmp.xml # change any <game> tag to a <folder> tag sed -i .bak "s/<game>/<folder>/g" tmp.xml # change any </game> tag to a </folder> tag sed -i .bak "s/<\/game>/<\/folder>/g" tmp.xml # crop any .m3u filename to keep the path only sed -i .bak 's/\/[[:alnum:][:blank:]\.\+\&,\(\);_-]*.m3u//g' tmp.xml # delete the closing tag at the end of gamelist.xml sed -i .bak '/^<\/gameList>/d' gamelist.xml # add the content of tmp.xml to the end of gamelist.xml cat tmp.xml >> gamelist.xml # add the closing tag at the end of gamelist.xml echo "</gameList>" >> gamelist.xml

And I must say, I'm quite happy with the result : now I have in ES only one scraped entry for any mono-disc game as I have one scraped entry for any subfolder (multi-disc game). When I select a game that is a multi-disc game, It opens the sublist - that is also scraped with the same information - and I just have to select the first entry to run the game.

I hope all this sounds useful.

EmulationStation will use the gamelist.xml ROMs folder, if found, otherwise it looks in /opt/retropie/configs/all/emulationstation/gamelists/<system>. The 2 files are not combined, just one of them is used, in that order.

If you enabled the 'Use Local Art' option in EmulationStation's settings, it will try find a video matching the game by looking under roms/<system>/media/<ROM_NAME>-video.mp4, so even if there's no video declared in gamelist.xml, it might still find a video associated with it.

In fact, what would be the best way to ensure that I get both videos and correct information into my setup?

Don't mix the scrapers if you want video - the internal scraper doesn't support videos so it might overwrite the video tags if you re-scrape with it. Use the external scraper and see which videos have issues - some arcade videos are incompatible with RPI's hardware video codecs and might not play correctly.

@mitu

Thanks Mitu. I ended up using locate to find any corresponding gamelist.xml for the Naomi folder(s) and wiped them, then I just started from scratch, adding one game at a time and it looks like it finally took the information. I must have missed something in there, but just copy/pasting by hand finally nixed the issue.

It was so weird. Before that it was even naming stuff totally wrong. Like I had MegaMan 3 for NES Playchoice listed in the Naomi folder. And a LOT of the games were being listed as Power Instinct, which is not on the Naomi. No idea why it was generating games that weren't in the folder at all.

As @YFZdude mentioned, the genesis folder is a symlink (shortcut) to the megadrive folder, so there's no need to remove it - it's not actually taking any space. You can leave it as is, it's ok - the scriptmodules expect a megadrive ROM folder and updating the MD emulators will re-create the folder.

@SeraphisCain Thanks - there is a gamelist there, but the titles on it are not the ones affected by the issue. There are only a handful of titles and there's no metadata defined. A red herring, I'm afraid.

I appreciate your help, but I'm ready to give up. I don't think it's going to get worked out.

Thanks anyway.

@IanDaemon that's exactly what I plan to use it for. All of the game sequels done with Roman Numerals can be displayed as the publishers intended but also in sequential order.

@thelostsoul said in Gamelist Addon - an assist tool to manually add new game entries:

About the automation, yes I want that implemented in the main app too someday. Just in case you did miss it,

I actually did miss it. Thanks for the directions.

I have finally resolved it myself: the Bash Script itself was named "Master Edition" by accident, which led to this particular gamelist entry being ignored, with the bash script name being shown as the title instead, and since it has been ignored - no video.
Can be closed, but I will not delete this for now, in case anyone else encounters this or some of the friendly users who answered want to know where this went.

Just saw this app related to this topic. Its not exactly what I am looking for, just want to link it here: RetroPi Media - gamelist.xml generator

Hi,
yeah, it's definitely the correct gamelist.xml

I switched on my PC today, and the problem remained.
So, in an effort to find the exact sequence to trigger this, I built a test .emulationstation folder from scratch. 3 roms, 1 system, 1 hidden rom.

And, it worked perfectly. <hidden>true</hidden> tags hid the one hidden rom.
So, I put back my original .emulationstation folder.

And, now, <hidden> works fine for me.

No other changes were made. (I renamed the folder, and just named it back)
So.
Not sure what to say to you guys now!

If I can reproduce it in future, I'll note how I did it.
Some of the time in the last day or two, I enabled Kiosk sometimes via the UI, and sometimes by editing the .cfg file by hand.
I didn't think ES wrote any changes apart from into the .emulationstation folder.
Each time though, like I said, I could see <hidden> was true in the entry, in Full mode.
And Kiosk was enabled properly, since I couldn't make any UI changes.

In my software, I'm going to add support for hiding certain genre's, and that should complete the work on it for the time being, I think.