Making premade gamelist.xml with xtra media collections
-
Oh.... BTW....
I've been in the middle of re-writing the synopsis files so they work better with RetroPie. (Not only because of memory constraints, but nobody wants to read a slowly scrolling novel for a game description either). You've probably read that I'm doing anything necessary to reduce the file size for each game to only 1kb or less. Sometimes, this requires me to re-word some of the descriptions, but I'm taking extra care to make them still be great descriptions for each game.
The original file size for all NES synopsis files was somewhere around 3.40MB for only 1,700 or so games. Right now, the file size is 1.79MB for 2,020 games and shrinking. :)
Can't wait to see what this all looks like after re-running your script when the edits are done!
-
@used2berx Well I finally got through the rewrites, and the file size is now 1.57MB. So even though there is 300-400+ more games than used to be in the collection, the file size of the
gamelist.xmlis going to be about 2.1MB less than it used to be. -
@meleu Hey man.
I've begun my testing on the Pi Zero for the NES games, and so far so good with that. 100% of them play even on a Pi Zero with at least one of the 3 emulators. (Default being quicknes of course.... and only about 100 of the US Licensed games. I'm assuming I'm going to run into a lot of problems when we start getting into hacks, translations, pirates, etc.).
Before I go to bed, I'm going to re-run the script with all the new synopsis files with the FULL command and see what happens with the script as is. I'll let you know if anything that we think should be working has any problems.
I haven't re-sized a lot of the artwork for new games or anything yet, so it's going to be a very incomplete gamelist.xml for now. I'm just re-running it at this point for testing purposes as well as "fixing" the names of all of the rom entries to display the full name instead of just the rom-file names.
I'll let you know how it goes hopefully in a few days. :)
-
@meleu Hey man. If you wouldn't mind, could you update this page to have all of the current commands and features in the script?
https://github.com/meleu/Used2BeTXT/blob/master/README.md
I have some questions about how things work and I'm seeing some odd behaviors that I wasn't expecting, but I'm not sure if I'm just not using the program right and I don't want to bother you with them yet. I'm specifically speaking about the backup process and if a script should be overwritten, appended, or written from scratch.
I know you might have that in the
--helpcommand, but I don't want to break the program now to check at the moment. Was hoping if it's in the help, you could just copy and paste that to the readme file.Thanks :)
-
@used2berx the README has been updated.
-
@meleu Thanks. I should have some time this weekend to kick the tires a bit. Don't know how much time I'll have before then though, but if I figure anything out I'll let you know.
-
@meleu Hey bud,
I was wondering if it is possible to not make tags if the media/field isn't available for the game? I wanted to ask you before I put it on the wishlist.
I was really surprised after running a FULL command that we had a 3.00MB file. Granted there were 300-400 more games this time around, I spent a lot of time paring the individual game synopsis files to 1kb or under and ended up with a total file size of around 1.6MB, so I was shocked to see we're still at 3.00MB for the NES gamelist.xml. (But then I did remember that we've got a LOT of long file names/paths on each entry that weren't in the synopsis).
I know it probably doesn't sound like we'd shave much off of that size by eliminating empty tags, but remember that at least for the NES, there are over 2,020 games included, as well as around 30 folders.
Maybe this won't be an issue when I finally get a Pi3, but it seems like having massive gamelist.xml files impacts performance on the Pi Zero. Fortunately, there aren't any problems so far with just this NES gamelist, but if I were to have FULL gamelists for all of the systems one day, I'm thinking they wouldn't run on the Pi Zero at all.
Also, removing the website address at the bottom of each entry should clear up some space too. :)
-
@meleu Sorting by Genre in RetroPie is pretty awesome man. It's going to help me fine-tune the final genres for the sets. I actually had no idea how many different ones I was using until I tried this feature out. There's so many combinations of them. (198!)
At least with this feature I can see if there are any that I put in a different order on two separate games, or if I called it something slightly different.
For example, VS Fighter / VS Fighting, Board Game / Board Games, Card Game / Card Games.
lol... just noticed I have "Actoin / Platformer". Might have a few misspellings in there. :)
Well... scrolling through them, I think I should be able to eliminate 30 of the genres pretty easily. 15-20 of them were probably going to be gone by next re-run of the script anyhow after my Pi testing since I've been heavily editing the Genre and Players fields as I've been going through the testing process.
BTW... I've tested over half of the NES games on the Pi Zero so far, and the results are really good. Getting into the more obscure territory right now, but we're still rocking over 99% compatibility. :)
-
@meleu Hey Meleu,
Is there a command I could run that would create an output text file for me that has every different line used in the
Genre:line of all of the synopsis.txt files? (Only once though, I don't need to see all 300 times that "Action / Platformer" shows up.)It's helpful to have that information to scroll through on the RetroPie screen, but I'd like to actually look at a text file of it so I can "sort" some things and better re-name the Genre fields that way.
I thought you'd know a quicker way to do this than me typing all of them out looking at my TV screen. :)
-
@used2berx Assuming your files are all .txt in a single folder, execute the following command from within that folder:
for i in *.txt; do sed -ne '/Genre:/ s/Genre:\(\s\)//p' "$i" >> /tmp/genres.txt; doneto get all Genres in a single
/tmp/genres.txt. To sort and eliminate duplicates, execute:cat /tmp/genres.txt | sort | unix > sorted.txtand the
sorted.txtfile should have a sorted and no-duplicate list of all the genres.EDIT: corrected the
forloop, it always looked inside 1 file. -
@mitu Thanks man. I'm going to give that a try and see how it works out. :)
-
@meleu Hey Meleu. Do you know anything about how the Pi handles FDS games? I've been unable to launch any of them from within the NES folder structure that I currently have them in. This was one of the issues high on the priority wish list.
I figured that I wouldn't be able to integrate the synopsis for them into the gamelist.xml easily unless you got to making that happen, but I was surprised when FDS doesn't load any of the games at all in quicknes, fceumm or nestopia.
-
@used2berx sorry bro, I never tried fds. I think @edmaul69 know something about it...
-
@meleu Cool. I'll ask him if I need help when I really dive into it.
Any chance you'll have some time to "fix" how FDS games are handled in the script? I believe I've got that at the top of the priority list right now. Assuming I can figure out how to launch the games, they should all play fine once I get that going. We just won't have any media or info on any of them until the script is changed.
-
@used2berx your first issue is you need the fds bios in the bios folder. Games wont run without it. The bios is disksys.rom . Then if you dont want to have to go into the retroarch gui to flip the disk then you want to edit your controller configs to do it with hotkeys. I add these settings to my controllers for fds and psx. Just add buttons that arent being used for other hotkeys.
input_disk_eject_toggle_btn = input_disk_next_btn = input_disk_prev_btn = -
@edmaul69 lol Doh! I bet that the bios is the issue. I forgot the FDS had one. I put this stuff together on the XBox like 10 years ago so it's been a while.
Thanks for the disk flip info as well. I'm sure I was going to be asking about that in the future too. :)
-
@edmaul69 Sweet man. That was all I was missing. Thanks again.
All I have to do is set up my controller with those hotkeys that you gave me and we're good to go. I should have the FDS testing done by the weekend. I'll let you know how it pans out.
@meleu Hey man. Any chance you might be able to work some scripting magic on that FDS stuff now that the holidays are over and it's cold and crappy outside :)
-
@used2berx yeah let me know how it goes
-
@used2berx said in Making premade gamelist.xml with xtra media collections:
@meleu Hey man. Any chance you might be able to work some scripting magic on that FDS stuff now that the holidays are over and it's cold and crappy outside
The funny thing is that in my part of the world the weather is hot and good to go to the beach with my kids :D
When the kids are on vacations my free time decreases considerably. And I'm away from my "coding station". I will only be able to play with that script on February, I guess.
Maybe it's time to actually play some games a little, what do you think? ;)
-
@edmaul69 said in Making premade gamelist.xml with xtra media collections:
Then if you dont want to have to go into the retroarch gui to flip the disk then you want to edit your controller configs to do it with hotkeys. I add these settings to my controllers for fds and psx. Just add buttons that arent being used for other hotkeys.
input_disk_eject_toggle_btn = input_disk_next_btn = input_disk_prev_btn =I was just going to edit the configuration for the specific controller I was using because I know where that is and I used it before to map the fast forward to it.
I like your solution better.
Where is the system specific controller configurations?(Nevermind the question. I figured that part out. Please read the next post. :))
Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.
Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.