Making premade gamelist.xml with xtra media collections

Used2BeRX

@UDb23 I have some free time the next few days so it's no problem. You're going to need that list eventually, so better to get it out of the way. The next few weeks are going to be a bit spotty for me after that, so I'll have less time to test this out, but it will be a top priority for me to get feedback to you ASAP so you can get back to it without waiting on me.

EDIT:

Looks like we're just going to make this easy (hopefully). I went into the synopsis system and from console to console the only fields they have for entering game info now are the following:

Xtras Name: (Extras name in the system means the file name and extension we use for each game)
Title: (Name of the game. The top line in all the TXT files)
Original Title: (Only used for Hacks or Translated games)
Alternate Title: (Only used for Hacks or Translated games)
Release Year:
Region:
Genre:
Gametype:
Developer:
Publisher:
Players:
Controller:
Media:
Hacked by:
Translated by:
Version: (Version of the hack/translation)

I'd say just make sure the above fields are all accounted for, and leave in all of the fields you have currently. Any games they've added since they put the system online don't account for fields like musician or programmer, but it looks like if they were in there back when I was making this stuff by hand years ago that they've remained. No reason to take them out I guess.

If any problems come up or if I notice things we can talk about that when they occur.

UDb23

@Used2BeRX Thanks for the "items/tag" list; with this I can update the txt parsing function in the program to catch all these.
I don't see the <genre> you mentioned previously; is it the same as <gametype> ?

Used2BeRX

@UDb23 Whoops. I forgot Genre. That's different than gametype. The gametype specifies if it's an official release or a hack or translation or prototype etc.

Also, the "Xtras Name" won't be in any of the files. The txt file name IS the Xtras name 99.9% of the time. We're going to probably run into some problems down the road with this though since case sensitivity was not an issue on the other platform but will be here. Most of the time they're good, but for example a game like "Attack of the Mutant Camels.zip" might be "Attack Of The Mutant Camels.xxx" for one or more of the media pieces.

UDb23

@Used2BeRX I can Camel Case (funny that you used Mutant Camels game as example!) the filenames of the xml if required. It's probably easier if you rename txt files and related media by using an utility like Bulk Rename to have all consistant camel cased names.

Used2BeRX

@UDb23 I thought Herb_Fergus was making a joke earlier in this thread or somewhere in another thread after I used that example. What does Camel Case mean?

I suppose if need be I can do a Bulk Rename on everything. My initial intention was to be able to use the exact same packs as were originally created and have been floating around the internet for the last 7-8 years, but I've had to make drastic changes to stuff for a Pi Zero pack anyhow.

What I'm really not looking forward to having to do is making romcenter datfiles with our naming conventions. I don't think that there is a way to make one file for each system that takes into account the subfolders. That would make life much easier, but I think I need to make a separate datfile for every sub-folder. Some of the systems like the NES have a crazy amount of nested folders.

I guess it really doesn't matter about the case now. I could just make every single file all upper or lower case since the game name on the emu will show as whatever is in the gamelist.xml and look nice.

When these sets were originally made, there were two things we had to deal with. None of the emulators on the other platform were set up initially to show anything other than the file name and extension (that was fixed years ago), and the other one was the filename limit was 42 characters including the extension.

UDb23

@Used2BeRX Camel Case means having all first letters of words in a sentence in upper case;
lower case: star wars: a new hope
Camel Case:Star Wars: a New Hope
So you can keep those rom names with the initial word capitals and make all the names consistant by applying "camel case" to all txt and media files using an utility like "Bulk rename".
Also visual basic has a dedicated function to "camel case" a sentence.

Used2BeRX

@UDb23 Ah... well for the most part I've got it Camel Case already then. But your example brings up the problem with that. I would have named the rom "Star Wars - A New Hope", but maybe somebody helping me put the packs together might have named a piece or two of the artwork "Star Wars - a New Hope". Like I said, it doesn't happen very often, but it went completely overlooked since nothing was case sensitive.

Too bad there isn't just a way to turn off case sensitivity. I know for sure everything matches up perfectly if that's not a factor.

EDIT: I did finally take the time to re-size all of my artwork to around 240x180 for the Pi Zero I'm working on. I was having problem with larger images with how many I had. Having the gamelist.xml for just the 4 atari systems was enough to keep emulators from launching before. I reduced the VMM to only 50MB like somebody suggested in another thread and the smaller images seem to scroll a lot smoother on the list. Time will tell if I can use images with the Pi Zero once we start making the XML's for larger collections like the NES and Gameboy.

I haven't re-"cased" anything yet. I'm kind of on a time frame to get this Pi back to my brother for a gift to his brother in law, so I don't want to be changing everything until I know one way or another whether he's going to get this Pi with artwork or not. I'll be getting a replacement to continue the work on when I give this one back though.

Used2BeRX

@UDb23 Case Sensitivity will not be an issue. I decided to make things easy and I just Bulk Renamed every file to all uppercase filenames and extensions. I haven't done that to the Atari systems that I've already made gamelist.xml files for already, but I'm sure I will once this program is working.

Any luck ironing out any of those issues I found earlier?

I don't know how hard it would be to do, but I was hoping that there could be a function in the program that would scan the roms directory and the sub-folders for the file match when it creates the line for where the rom exists. Every system I have comes with sub-folders that separate official titles from all sorts of hacks, translations, prototypes, homebrew and other categories. Putting them all in one folder would be a mess of a romlist that nobody would want to play, and having to go in and manually change almost 10,000 entries over all of the systems by hand would largely defeat the purpose of this program.

UDb23

@Used2BeRX Just published new version of MetaX (.05). It's available in the same folder as previous.
Changes:

Filename issues fixed (filenames for xml were based on game name inside the txt; now uses same filename as txt)
Genre issue fixed; is now detected and saved correctly
marquee tag added

Next steps (coming soon):

custom media path (can be set by user)
convert all files in directory
create global gamelist.xml (converting all txt in folder)

Your last request, to scan if actual rom exists and create xml only for those found, makes sense of course.
The problem is related to names of the roms the user has; if they do not match exactly with the game names in the TXTs the "scan engine" would not find them correctly. Unless you're telling me that for these old console we can be almost sure roms have "standardized" names.

Maybe @meleu can support us in this matter. He has written many really helpful scripts for retropie, including the installer for the overlays and game art.

@meleu : what about adding a specific line in the info.txt like meta="mymetadata.xml" and providing the xml for that rom with complete metadata/tags generated with MetaX and @Used2BeRX txt data ?
Would it then be possible for the your script to add (or replace) the game tags of that .xml into the gamelist.xml ?

Used2BeRX

@UDb23 Nice. I'll download it and re-test the *.txt files I tested last time and see if I get any errors this time. I won't test more than that for now and we'll just have to see if we get any other errors popping up when we start doing the global gamelist.xml.

I can say for sure that at least with my sets the names of the roms and the synopsis.txt and any Xtras will be identical. I'm working on re-casing everything right now and I just got a new version of FlashFXP that has a function to compare file names and hide exact matches so I will be able to see if anything is not matching after the re-casing and fix those as well. My sets will be 100% match, that you can be sure of.

If meleu has a way to do this where it doesn't have to be as perfect, that's great. It would allow people to not have to be so anal about doing things with their own sets. This is going to be a great tool, and that would make it more universal for other people.

I will also get together an exact layout of my media structure for you to look over so you can see where media is going to be. It's going to be long as hell, so I'll put it in a "code window" here and you can copy and paste it into Notepad to see the structure for yourself.

Used2BeRX

@UDb23 ERROR REPORT:
Atari 7800 (All 90 Games). Previous Errors: 13. Current Errors 7.
NES (First 25 Games). Previous Errors: 10. Current Errors 9.

Atari 7800 Errors:
Centipede.txt
FailSafe.txt
Fatal Run.txt
Meltdown.txt
Ms Pac-Man.txt
Pac-Man Collection.txt
Tower Toppler.txt

NES Errors:
10-Yard Fight.txt
1942.txt
1943.txt
720.txt
75 Bingo.txt
8 Eyes.txt
A Boy and His Blob.txt
A Nightmare On Elm Street.txt
Abadox.txt

I'm going to put any potential errors I see in the original text files underneath each game here for you to look at and decide if you think that's the problem.

Atari7800:
Centipede.txt
Genre: Arcade - Shooter - Fixed
Players: 1 or 2 VS; CO-OP
"Hints:" in <desc>

FailSafe.txt
Genre: Action, Tank

There are ', /, -, :, ., ! , " characters in the <desc> on this file. I won't list this as an issue for any other files, but it should be expected that these characters will show up in the descriptions of a lot of other games in case they're currently a problem.

Fatal Run.txt
Genre: Racing - Cars

along with special characters in <desc> mentioned above, this one has "#" in it as well.

Meltdown.txt
Controller: XG-1 Lightgun

Ms Pac-Man.txt
[First line title]: Ms. Pac-Man
Numbers "X." in <desc>

Pac-Man Collection.txt
[First line title]: Pac-Man Collection!

Tower Toppler.txt
Possibly one or more of the special characters mentioned above in <desc>.

NES:
10-Yard Fight.txt
Genre: Sports - Football
Special Characters in <desc>?

1942.txt
Genre: Shoot 'em Up - Vertical
Players: 1 or 2 CO-OP
Special Characters in <desc>?

1943.txt
Genre: Shoot 'em Up - Vertical
Players: 1 or 2 CO-OP
Special Characters in <desc>?

720.txt
Genre: Sports - X-Games
Special Characters in <desc>?

75 Bingo.txt
Region: Unlicensed (Asia)
Special Characters in <desc>?

8 Eyes.txt
Players: 1 or 2 CO-OP
Special Characters in <desc>? There is also "+" and "=" in this one.

A Boy and His Blob.txt
[First line title]: A Boy and His Blob: Trouble on Blobolonia
Special Characters in <desc>? There is also "(" and ")" in this one.

A Nightmare On Elm Street.txt
Players: 1 to 4 CO-OP
Special Characters in <desc>?

Abadox.txt
Genre: Shoot 'em Up - Horizontal
Special Characters in <desc>?

Knocked out about half of the errors with this fix. Hopefully the stuff I pointed out will take care of the rest of them?

I'll get to work on getting the file system put together for you.

UDb23

@Used2BeRX Huh! I thought no more errors; sorry.
I will check those files one by one. I don't it's some strange characters this time.
More likely these txt have something different compared with usual file structure.
The program looks for the single tags and if found takes the value. Description is identified by being after the "------" at the end of the file.
Maybe I have to adjust these rules to parse these txt that create errors.
Will check tomorrow.

Used2BeRX

@UDb23 No worries. That's what I'm here for. :)

I got the file structure for you. I don't think it's really very useful to you since we're trying to make a "Universal-Type" program here, but I thought it would give you a good idea of what somebody with full sets might be working with, and it would also really illustrate how important the ability to have the program figure out where the roms will be is going to be for me.

MEDIA PATHS:

/home/
/home/pi/
/home/pi/RetroPie/
/home/pi/RetroPie/Media/


ATARI 2600: 
/home/pi/RetroPie/Media/A2600/
/home/pi/RetroPie/Media/A2600/Artwork/
/home/pi/RetroPie/Media/A2600/Artwork/3D Boxart/
/home/pi/RetroPie/Media/A2600/Artwork/Action/
/home/pi/RetroPie/Media/A2600/Artwork/Box Front/
/home/pi/RetroPie/Media/A2600/Artwork/Cart/
/home/pi/RetroPie/Media/A2600/Artwork/Marquee/
/home/pi/RetroPie/Media/A2600/Artwork/Titles/
/home/pi/RetroPie/Media/A2600/Commercials/
/home/pi/RetroPie/Media/A2600/GameFAQs/
/home/pi/RetroPie/Media/A2600/Manuals/
/home/pi/RetroPie/Media/A2600/Movies/
/home/pi/RetroPie/Media/A2600/VGMaps/

ATARI 7800:
/home/pi/RetroPie/Media/A7800/
/home/pi/RetroPie/Media/A7800/Artwork/
/home/pi/RetroPie/Media/A7800/Artwork/3D Boxart/
/home/pi/RetroPie/Media/A7800/Artwork/Action/
/home/pi/RetroPie/Media/A7800/Artwork/Box Front/
/home/pi/RetroPie/Media/A7800/Artwork/Cart/
/home/pi/RetroPie/Media/A7800/Artwork/Marquee/
/home/pi/RetroPie/Media/A7800/Artwork/Titles/
/home/pi/RetroPie/Media/A7800/Commercials/
/home/pi/RetroPie/Media/A7800/GameFAQs/
/home/pi/RetroPie/Media/A7800/Manuals/
/home/pi/RetroPie/Media/A7800/Movies/
/home/pi/RetroPie/Media/A7800/VGMaps/

COLECOVISION:
/home/pi/RetroPie/Media/ADAM/
/home/pi/RetroPie/Media/ADAM/Artwork/
/home/pi/RetroPie/Media/ADAM/Artwork/3D Boxart/
/home/pi/RetroPie/Media/ADAM/Artwork/Action/
/home/pi/RetroPie/Media/ADAM/Artwork/Box Front/
/home/pi/RetroPie/Media/ADAM/Artwork/Cart/
/home/pi/RetroPie/Media/ADAM/Artwork/Marquee/
/home/pi/RetroPie/Media/ADAM/Artwork/Titles/
/home/pi/RetroPie/Media/ADAM/Commercials/
/home/pi/RetroPie/Media/ADAM/GameFAQs/
/home/pi/RetroPie/Media/ADAM/Manuals/
/home/pi/RetroPie/Media/ADAM/Movies/
/home/pi/RetroPie/Media/ADAM/VGMaps/

ATARI 5200 / ATARI 800:
/home/pi/RetroPie/Media/ATARI800/
/home/pi/RetroPie/Media/ATARI800/Artwork/
/home/pi/RetroPie/Media/ATARI800/Artwork/3D Boxart/
/home/pi/RetroPie/Media/ATARI800/Artwork/Action/
/home/pi/RetroPie/Media/ATARI800/Artwork/Box Front/
/home/pi/RetroPie/Media/ATARI800/Artwork/Cart/
/home/pi/RetroPie/Media/ATARI800/Artwork/Marquee/
/home/pi/RetroPie/Media/ATARI800/Artwork/Titles/
/home/pi/RetroPie/Media/ATARI800/Commercials/
/home/pi/RetroPie/Media/ATARI800/GameFAQs/
/home/pi/RetroPie/Media/ATARI800/Manuals/
/home/pi/RetroPie/Media/ATARI800/Movies/
/home/pi/RetroPie/Media/ATARI800/VGMaps/

GAMEBOY / GAMEBOY COLOR / GAMEBOY ADVANCE:
/home/pi/RetroPie/Media/GBA/
/home/pi/RetroPie/Media/GBA/Artwork/
/home/pi/RetroPie/Media/GBA/Artwork/3D Boxart/
/home/pi/RetroPie/Media/GBA/Artwork/Action/
/home/pi/RetroPie/Media/GBA/Artwork/Box Front/
/home/pi/RetroPie/Media/GBA/Artwork/Cart/
/home/pi/RetroPie/Media/GBA/Artwork/Marquee/
/home/pi/RetroPie/Media/GBA/Artwork/Titles/
/home/pi/RetroPie/Media/GBA/Commercials/
/home/pi/RetroPie/Media/GBA/GameFAQs/
/home/pi/RetroPie/Media/GBA/Manuals/
/home/pi/RetroPie/Media/GBA/Movies/
/home/pi/RetroPie/Media/GBA/VGMaps/

SEGA GENESIS / SEGA CD / 32X:
/home/pi/RetroPie/Media/GENESIS/
/home/pi/RetroPie/Media/GENESIS/Artwork/
/home/pi/RetroPie/Media/GENESIS/Artwork/3D Boxart/
/home/pi/RetroPie/Media/GENESIS/Artwork/Action/
/home/pi/RetroPie/Media/GENESIS/Artwork/Box Front/
/home/pi/RetroPie/Media/GENESIS/Artwork/Cart/
/home/pi/RetroPie/Media/GENESIS/Artwork/Marquee/
/home/pi/RetroPie/Media/GENESIS/Artwork/Titles/
/home/pi/RetroPie/Media/GENESIS/Commercials/
/home/pi/RetroPie/Media/GENESIS/GameFAQs/
/home/pi/RetroPie/Media/GENESIS/Manuals/
/home/pi/RetroPie/Media/GENESIS/Movies/
/home/pi/RetroPie/Media/GENESIS/VGMaps/

ATARI LYNX:
/home/pi/RetroPie/Media/LYNX/
/home/pi/RetroPie/Media/LYNX/Artwork/
/home/pi/RetroPie/Media/LYNX/Artwork/3D Boxart/
/home/pi/RetroPie/Media/LYNX/Artwork/Action/
/home/pi/RetroPie/Media/LYNX/Artwork/Box Front/
/home/pi/RetroPie/Media/LYNX/Artwork/Cart/
/home/pi/RetroPie/Media/LYNX/Artwork/Marquee/
/home/pi/RetroPie/Media/LYNX/Artwork/Titles/
/home/pi/RetroPie/Media/LYNX/Commercials/
/home/pi/RetroPie/Media/LYNX/GameFAQs/
/home/pi/RetroPie/Media/LYNX/Manuals/
/home/pi/RetroPie/Media/LYNX/Movies/
/home/pi/RetroPie/Media/LYNX/VGMaps/

NINTENDO ENTERTAINMENT SYSTEM / FAMICOM DISK SYSTEM:
/home/pi/RetroPie/Media/NES/
/home/pi/RetroPie/Media/NES/Artwork/
/home/pi/RetroPie/Media/NES/Artwork/3D Boxart/
/home/pi/RetroPie/Media/NES/Artwork/Action/
/home/pi/RetroPie/Media/NES/Artwork/Box Front/
/home/pi/RetroPie/Media/NES/Artwork/Cart/
/home/pi/RetroPie/Media/NES/Artwork/Marquee/
/home/pi/RetroPie/Media/NES/Artwork/Titles/
/home/pi/RetroPie/Media/NES/Commercials/
/home/pi/RetroPie/Media/NES/GameFAQs/
/home/pi/RetroPie/Media/NES/Manuals/
/home/pi/RetroPie/Media/NES/Movies/
/home/pi/RetroPie/Media/NES/VGMaps/

NEO GEO POCKET / NEO GEO POCKET COLOR:
/home/pi/RetroPie/Media/NGPC/
/home/pi/RetroPie/Media/NGPC/Artwork/
/home/pi/RetroPie/Media/NGPC/Artwork/3D Boxart/
/home/pi/RetroPie/Media/NGPC/Artwork/Action/
/home/pi/RetroPie/Media/NGPC/Artwork/Box Front/
/home/pi/RetroPie/Media/NGPC/Artwork/Cart/
/home/pi/RetroPie/Media/NGPC/Artwork/Marquee/
/home/pi/RetroPie/Media/NGPC/Artwork/Titles/
/home/pi/RetroPie/Media/NGPC/Commercials/
/home/pi/RetroPie/Media/NGPC/GameFAQs/
/home/pi/RetroPie/Media/NGPC/Manuals/
/home/pi/RetroPie/Media/NGPC/Movies/
/home/pi/RetroPie/Media/NGPC/VGMaps/

ODYSSEY 2: (Don't think this is emulated on the Pi)
/home/pi/RetroPie/Media/ODYSSEY2/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/3D Boxart/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/Action/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/Box Front/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/Cart/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/Marquee/
/home/pi/RetroPie/Media/ODYSSEY2/Artwork/Titles/
/home/pi/RetroPie/Media/ODYSSEY2/Commercials/
/home/pi/RetroPie/Media/ODYSSEY2/GameFAQs/
/home/pi/RetroPie/Media/ODYSSEY2/Manuals/
/home/pi/RetroPie/Media/ODYSSEY2/Movies/
/home/pi/RetroPie/Media/ODYSSEY2/VGMaps/

TURBOGRAFX 16 / TURBOCD:
/home/pi/RetroPie/Media/PCE/
/home/pi/RetroPie/Media/PCE/Artwork/
/home/pi/RetroPie/Media/PCE/Artwork/3D Boxart/
/home/pi/RetroPie/Media/PCE/Artwork/Action/
/home/pi/RetroPie/Media/PCE/Artwork/Box Front/
/home/pi/RetroPie/Media/PCE/Artwork/Cart/
/home/pi/RetroPie/Media/PCE/Artwork/Marquee/
/home/pi/RetroPie/Media/PCE/Artwork/Titles/
/home/pi/RetroPie/Media/PCE/Commercials/
/home/pi/RetroPie/Media/PCE/GameFAQs/
/home/pi/RetroPie/Media/PCE/Manuals/
/home/pi/RetroPie/Media/PCE/Movies/
/home/pi/RetroPie/Media/PCE/VGMaps/

SONY PLAYSTATION: 
/home/pi/RetroPie/Media/PSX/
/home/pi/RetroPie/Media/PSX/Artwork/
/home/pi/RetroPie/Media/PSX/Artwork/3D Boxart/
/home/pi/RetroPie/Media/PSX/Artwork/Action/
/home/pi/RetroPie/Media/PSX/Artwork/Box Front/
/home/pi/RetroPie/Media/PSX/Artwork/Cart/
/home/pi/RetroPie/Media/PSX/Artwork/Marquee/
/home/pi/RetroPie/Media/PSX/Artwork/Titles/
/home/pi/RetroPie/Media/PSX/Commercials/
/home/pi/RetroPie/Media/PSX/GameFAQs/
/home/pi/RetroPie/Media/PSX/Manuals/
/home/pi/RetroPie/Media/PSX/Movies/
/home/pi/RetroPie/Media/PSX/VGMaps/

SEGA MASTER SYSTEM / GAME GEAR / SG-1000:
/home/pi/RetroPie/Media/SMSGG/
/home/pi/RetroPie/Media/SMSGG/Artwork/
/home/pi/RetroPie/Media/SMSGG/Artwork/3D Boxart/
/home/pi/RetroPie/Media/SMSGG/Artwork/Action/
/home/pi/RetroPie/Media/SMSGG/Artwork/Box Front/
/home/pi/RetroPie/Media/SMSGG/Artwork/Cart/
/home/pi/RetroPie/Media/SMSGG/Artwork/Marquee/
/home/pi/RetroPie/Media/SMSGG/Artwork/Titles/
/home/pi/RetroPie/Media/SMSGG/Commercials/
/home/pi/RetroPie/Media/SMSGG/GameFAQs/
/home/pi/RetroPie/Media/SMSGG/Manuals/
/home/pi/RetroPie/Media/SMSGG/Movies/
/home/pi/RetroPie/Media/SMSGG/VGMaps/

SUPER NINTENDO: 
/home/pi/RetroPie/Media/SNES/
/home/pi/RetroPie/Media/SNES/Artwork/
/home/pi/RetroPie/Media/SNES/Artwork/3D Boxart/
/home/pi/RetroPie/Media/SNES/Artwork/Action/
/home/pi/RetroPie/Media/SNES/Artwork/Box Front/
/home/pi/RetroPie/Media/SNES/Artwork/Cart/
/home/pi/RetroPie/Media/SNES/Artwork/Marquee/
/home/pi/RetroPie/Media/SNES/Artwork/Titles/
/home/pi/RetroPie/Media/SNES/Commercials/
/home/pi/RetroPie/Media/SNES/GameFAQs/
/home/pi/RetroPie/Media/SNES/Manuals/
/home/pi/RetroPie/Media/SNES/Movies/
/home/pi/RetroPie/Media/SNES/VGMaps/

WATARA SUPERVISION: (Don't think this is emulated on the Pi)
/home/pi/RetroPie/Media/SUPERVISION/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/3D Boxart/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/Action/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/Box Front/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/Cart/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/Marquee/
/home/pi/RetroPie/Media/SUPERVISION/Artwork/Titles/
/home/pi/RetroPie/Media/SUPERVISION/Commercials/
/home/pi/RetroPie/Media/SUPERVISION/GameFAQs/
/home/pi/RetroPie/Media/SUPERVISION/Manuals/
/home/pi/RetroPie/Media/SUPERVISION/Movies/
/home/pi/RetroPie/Media/SUPERVISION/VGMaps/

NINTENDO VIRTUALBOY: (Don't think this is emulated on the Pi)
/home/pi/RetroPie/Media/VIRTUALBOY/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/3D Boxart/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/Action/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/Box Front/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/Cart/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/Marquee/
/home/pi/RetroPie/Media/VIRTUALBOY/Artwork/Titles/
/home/pi/RetroPie/Media/VIRTUALBOY/Commercials/
/home/pi/RetroPie/Media/VIRTUALBOY/GameFAQs/
/home/pi/RetroPie/Media/VIRTUALBOY/Manuals/
/home/pi/RetroPie/Media/VIRTUALBOY/Movies/
/home/pi/RetroPie/Media/VIRTUALBOY/VGMaps/

BANDAI WONDERSWAN: (Don't think this is emulated on the Pi)
/home/pi/RetroPie/Media/WONDERSWAN/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/3D Boxart/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/Action/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/Box Front/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/Cart/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/Marquee/
/home/pi/RetroPie/Media/WONDERSWAN/Artwork/Titles/
/home/pi/RetroPie/Media/WONDERSWAN/Commercials/
/home/pi/RetroPie/Media/WONDERSWAN/GameFAQs/
/home/pi/RetroPie/Media/WONDERSWAN/Manuals/
/home/pi/RetroPie/Media/WONDERSWAN/Movies/
/home/pi/RetroPie/Media/WONDERSWAN/VGMaps/





ROM PATHS:
/home/pi/RetroPie/roms/

ATARI 2600: 
/home/pi/RetroPie/roms/atari2600/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_1) US/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_2) Europe (NTSC Conversions)/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_3) Europe (Non-NTSC Conversions)/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_4) Brazil/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_5) Cassettes/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_6) Light Gun/
/home/pi/RetroPie/roms/atari2600/(1) Licensed/(1_7) Special Releases/
/home/pi/RetroPie/roms/atari2600/(2) Homebrew - Prototypes/
/home/pi/RetroPie/roms/atari2600/(2) Homebrew - Prototypes/(2_1) Homebrew/
/home/pi/RetroPie/roms/atari2600/(2) Homebrew - Prototypes/(2_2) Prototypes/
/home/pi/RetroPie/roms/atari2600/(2) Homebrew - Prototypes/(2_3) Hacks/
/home/pi/RetroPie/roms/atari2600/(2) Homebrew - Prototypes/(2_4) Trainers/

ATARI 5200 / ATARI 800: 
/home/pi/RetroPie/roms/atari5200/
/home/pi/RetroPie/roms/atari5200/(1) Atari 5200/
/home/pi/RetroPie/roms/atari5200/(1) Atari 5200/(1) Licensed/
/home/pi/RetroPie/roms/atari5200/(1) Atari 5200/(2) Unreleased - Unlicensed/
/home/pi/RetroPie/roms/atari5200/(1) Atari 5200/(2) Unreleased - Unlicensed/(1) Prototypes/
/home/pi/RetroPie/roms/atari5200/(1) Atari 5200/(2) Unreleased - Unlicensed/(2) Homebrew/
/home/pi/RetroPie/roms/atari5200/(1) Atari 5200/(2) Unreleased - Unlicensed/(3) Atari 800 Conversions/
/home/pi/RetroPie/roms/atari5200/(2) Atari 800 Carts/
/home/pi/RetroPie/roms/atari5200/(2) Atari 800 Carts/(1) Licensed/
/home/pi/RetroPie/roms/atari5200/(2) Atari 800 Carts/(2) Light Gun Games/
/home/pi/RetroPie/roms/atari5200/(2) Atari 800 Carts/(3) Prototypes/

ATARI 7800: 
/home/pi/RetroPie/roms/atari7800/
/home/pi/RetroPie/roms/atari7800/(1) Licensed/
/home/pi/RetroPie/roms/atari7800/(2) Lightgun Games/
/home/pi/RetroPie/roms/atari7800/(3) Prototypes/
/home/pi/RetroPie/roms/atari7800/(4) Update Hacks/
/home/pi/RetroPie/roms/atari7800/(5) Homebrew/

ATARI LYNX: 
/home/pi/RetroPie/roms/atarilynx/
/home/pi/RetroPie/roms/atarilynx/(1) Licensed/
/home/pi/RetroPie/roms/atarilynx/(2) Prototypes/
/home/pi/RetroPie/roms/atarilynx/(3) Homebrew/

COLECOVISION: 
/home/pi/RetroPie/roms/coleco/
(Unknown at this time if I'm going to do this because it requires a ton of control configuration)

GAME GEAR: 
/home/pi/RetroPie/roms/gamegear/
/home/pi/RetroPie/roms/gamegear/(1) Licensed/
/home/pi/RetroPie/roms/gamegear/(1) Licensed/(1_1) US Licensed/
/home/pi/RetroPie/roms/gamegear/(1) Licensed/(1_2) Europe Licensed/
/home/pi/RetroPie/roms/gamegear/(1) Licensed/(1_3) Japan Licensed/
/home/pi/RetroPie/roms/gamegear/(2) Translated/
/home/pi/RetroPie/roms/gamegear/(3) Prototypes/

GAMEBOY: 
/home/pi/RetroPie/roms/gb/
/home/pi/RetroPie/roms/gb/(1) Licensed/
/home/pi/RetroPie/roms/gb/(1) Licensed/(1_1) US Licensed/
/home/pi/RetroPie/roms/gb/(1) Licensed/(1_2) Europe Licensed/
/home/pi/RetroPie/roms/gb/(1) Licensed/(1_3) Japan Licensed/
/home/pi/RetroPie/roms/gb/(1) Licensed/(1_4) Personal Assistants/
/home/pi/RetroPie/roms/gb/(2) Translated/
/home/pi/RetroPie/roms/gb/(3) Unlicensed - Hacks/
/home/pi/RetroPie/roms/gb/(3) Unlicensed - Hacks/(3_1) Unlicensed/
/home/pi/RetroPie/roms/gb/(3) Unlicensed - Hacks/(3_2) Prototypes/
/home/pi/RetroPie/roms/gb/(3) Unlicensed - Hacks/(3_3) Pirates/
/home/pi/RetroPie/roms/gb/(3) Unlicensed - Hacks/(3_4) Update Hacks/
/home/pi/RetroPie/roms/gb/Non-Working/

GAMEBOY ADVANCE: 
/home/pi/RetroPie/roms/gba/
/home/pi/RetroPie/roms/gba/(1) Licensed/
/home/pi/RetroPie/roms/gba/(1) Licensed/(1_1) US Licensed/
/home/pi/RetroPie/roms/gba/(1) Licensed/(1_2) Europe Licensed/
/home/pi/RetroPie/roms/gba/(1) Licensed/(1_3) Japan Licensed/
/home/pi/RetroPie/roms/gba/(1) Licensed/(1_4) Video Cartridges/
/home/pi/RetroPie/roms/gba/(1) Licensed/(1_5) Special Releases/
/home/pi/RetroPie/roms/gba/(2) Translated/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/(3_1) Unlicensed/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/(3_2) Prototypes/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/(3_3) Pirates/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/(3_4) Update Hacks/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/(3_5) Pokemon Hacks/
/home/pi/RetroPie/roms/gba/(3) Unlicensed - Hacks/(3_6) Homebrew/
/home/pi/RetroPie/roms/gba/Non-Working/

GAMEBOY COLOR: 
/home/pi/RetroPie/roms/gbc/
/home/pi/RetroPie/roms/gbc/(1) Licensed/
/home/pi/RetroPie/roms/gbc/(1) Licensed/(1_1) US Licensed/
/home/pi/RetroPie/roms/gbc/(1) Licensed/(1_2) Europe Licensed/
/home/pi/RetroPie/roms/gbc/(1) Licensed/(1_3) Japan Licensed/
/home/pi/RetroPie/roms/gbc/(2) Translated/
/home/pi/RetroPie/roms/gbc/(3) Unlicensed - Hacks/
/home/pi/RetroPie/roms/gbc/(3) Unlicensed - Hacks/(3_1) Unlicensed/
/home/pi/RetroPie/roms/gbc/(3) Unlicensed - Hacks/(3_2) Prototypes/
/home/pi/RetroPie/roms/gbc/(3) Unlicensed - Hacks/(3_3) Pirates/
/home/pi/RetroPie/roms/gbc/(3) Unlicensed - Hacks/(3_4) Update Hacks/
/home/pi/RetroPie/roms/gbc/(3) Unlicensed - Hacks/(3_5) Original Homebrew/
/home/pi/RetroPie/roms/gbc/Non-Working/

SEGA MASTERSYSTEM:
/home/pi/RetroPie/roms/mastersystem/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/(1_1) US Licensed/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/(1_2) Lightgun/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/(1_3) 3D Games/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/(1_4) Europe Licensed/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/(1_5) Japan/
/home/pi/RetroPie/roms/mastersystem/(1) Licensed/(1_6) Brazil/
/home/pi/RetroPie/roms/mastersystem/(2) Translated/
/home/pi/RetroPie/roms/mastersystem/(3) Unlicensed - Homebrew/
/home/pi/RetroPie/roms/mastersystem/(3) Unlicensed - Homebrew/(3_1) Unlicensed/
/home/pi/RetroPie/roms/mastersystem/(3) Unlicensed - Homebrew/(3_2) Prototypes/
/home/pi/RetroPie/roms/mastersystem/(3) Unlicensed - Homebrew/(3_3) Update Hacks/
/home/pi/RetroPie/roms/mastersystem/Non-Working/

SEGA GENESIS:
/home/pi/RetroPie/roms/megadrive/
/home/pi/RetroPie/roms/megadrive/(1_1) Licensed/
/home/pi/RetroPie/roms/megadrive/(1_1) Licensed/(1_1) USA Licensed/
/home/pi/RetroPie/roms/megadrive/(1_1) Licensed/(1_2) Menacer Games/
/home/pi/RetroPie/roms/megadrive/(1_1) Licensed/(1_3) Europe Licensed/
/home/pi/RetroPie/roms/megadrive/(1_1) Licensed/(1_4) Japan Licensed/
/home/pi/RetroPie/roms/megadrive/(1_2) Translated/
/home/pi/RetroPie/roms/megadrive/(1_3) Unlicensed - Homebrew/
/home/pi/RetroPie/roms/megadrive/(1_3) Unlicensed - Homebrew/(3_1) Unlicensed/
/home/pi/RetroPie/roms/megadrive/(1_3) Unlicensed - Homebrew/(3_2) Prototypes/
/home/pi/RetroPie/roms/megadrive/(1_3) Unlicensed - Homebrew/(3_3) Pirates/
/home/pi/RetroPie/roms/megadrive/(1_3) Unlicensed - Homebrew/(3_4) Update Hacks/
/home/pi/RetroPie/roms/megadrive/(1_3) Unlicensed - Homebrew/(3_5) Original Homebrew/

NINTENDO ENTERTAINMENT SYSTEM / FAMICOM DISK SYSTEM:
/home/pi/RetroPie/roms/nes/
/home/pi/RetroPie/roms/nes/(1) Licensed/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_1) US Licensed/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_2) US Unlicensed/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_3_1) NES Zapper Games/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_3_2) NES Power Pad Games/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_4) Europe/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_5) Japan/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_6) Australia/
/home/pi/RetroPie/roms/nes/(1) Licensed/(1_7) VS Games/
/home/pi/RetroPie/roms/nes/(2) Translated/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_01) Unlicensed/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_02) Prototypes/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_03) Pirate Carts/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_04) Pirate - Fighting Games/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_05) Original Homebrew/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_06) Castlevania Updates/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_07) Final Fantasy Updates/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_08) Mega Man Updates/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_09) Metroid Updates/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_10) Super Mario Bros Updates/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_11) Zelda Updates/
/home/pi/RetroPie/roms/nes/(3) Unlicensed - Homebrew/(3_12) Other Updates/
/home/pi/RetroPie/roms/nes/(4) Famicom Disk System/
/home/pi/RetroPie/roms/nes/(4) Famicom Disk System/(4_1) Translated/
/home/pi/RetroPie/roms/nes/(4) Famicom Disk System/(4_2) Untranslated/
/home/pi/RetroPie/roms/nes/(4) Famicom Disk System/(4_3) Update Hacks/
/home/pi/RetroPie/roms/nes/Non-Working/
/home/pi/RetroPie/roms/nes/Non-Working/NEEDS ALTERNATE CONTROLLER/

NEO GEO POCKET / NEO GEO POCKET COLOR: 
/home/pi/RetroPie/roms/ngp/
(Haven't decided structure.  Will probably combine both into one for such small libraries)

TURBOGRAFX 16:
(May change.  Haven't decided on how TGCD will work because I'm only using Pi Zero)
/home/pi/RetroPie/roms/pcengine/
/home/pi/RetroPie/roms/pcengine/(1_1) US Licensed/
/home/pi/RetroPie/roms/pcengine/(1_2) Japan Licensed/
/home/pi/RetroPie/roms/pcengine/(2) Translated/
/home/pi/RetroPie/roms/pcengine/(3_1) Special Releases/
/home/pi/RetroPie/roms/pcengine/(3_2) Updates/

SONY PLAYSTATION:
(May change.  Haven't even thought of CD based games because of using Pi Zero)
/home/pi/RetroPie/roms/psx/

SEGA 32X:
(May change and lump in with Genesis instead of having separate spot.  Doesn't work on Pi Zero)
/home/pi/RetroPie/roms/sega32x/
/home/pi/RetroPie/roms/sega32x/(2_1) Licensed/
/home/pi/RetroPie/roms/sega32x/(2_2) Update Hacks/
/home/pi/RetroPie/roms/sega32x/(2_3) Original Homebrew/

SEGA CD: 
(May change and lump in with Genesis instead of having separate spot.  Doesn't work on Pi Zero)
/home/pi/RetroPie/roms/segacd/

SEGA SG-1000:
/home/pi/RetroPie/roms/sg-1000/

SUPER NINTENDO:
/home/pi/RetroPie/roms/snes/
/home/pi/RetroPie/roms/snes/(1) Licensed/
/home/pi/RetroPie/roms/snes/(1) Licensed/(1) US/
/home/pi/RetroPie/roms/snes/(1) Licensed/(2) Super Scope/
/home/pi/RetroPie/roms/snes/(1) Licensed/(3) Europe/
/home/pi/RetroPie/roms/snes/(1) Licensed/(4) Japan/
/home/pi/RetroPie/roms/snes/(1) Licensed/(5) Special Releases/
/home/pi/RetroPie/roms/snes/(2) Translated/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(01) Unlicensed/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(02) Prototypes/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(03) Pirates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(04) Original Homebrew/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(05) Castlevania Updates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(06) Chrono Trigger Updates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(07) Final Fantasy Updates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(08) Legend of Zelda Updates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(09) Super Mario Updates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(10) Super Metroid Updates/
/home/pi/RetroPie/roms/snes/(3) Unlicensed - Homebrew/(11) Other Updates/
/home/pi/RetroPie/roms/snes/Non-Working/

UDb23

@Used2BeRX thanks.

Used2BeRX

@UDb23 No problem.

I'm pretty much set with the low-def artwork for the Pi-zero setup to try all this out with. I've re-cased everything and verified all the names match and everything is on the Pi now. I've got a few things here and there I need to fix up, but it will all be set up by the time you have the next update so we can really start testing this out.

meleu

@UDb23 hey bro! Sorry, I didn't get exactly what this thread is about (ok, something related with gamelist.xml). Is it related with rpie-art?

If you want to make convertions like that on the OP (from txt to xml) I can help with it. But I'm not sure if changing user's gamelist.xml is something to be expected from a tool designed to install art.

UDb23

@meleu : @Used2BeRX has a huge collection of txt files containing games metadata he made in the past, and also related media (box-art etc). He asked support to convert these txt files to ES compatible xml format in WIndows.
I made a small Program to do the conversion and it's almost ok.

Now he'd like to automate the install of metadata and media only for the roms a user actually has installed. Basically like scraping roms using local metadata and media instead of online. Any suggestions ?

meleu

@UDb23 said in Making premade gamelist.xml with xtra media collections:

Any suggestions ?

Try to guess... Yes, shell script. :-)

It seems to be easy to implement. The most challenging part will be the ROM filename matching (same with our rpie-art).

I can help with it. I'll try to take a look into it on Wednesday.

UDb23

@meleu nice, thanks :-)
Meanwhile I'll fix a few bugs in the conversion Program.

meleu

@UDb23 The conversion to xml is really simple and straightforward to do via shell script, a few lines of sed tricks and, voilá, xml ready! If you guys really need to do it on windows, maybe it's time to know the cygwin. ;-)

About the scraper, did he ( @Used2BeRX ) put the txt/xml files in some repo?

A quick reading through the posts in this thread makes me believe that the files are at some of those web servers that don't allow downloads directly from command line.

@Used2BeRX putting your files in github really increases the chances to other people contribute with your hardwork and use it. If you don't know how it works, consider to learn at least the basics.

I see three pros:

The txt files seems to be human readable, then anyone would be able to contribute.
Users could download files directly from the command line (pi users love this feature).
Your work would be easily accessible (a friendly URL, not those random chars of those dropbox-like web servers you're using).

P.S.: I reread my post and maybe I'm sounding like a smartass. Sorry, this is not my intention. :-)

Cheers.