RetroPi Media - gamelist.xml generator

disguisedcoot

I will give it a go, just about to start a few projects

SuperPitendo

Hi,

I cant find any MARQUEE options. They are necessary for some themes.

MotoGp

@SuperPitendo said in RetroPi Media - gamelist.xml generator:

I cant find any MARQUEE options.

I can add Marquees settings, I don't use them so I didn't think aobut it.

MotoGp

this is what the gamelist looks like when created.
note: if creating from hyperlists, the <desc> field will contain just the game name not a description of the game. also the rating is same for all.

check to see if the file paths are correct for your system.

<game>
		<path>./Addams Family, The (USA).zip</path>
		<name>Addams Family, The (USA)</name>
		<cover>./media/covers/Addams Family, The (USA).png</cover>
		<image>./media/screenshots/Addams Family, The (USA).png</image>
		<marquee ></marquee >
		<video>./media/videos/Addams Family, The (USA).mp4</video>
		<rating>0.9</rating>
		<desc>Addams Family, The (USA)</desc>
		<releasedate>1992</releasedate>
		<developer>Ocean</developer>
		<publisher>Ocean</publisher>
		<genre>Platform</genre>
		<players>2</players>
	</game>

SuperPitendo

@MotoGp I know, some dudes like marquees and others dont.
But the effort you put in this tool will not be appreciated as it should if you target (unintenionally) a splitgroup (metadata user) of a splitgroup (without interest in marquees). You see, the target group become pretty small.
My advise: more flexibility!!!

Anything that can be scraped, should be an option (like marquees)
I like my metadata in one folder per system (like sselphscraper does it), not in three different folders. here should be an option too.
I see there is a kind of check if there are some missing roms. But missing in comparison to what? Wich list from where is taken to check the missing roms? I think being able to add the newest dat.files by yourself would be an amazing feature in your tool.
The one thing I really miss in any scraper and tool is a prepared (maybe drop down) list of publisher, developer and genre. After many scraping session with different scrapers, I was always unamused about the inkonsistencies in spelling of these tags and sorting by these tags was useless...

Cheers!

MotoGp

@SuperPitendo said in RetroPi Media - gamelist.xml generator:

@MotoGp I know, some dudes like marquees and others dont.
But the effort you put in this tool will not be appreciated as it should if you target (unintenionally) a splitgroup (metadata user) of a splitgroup (without interest in marquees). You see, the target group become pretty small.
My advise: more flexibility!!!

Anything that can be scraped, should be an option (like marquees)

I like my metadata in one folder per system (like sselphscraper does it), not in three different folders. here should be an option too.

I see there is a kind of check if there are some missing roms. But missing in comparison to what? Wich list from where is taken to check the missing roms? I think being able to add the newest dat.files by yourself would be an amazing feature in your tool.

The one thing I really miss in any scraper and tool is a prepared (maybe drop down) list of publisher, developer and genre. After many scraping session with different scrapers, I was always unamused about the inkonsistencies in spelling of these tags and sorting by these tags was useless...

Cheers!

This app isn't a scraper, it does not download anything. I've added the marquess to the setup.
You can put all of your data in one folder like roms\systemname\media\
the check is this. If you use either a gamelist from someone or a Hyperlist, it check to see if you have the roms that match the list. I'm not sure what the dat.files are.
I'm note usre how to handle this one.

The overall intent of my app was to see what roms you had and the cooresponding images. It just basically shows you what you have and what is missing.

It allows you to edit the gamelist file. But again, its not a scraper app. The whole scraper thing is foreign to me. I understnad what it does but I think the results of the ones I tried and pretty bad.

If to others this app serves no purpose, I'll just use it myself. I just thought I'd share it and maybe would be useful to someone else. I made a similar app for Hyperspin years ago and was useful for that system but Hyperspin didn't "scrape" to create your gamelist, the lists were already made and you downloaded them to your systema and sometimes you had a game in the menu but you actually did not have the rom, so I was avoiding that issue.

rand0m

@MotoGp App looks great, would it be possible to get Attract-Mode lists from it? They are in txt format so will require output in simple text rather then xml.

MotoGp

@rand0m I haven't setup attract mode on mine. can you show me the file that is used for it? I'm sure I can create it.

bhakta

Can I give it a go?
I wanted to convert hyperspin and nfo files to pegasus but it's painfully slow to manually do it. even using scripts and trying to get everything right in regex.

TIA

MotoGp

Here is the first release. I added the Marquee files

As always try one system first, back up your data first.

There is nothing to install, just unzip the file and run RetroPieMedia.exe. Do not try to run from within the zip file. Keep all the files from the zip in the same folder. The folder name doesn’t matter.

RetroPie Media Basic Instructions:

Setup folders and extensions
Browse to rom Folder for the desired system.
Browse and select Hyperlist.xml file for system.
Click Import button. This process can take a little time depending on how many games are listed in the xml file. Wait for the “Success” message to appear.
Now the Hyperlist.xml will be displayed in the data grid. Anything in green means the file was located. Red means the file was not found. If all of your roms are red double check you entered the correct rom extension. Also all roms must have the same extension.
At this point no files are changed/created.
If you have unmatched roms you can match them by selecting the game name in the left data grid then selecting the corresponding rom file in the unmatched list then click match.
Once you’ve matched all the files you can, you can archive the unmatched files, they get moved to roms\orphans.
If you want to remove games from the list that do not have a rom, click the” remove games “button. This is only removing it from the data grid. To undo just click “import” again.
Once you have the list how you want it, click “Generate xml” This will create a backup of your current gamelist.xml and then create a new one.

You can download the program from here:
https://www.dropbox.com/s/3bpa8435bfe6luv/RetroPieMedia Release 2.zip?dl=0

The xml output looks like this.
<game>
<path>./10-Yard Fight (USA, Europe).zip</path>
<name>10-Yard Fight (USA, Europe)</name>
<cover>./media/covers/10-Yard Fight (USA, Europe).png</cover>
<image>./media/screenshots/10-Yard Fight (USA, Europe).png</image>
<marquee>./media/marquees/10-Yard Fight (USA, Europe).png</marquee>
<video>./media/videos/10-Yard Fight (USA, Europe).mp4</video>
<rating>0.9</rating>
<desc>10-Yard Fight (USA, Europe)</desc>
<releasedate>1985</releasedate>
<developer>Nintendo</developer>
<publisher>Nintendo</publisher>
<genre>Sports/Football</genre>
<players>2</players>
</game>

MotoGp

@bhakta said in RetroPi Media - gamelist.xml generator:

Can I give it a go?
I wanted to convert hyperspin and nfo files to pegasus but it's painfully slow to manually do it. even using scripts and trying to get everything right in regex.

TIA

Please give it a try and let me know if you have an issues, thanks

davidonabus

@MotoGp I'm giving this a go. I pointed the app to my roms folder (arcade) and I received the following error:

Source File Error

Action cancelled.

Source File does not have correct number of attributes

ROM: ./005.zip Only has: 4

OK

MotoGp

@davidonabus said in RetroPi Media - gamelist.xml generator:

@MotoGp I'm giving this a go. I pointed the app to my roms folder (arcade) and I received the following error:

Source File Error

Action cancelled.

Source File does not have correct number of attributes

ROM: ./005.zip Only has: 4

OK

When reading the gamelist.xml file, I added code to check to see how many attributes each game has. I found that some of the "scrapers" were inconsistant with what information it wrote for each game. So if you open your gamelist.xml and scoll down to the game 005.zip you will see that between the <game> & </game> there are only 4 nodes like <path><Image> etc. can you post the xml data from you game list for this particular game? I guess I could edit the code to still import it but you may only get the game name. Posting a snippet of your xml will be helpful. What scraper did you use?

rand0m

@MotoGp the file is txt named after the system like if the system is named genesis the filed created will be genesis.txt. The file uses ; as separator with every entry (game) being on a separate line and has following structure:

#Name;Title;Emulator;CloneOf;Year;Manufacturer;Category;Players;Rotation;Control;Status;DisplayCount;DisplayType;AltRomname;AltTitle;Extra;Buttons

Example:

Bank Heist (USA);Bank Heist;;;1983;Fox;Puzzle;;;;;;;;;;

MotoGp

@MotoGp said in RetroPi Media - gamelist.xml generator:

@davidonabus said in RetroPi Media - gamelist.xml generator:

@MotoGp I'm giving this a go. I pointed the app to my roms folder (arcade) and I received the following error:

Source File Error

Action cancelled.

Source File does not have correct number of attributes

ROM: ./005.zip Only has: 4

OK

When reading the gamelist.xml file, I added code to check to see how many attributes each game has. I found that some of the "scrapers" were inconsistant with what information it wrote for each game. So if you open your gamelist.xml and scoll down to the game 005.zip you will see that between the <game> & </game> there are only 4 nodes like <path><Image> etc. can you post the xml data from you game list for this particular game? I guess I could edit the code to still import it but you may only get the game name. Posting a snippet of your xml will be helpful. What scraper did you use?

I rewrote the code around this. Now if an attribute is missing like Genre, it will just leave it blank.
I updated the zip here.
https://www.dropbox.com/s/3bpa8435bfe6luv/RetroPieMedia Release 2.zip?dl=0

MotoGp

@rand0m said in RetroPi Media - gamelist.xml generator:

@MotoGp the file is txt named after the system like if the system is named genesis the filed created will be genesis.txt. The file uses ; as separator with every entry (game) being on a separate line and has following structure:

#Name;Title;Emulator;CloneOf;Year;Manufacturer;Category;Players;Rotation;Control;Status;DisplayCount;DisplayType;AltRomname;AltTitle;Extra;Buttons

Example:

Bank Heist (USA);Bank Heist;;;1983;Fox;Puzzle;;;;;;;;;;
that would be pretty easy to create.
So there is a file per system like nes.txt, atari2600.txt and in each txt it contains the all of the games? or do you select the games you want?

MotoGp

@rand0m said in RetroPi Media - gamelist.xml generator:

@MotoGp the file is txt named after the system like if the system is named genesis the filed created will be genesis.txt. The file uses ; as separator with every entry (game) being on a separate line and has following structure:

#Name;Title;Emulator;CloneOf;Year;Manufacturer;Category;Players;Rotation;Control;Status;DisplayCount;DisplayType;AltRomname;AltTitle;Extra;Buttons

Example:

Bank Heist (USA);Bank Heist;;;1983;Fox;Puzzle;;;;;;;;;;

Ok, I created this script for you. Where is the text file stored? In the root of the roms folder?

Here is a sample output for one system.

Aggressive Inline (USA);Aggressive Inline (USA);;;2002;Acclaim;Skating/Sports;;;;;;;;;;
AirForce Delta Storm (USA) (En,Ja,Fr,De);AirForce Delta Storm (USA) (En,Ja,Fr,De);;;2002;Konami;Shoot-'Em-Up;;;;;;;;;;
Aladdin (USA) (En,Fr,De,Es);Aladdin (USA) (En,Fr,De,Es);;;2004;Capcom;Platform;;;;;;;;;;
Alex Rider - Stormbreaker (USA);Alex Rider - Stormbreaker (USA);;;2006;THQ;Action;;;;;;;;;;
Alien Hominid (Europe) (En,Fr,De,Es,It);Alien Hominid (Europe) (En,Fr,De,Es,It);;;2006;Zoo Digital Publishing;Shooter;;;;;;;;;;
Alienators - Evolution Continues (USA, Europe);Alienators - Evolution Continues (USA, Europe);;;2001;Activision;Action;;;;;;;;;;
All Grown Up! - Express Yourself (USA, Europe);All Grown Up! - Express Yourself (USA, Europe);;;2004;THQ;Miscellaneous;;;;;;;;;;
All-Star Baseball 2003 (USA);All-Star Baseball 2003 (USA);;;2002;Acclaim;Baseball/Sports;;;;;;;;;;
All-Star Baseball 2004 (USA);All-Star Baseball 2004 (USA);;;2003;Acclaim;Baseball/Sports;;;;;;;;;;
Altered Beast - Guardian of the Realms (USA);Altered Beast - Guardian of the Realms (USA);;;2002;THQ;Beat-'Em-Up;;;;;;;;;;
Amazing Virtual Sea-Monkeys, The (USA);Amazing Virtual Sea-Monkeys, The (USA);;;2002;Conspiracy Entertainment;Action;;;;;;;;;;

rand0m

@MotoGp Thanks, every system has a separate list and only contains the items (roms) present in the rom directory ( given by user) if list is created through Attrcat-Mode. Otherwise a romlist can contain all items even those not present in a rom directory, users can then create a filter which only displays items which actually exist.

In PC the romlists are stored in Attrcat-Mode (root folder)\romlists. The sample is spot on.

MotoGp

@rand0m said in RetroPi Media - gamelist.xml generator:

@MotoGp Thanks, every system has a separate list and only contains the items (roms) present in the rom directory ( given by user) if list is created through Attrcat-Mode. Otherwise a romlist can contain all items even those not present in a rom directory, users can then create a filter which only displays items which actually exist.

In PC the romlists are stored in Attrcat-Mode (root folder)\romlists. The sample is spot on.

The latest release includes this function. It will only export games where the check box "include" is checked. The default is if the rom is found it is checked. So if there is a rom you don't want o include, you can just uncheck it. My only question is for the #name should it have the ROM extension?

Latest build is here 9/23/2019
https://www.dropbox.com/s/3bpa8435bfe6luv/RetroPieMedia Release.zip?dl=0

rand0m

@MotoGp #name does not include ROM extension, the rom "penny.bin" will be "penny" in #name. I checked out the app today, brilliant work. One thing I wish is that we also get the option to add rom folder (with options for including subfolders) then compare that to hyperlist file.