EmulationStation mod

mattrixk

Floob

@jacobfk20
I used your grid view version of ES in the experimental image I built here, hope thats ok with you.
https://retropie.org.uk/forum/topic/93/attract-mode-with-retropie-alternative-to-emulationstation/213

jacobfk20

@Floob Yes, that's fine by me. Thanks for letting me know. I just want you to know that I'm still working on it quite a bit.

Also, I took a quick look at your work. Looking good :)

Floob

@jacobfk20 Am I right in thinking that your latest grid view version dropped some of the earlier features like "view storage" etc... ?
When you have a new version ready, I'll happily make a video of it if you like.

jacobfk20

@Floob Sorta. My latest gridview branch is just for gridview. I'll be doing other branches for On Screen Keyboard, System Menu, and other small things I've done pretty soon.

A video would be pretty nice as I'm getting close to finishing up this current version.

meleu

@jacobfk20 said in EmulationStation mod:

I put together a simple quick branch that will only save metadata if that system has had any changes to its metadata.

https://github.com/jacobfk20/EmulationStation/tree/Metadata

@jacobfk20 sorry for the delay. I've tested your Metadata branch.

Those 5 minutes were reduced to less then 1 second!

To not save times played is a good price to pay (I don't even care about this :-) ).

Zigurana

@meleu said in EmulationStation mod:

To not save times played is a good price to pay (I don't even care about this :-) ).

I agree.
The main features you get by this function is

quickly get back to the game you were playing earlier.
discover games you never played before.

I think it would be better to build a separate list of recently played games (n=10), where you can get back to easily.
When combined it with the "surprise me" function fron de kid-friendly branch, It would offer about the same functionality.

gomisensei

@meleu I still think a separate stats.xml that saves only the name, and times played/total time/last time, separate from any other metadata would be a good idea, especially if it could be optionally turned off.

jacobfk20

@meleu Glad to hear it works. I actually kinda forgot I made that branch lol. Can you still change metadata and it still save? How long does it take for you to save on exit when you change one system's gamedata?

@Zigurana @gomisensei I thought that as I made that branch. I'm wanting to check that out sometime soon especially after hearing that it works for someone that has long save times. But you guys are right, normalizing the gamelist out would be pretty beneficial.

jacobfk20

@meleu Are most of your games that are in those big lists (1000+ roms) not scraped or have metadata?

meleu

@jacobfk20 man! really really sorry! I forgot to give you an important feedback! The ES from Metadata branch didn't even touch the gamelist.xml.

I saw the last changed time with ls -l and all the gamelist.xml was last changed when I last tested the default RetroPie ES with "save metada on exit" turned on. And it was in 2016-Aug-15. After I installed the Metadata these files didn't change and I'm sure that the "save metadata on exit" is on.

Now, answering your question:

@jacobfk20 said in EmulationStation mod:

Are most of your games that are in those big lists (1000+ roms) not scraped or have metadata?

The romsets are scraped but some ROMs failed to get scraped. I don't have the exact number...

jacobfk20

@meleu Yes, if nothing changed in that system's metadata it will not bother saving anything, so gameList will not be touched. A gamelist will only be saved to if you change any metadata on any of that system's games.

meleu

@jacobfk20 but I played a bunch of games to make the tests (nes, snes, megadrive and mastersystem). I'll test it again detailing each steps. More info tonight.

jacobfk20

In that build playing a game doesn't justify saving metadata. Times played, and last time played do not trigger metadata to save. Editing game metadata and scraping will trigger a save.

Anyway, would you be willing to run two tests for me? It will require running two different builds though. I think I may have found the biggest cause of what makes saving metadata take so long and I would like to have a before and after comparison.

meleu

@jacobfk20 said in EmulationStation mod:

In that build playing a game doesn't justify saving metadata. Times played, and last time played do not trigger metadata to save. Editing game metadata and scraping will trigger a save.

Sorry if I misunderstanding, but then I think it's almost useless :-)
I only scrape and/or edit gamelist.xml when ES is not running. I only see use cases for it when using the ES scraper and using the trick to scrape screenshots.

Anyway, would you be willing to run two tests for me? It will require running two different builds though. I think I may have found the biggest cause of what makes saving metadata take so long and I would like to have a before and after comparison.

Aye aye Captain!

Since I don't have enough C++ skills to contribute with the code, I'm happy to help as a tester. :-)

jacobfk20

@meleu lol, I could have it save when "times played" and "last time played" are updated.

These two builds I want you to run save everything no matter what (unless you have "save on exit" turned off) but this time they log how long in seconds it took per system and how many loop cycles to terminal and es_log. So when you run the first build, save the es_log (~/.emulationstation) then run the next build and save it's log somewhere and send them both to me.

The second build could potentially lower the save time by quite a bit.
I'll post the builds and full instructions I want you to run here in a few.

jacobfk20

@meleu Alright, The two builds are ready. First thing: They are pretty safe but PLEASE backup your gamelists just to be 100% safe. I've ran these a tests a good chunk of times but you can never be too sure.

Copy over the emulationstation in test1 and run it. (you can run this anywhere on your pi it doesn't have to overwrite what is in /opt/retropie/supplementary/emulationstation) You'll need to set it as executable with 'chmod +x emulationstation' (no quotes)
After ES loads, make sure you have "Save on Exit" turned on and exit ES. It'll save normally (this will take the original wait time you normally would expect)
After its fully closed, grab a copy of the es_log and name it something like "es_log-1" or something (Log is located in ~/.emulationstation)
Copy over the emulationstation in test2, make it executable, and run it.
After loaded, Make sure save on exit is still enabled and close ES. ( This time should be reduced. It reports times as well.)
Copy and rename the new es_log.
Send me the two es_logs you saved.

Grab the two builds from my drive

You can email me the logs at my gmail. (My gmail is the same as my username here)

No hurries :)

meleu

@jacobfk20 Done! The test2 build is much faster in updating the metadata! Tested both with just exiting ES, and exiting after playing 2 or 3 games. I hope it helps.

jacobfk20

@meleu Thank you! It looks like I was correct. You went from a hair over 5 minutes to 9-10 seconds on exit now. It wasn't having much impact on my exit time (2 seconds to 1.4 seconds) but I'm glad to see it works on someone that has long exit times.

I did the math with the data given from the es_logs and the new method saves you 2,967,762 cycles in a while loop. That's insane!!

Is 10 seconds manageable? lol, I don't think I can get it any faster.

Anyway, I'm going to clean this branch up and may do a PR. Thanks again for doing the test. :)

lilbud

Where would be able to theme the carousel bar rank on your to do list?