RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Metadata Improvements in EmulationStation

    Scheduled Pinned Locked Moved Ideas and Development
    emulationstationmetadatadevelopment
    73 Posts 15 Posters 31.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      MWGemini @Nismo
      last edited by MWGemini

      @Nismo What language? If you could tell me what steps you take to translate it, I might be able to automate it.

      @screech Email sent.

      N 1 Reply Last reply Reply Quote 0
      • N
        Nismo @MWGemini
        last edited by Nismo

        @MWGemini I translate it to spanish and it's a hard work, there are a lot of files to be edited in the source code, anyway if you still want to compile it in 2 languages, I can translate the source code files and send to you a "translate source code" to compile.

        I hope in the near future we can have a commit that include the ES strings in a strings.xml or something like that for easy translate ES to other languages, also it's nice for kids that doesn't speak english.

        @screech I really, absolutely really apreciate the work you are doing with UXS, very nice work.

        Thank you both.

        1 Reply Last reply Reply Quote 0
        • mattrixkM
          mattrixk @screech
          last edited by

          @screech I love your scraper. I had very little trouble setting up a Scrape Profile that downloads box art, fan art, screenshot, wheel/logo and a video for each ROM in a system, appends "-boxart", "-fanart", "-screenshot", "-logo" and "-video" to the file name and then creates a gamelist.xml that spits out <boxart>, <fanart>, <screenshot> etc. I even have it set so you can choose 2D or 3D box art, and if you want normal, black or chrome wheel/logo art.

          The only things I need for it now are being able to download different sized images within the one Scrape Profile, and fixing the bug where it wasn't getting all the images (even though the Mix profile gets them). Both of these are things I've already mentioned in the other thread.

          Maybe the gurus here will be able to come up with a way to automatically import xml files into the database. I think we'd have to agree on a standardised naming system at some point, just to help things go smoothly.

          My ES themes: MetaPixel | Spare | Io | Indent

          1 Reply Last reply Reply Quote 0
          • mattrixkM
            mattrixk @MWGemini
            last edited by

            @MWGemini I've never heard of Travis CL? What is it/what does it do? How would a simple user such as myself make use of it?

            My ES themes: MetaPixel | Spare | Io | Indent

            M 1 Reply Last reply Reply Quote 0
            • screechS
              screech
              last edited by

              @mattrixk I already watch to the "code" to add a new node in Profil XML to put a size "by media" ^^ but it's not so easy because I haven't anticipate this :S but I promise ;) I will try ;)

              mattrixkM 1 Reply Last reply Reply Quote 1
              • M
                MWGemini @mattrixk
                last edited by MWGemini

                @mattrixk said in Metadata Improvements in EmulationStation:

                @MWGemini I've never heard of Travis CL? What is it/what does it do? How would a simple user such as myself make use of it?

                It's an automated build system. When linked to GitHub, it watches for code changes, which then triggers a build script to be run. Basically, every time someone commits code to a repository, you can have the entire project be built and deployed automatically. It's not something that an end user would set up- a developer associated with the GitHub repository would need to do it. However, end users would benefit by having the latest builds always readily available, and developers benefit by not having to do that process manually.

                @Nismo I hadn't considered that ES doesn't support translation already- I assumed it already had that feature. It would definitely be possible to add that, but it won't be a trivial task. Edit:I looked into it a bit further. RecalBox already has this functionality, so it might actually be not-too-painful to port that code over to this fork of EmulationStation. That's a separate topic, however.

                N 1 Reply Last reply Reply Quote 1
                • N
                  Nismo @MWGemini
                  last edited by Nismo

                  @MWGemini Yes I supposed that it's a lot of work, but I don't loose my hope...

                  1 Reply Last reply Reply Quote 0
                  • mattrixkM
                    mattrixk @screech
                    last edited by mattrixk

                    @screech: I appreciate all the work you've put into this excellent scraper. While the feature of downloading media in different sizes would be fantastic, for the time being I have a work around of just downloading everything in a larger size and then resizing them manually using FastStone Image Resizer. It's a bit more work, but it does the job.

                    Also, there is no real rush on that, as I mainly want this ability for when/if we get these new image metadata elements added into ES.

                    @MWGemini: that sounds like it would be exceedingly awesome.

                    My ES themes: MetaPixel | Spare | Io | Indent

                    M 1 Reply Last reply Reply Quote 0
                    • M
                      MWGemini @mattrixk
                      last edited by

                      @mattrixk Which part, the automated builds, the multi-language support, or the visual theme editor?

                      lilbudL mattrixkM 2 Replies Last reply Reply Quote 0
                      • lilbudL
                        lilbud @MWGemini
                        last edited by

                        @MWGemini theme editor for sure

                        Creator of the Radiocade: https://retropie.org.uk/forum/topic/6077/radiocade

                        Backlog: http://backloggery.com/lilbud

                        1 Reply Last reply Reply Quote 0
                        • mattrixkM
                          mattrixk @MWGemini
                          last edited by

                          @MWGemini I was mainly thinking about the automated builds. I personally don't have any use for the language support (but I do realise how great it would be for people who need/want it). I'm also not really sure how the visual theme editor would work, but if you want to take a crack at it, I'll gladly try testing it out/giving some input.

                          My ES themes: MetaPixel | Spare | Io | Indent

                          M 1 Reply Last reply Reply Quote 0
                          • M
                            MWGemini @mattrixk
                            last edited by MWGemini

                            @mattrixk @lilbud right now my priority is in helping @fieldofcows with the stuff he is working on. He's the hero of this thread and I think he's doing a lot of great development on EmulationStation. I've only been testing the work he's done, I haven't done any development on ES, so I don't want to steal his thunder.

                            If/when I get a bit more free time, I want to help @fieldofcows implement the changes mentioned in this thread (assuming he wants/needs the help), and after that, I'll probably try to pull in language support, grid view, theme system improvements, and then I'll work on the visual editor (assuming someone hasn't beaten me to it by that point).

                            Since the thread has gone a bit of topic, I'll try to steer it back. @fieldofcows, I've modified the database design document I sent you, thanks to input from @mattrixk , @sselph, and @screech. I think we have a very solid design in place, and if you agree with it, I can start writing some of the SQL for it (or build/test automation, or something else, if you have a request/idea) this week, if you want.

                            mattrixkM fieldofcowsF 2 Replies Last reply Reply Quote 3
                            • mattrixkM
                              mattrixk @MWGemini
                              last edited by

                              @MWGemini said in Metadata Improvements in EmulationStation:

                              @fieldofcows [is] the hero of this thread and I think he's doing a lot of great development on EmulationStation.

                              Hear hear!

                              My ES themes: MetaPixel | Spare | Io | Indent

                              1 Reply Last reply Reply Quote 2
                              • fieldofcowsF
                                fieldofcows @MWGemini
                                last edited by

                                @MWGemini said in Metadata Improvements in EmulationStation:

                                He's the hero of this thread

                                Aww thanks! I'm letting you lot discuss these issues for a little while while I finish the WSOD issue. I'll get back to the metadata in due course...

                                M 1 Reply Last reply Reply Quote 0
                                • M
                                  MWGemini @fieldofcows
                                  last edited by

                                  @herb_fargus @Buzz I'd love to get your input on the design doc I've been working on as well. I'm assuming you're both able to send private messages, so if you'd like to PM me your email address, I can share the Google doc with you. I've been getting the input of some of the community's biggest contributors (scraper authors, theme designers, etc.), and it's still a work-in-progress, but I think we've got a very robust design.

                                  BuZzB 1 Reply Last reply Reply Quote -1
                                  • BuZzB
                                    BuZz administrators @MWGemini
                                    last edited by BuZz

                                    @MWGemini no pm on forum. Can't you just post a link? No need to discuss in private.

                                    To help us help you - please make sure you read the sticky topics before posting - https://retropie.org.uk/forum/topic/3/read-this-first

                                    1 Reply Last reply Reply Quote 0
                                    • darkniorD
                                      darknior
                                      last edited by

                                      Woaw ... really impressive work here ... i dream about this option from a long time :D
                                      More METADATA, FILTERS, VIEW ... FASTER ... so incredible ;)

                                      Life is game, just play it !

                                      S 1 Reply Last reply Reply Quote 0
                                      • S
                                        sp00k @darknior
                                        last edited by sp00k

                                        has anyone experimented with different xml parsers?
                                        i use perl for hacky things, and reading my largest gamelist.xml went from 48 -> 7 seconds by using a different parser.
                                        eg: sax instead of dom

                                        N J 2 Replies Last reply Reply Quote 0
                                        • N
                                          Nismo @sp00k
                                          last edited by

                                          @sp00k interesting... how do you do that?

                                          More info about sax and dom: http://stackoverflow.com/questions/6828703/what-is-the-difference-between-sax-and-dom

                                          1 Reply Last reply Reply Quote 0
                                          • J
                                            jdrassa @sp00k
                                            last edited by

                                            @sp00k I am not sure that switch the xml parser would have much impact here. Any speed improvements would only effect startup. Also the speed improvements you saw may not even be realized in EmulationStation. ES needs to read every element in the xml file. If your tests were only reading specific elements, then they wouldn't be indicative of the performance we would see in ES.

                                            Get latest build of EmulationStation for Windows here

                                            S 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.