Navigation

    RetroPie forum home
    • Register
    • Login
    • Search
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    I need your help: Web based ROM visualization

    Ideas and Development
    visualization web
    6
    16
    2699
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • herb_fargus
      herb_fargus administrators @Arcuza last edited by

      @Arcuza you mean a gamelist.xml for a fully scraped set?

      I have one here for mame:

      https://github.com/HerbFargus/Mame-Extras/tree/master/mame-2003/snaps

      It doesn't have all the tags, mostly just for images and game names but it's a start.

      Looking forward to seeing what you come up with

      Arcuza 2 Replies Last reply Reply Quote 0
      • Arcuza
        Arcuza @herb_fargus last edited by

        @herb_fargus Thank you very much! I'll start with this data and give you a demo tomorrow. Is it possible to gather more meta data? Especially times played, date last played, rom file size and perhaps rating? Doesn't Emulation Station produce some kind of metadata as well?

        MWGemini 1 Reply Last reply Reply Quote 0
        • daeks
          daeks last edited by daeks

          could you share your webcode with us? I can try with huge gamelists as well.

          1 Reply Last reply Reply Quote 0
          • MWGemini
            MWGemini @Arcuza last edited by

            @Arcuza I have about 63,000 ROMS across something like 18 systems, but I have not scraped all of them. In fact, most are not scraped. I haven't yet had the chance to perfect all of my gamelists, because I'm planning/hoping to replace gamelists with a database in the not too distant future.

            It should be pretty easy for you to create data to load-test your system, though. Writing XML is pretty easy, so you could just create a program to create a random name and some random data for it, and loop as many times as you want.

            Arcuza 1 Reply Last reply Reply Quote 0
            • Arcuza
              Arcuza @MWGemini last edited by

              @MWGemini Thank you for your support. I ran into a problem today when testing Herb Fargus data, and that's dealing with many-to-many relationships. I didn't solve that during the day, but I'm on my way.

              The code is already finished when receiving expected data, now I want to test what happens when running into unexpected data.

              Thank you

              1 Reply Last reply Reply Quote 0
              • joyrider3774
                joyrider3774 last edited by

                Will it eventually be running from the pi itselve somehow so you can access a webserver on the pi and view all this data ? Do you have some screenshots i wonder how it looks like

                Arcuza 1 Reply Last reply Reply Quote 0
                • Arcuza
                  Arcuza @joyrider3774 last edited by

                  @joyrider3774 It's dependant on that the web server is able to push the gamelist.xml through a HTTPRequest. All is client side, so all data is processed in the browser. Of course you can run a web browser on the PI, but I think it would be too slow. In that case I would rather make it native on the PI in C++. But I need to learn Linux graphics, io and input since I've never done that before.

                  I just have to solve null data and finite/rational data filtering first. Then you can have a full blown demo.

                  1 Reply Last reply Reply Quote 0
                  • Arcuza
                    Arcuza @herb_fargus last edited by

                    @herb_fargus Thank you for your help. You don't have a well scraped set with several consoles? Is there one gamelist.xml for each console?

                    herb_fargus 2 Replies Last reply Reply Quote 0
                    • herb_fargus
                      herb_fargus administrators @Arcuza last edited by

                      @Arcuza yes as far as I know there is one gamelist.xml per system.

                      I don't really have massive romsets so I don't really have any lists.

                      I'm sure there are plenty of others the forum that do though

                      1 Reply Last reply Reply Quote 0
                      • herb_fargus
                        herb_fargus administrators @Arcuza last edited by

                        @Arcuza I found another one for NES

                        https://drive.google.com/open?id=0B2TMeZ6iEFvHVTEtLWNubk00ZEE

                        Arcuza 1 Reply Last reply Reply Quote 0
                        • Arcuza
                          Arcuza @herb_fargus last edited by

                          @herb_fargus Hi, do these gamelists.xml have different schemas per console, or do they follow a standard? Do anyone know? Is there a document describing this?

                          herb_fargus 1 Reply Last reply Reply Quote 0
                          • herb_fargus
                            herb_fargus administrators @Arcuza last edited by

                            @Arcuza they should be the same for every system.

                            https://github.com/Aloshi/EmulationStation/blob/master/GAMELISTS.md

                            1 Reply Last reply Reply Quote 0
                            • Jeck11
                              Jeck11 last edited by

                              Found this set online. Maybe it'll help ya.

                              https://dl.dropboxusercontent.com/u/23090041/gamelists.rar

                              1 Reply Last reply Reply Quote 0
                              • Arcuza
                                Arcuza last edited by

                                Seems like I'm into some nasty mathematics issues, regarding the filters and decimal values.

                                But, at least you can have a nonworking look here:

                                http://elitlogik.se/visualizer.html (Data in this demo is based on herb_fargus NES gamelist)

                                Things that needs to be done:

                                • Fix handling of null values
                                • Be able to set custom color schemes and directions (now its green for low and red for high)
                                • Fix the darn Filters to work better
                                • Sort the selectables descending, maybe group "others" if less than 1%
                                • XMLHttpRequest to recieve the gamelist.xml of your own Retropie

                                In a far future maybe having some nice options when clicking on a game title in the rectangles, like editing, commenting or socializing with your friends on facebook ;)

                                Do you have any suggestions, please post.

                                herb_fargus 1 Reply Last reply Reply Quote 0
                                • herb_fargus
                                  herb_fargus administrators @Arcuza last edited by

                                  @Arcuza to add a cog into your system emulationstation was just updated recently to include video and marquee tags as well just fyi

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post

                                  Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                  Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.