Navigation

    RetroPie forum home
    • Register
    • Login
    • Search
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    Please do not post a support request without first reading and following the advice in https://retropie.org.uk/forum/topic/3/read-this-first

    I need your help: Web based ROM visualization

    Ideas and Development
    visualization web
    6
    16
    2699
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • daeks
      daeks last edited by daeks

      could you share your webcode with us? I can try with huge gamelists as well.

      1 Reply Last reply Reply Quote 0
      • MWGemini
        MWGemini @Arcuza last edited by

        @Arcuza I have about 63,000 ROMS across something like 18 systems, but I have not scraped all of them. In fact, most are not scraped. I haven't yet had the chance to perfect all of my gamelists, because I'm planning/hoping to replace gamelists with a database in the not too distant future.

        It should be pretty easy for you to create data to load-test your system, though. Writing XML is pretty easy, so you could just create a program to create a random name and some random data for it, and loop as many times as you want.

        Arcuza 1 Reply Last reply Reply Quote 0
        • Arcuza
          Arcuza @MWGemini last edited by

          @MWGemini Thank you for your support. I ran into a problem today when testing Herb Fargus data, and that's dealing with many-to-many relationships. I didn't solve that during the day, but I'm on my way.

          The code is already finished when receiving expected data, now I want to test what happens when running into unexpected data.

          Thank you

          1 Reply Last reply Reply Quote 0
          • joyrider3774
            joyrider3774 last edited by

            Will it eventually be running from the pi itselve somehow so you can access a webserver on the pi and view all this data ? Do you have some screenshots i wonder how it looks like

            Arcuza 1 Reply Last reply Reply Quote 0
            • Arcuza
              Arcuza @joyrider3774 last edited by

              @joyrider3774 It's dependant on that the web server is able to push the gamelist.xml through a HTTPRequest. All is client side, so all data is processed in the browser. Of course you can run a web browser on the PI, but I think it would be too slow. In that case I would rather make it native on the PI in C++. But I need to learn Linux graphics, io and input since I've never done that before.

              I just have to solve null data and finite/rational data filtering first. Then you can have a full blown demo.

              1 Reply Last reply Reply Quote 0
              • Arcuza
                Arcuza @herb_fargus last edited by

                @herb_fargus Thank you for your help. You don't have a well scraped set with several consoles? Is there one gamelist.xml for each console?

                herb_fargus 2 Replies Last reply Reply Quote 0
                • herb_fargus
                  herb_fargus administrators @Arcuza last edited by

                  @Arcuza yes as far as I know there is one gamelist.xml per system.

                  I don't really have massive romsets so I don't really have any lists.

                  I'm sure there are plenty of others the forum that do though

                  1 Reply Last reply Reply Quote 0
                  • herb_fargus
                    herb_fargus administrators @Arcuza last edited by

                    @Arcuza I found another one for NES

                    https://drive.google.com/open?id=0B2TMeZ6iEFvHVTEtLWNubk00ZEE

                    Arcuza 1 Reply Last reply Reply Quote 0
                    • Arcuza
                      Arcuza @herb_fargus last edited by

                      @herb_fargus Hi, do these gamelists.xml have different schemas per console, or do they follow a standard? Do anyone know? Is there a document describing this?

                      herb_fargus 1 Reply Last reply Reply Quote 0
                      • herb_fargus
                        herb_fargus administrators @Arcuza last edited by

                        @Arcuza they should be the same for every system.

                        https://github.com/Aloshi/EmulationStation/blob/master/GAMELISTS.md

                        1 Reply Last reply Reply Quote 0
                        • Jeck11
                          Jeck11 last edited by

                          Found this set online. Maybe it'll help ya.

                          https://dl.dropboxusercontent.com/u/23090041/gamelists.rar

                          1 Reply Last reply Reply Quote 0
                          • Arcuza
                            Arcuza last edited by

                            Seems like I'm into some nasty mathematics issues, regarding the filters and decimal values.

                            But, at least you can have a nonworking look here:

                            http://elitlogik.se/visualizer.html (Data in this demo is based on herb_fargus NES gamelist)

                            Things that needs to be done:

                            • Fix handling of null values
                            • Be able to set custom color schemes and directions (now its green for low and red for high)
                            • Fix the darn Filters to work better
                            • Sort the selectables descending, maybe group "others" if less than 1%
                            • XMLHttpRequest to recieve the gamelist.xml of your own Retropie

                            In a far future maybe having some nice options when clicking on a game title in the rectangles, like editing, commenting or socializing with your friends on facebook ;)

                            Do you have any suggestions, please post.

                            herb_fargus 1 Reply Last reply Reply Quote 0
                            • herb_fargus
                              herb_fargus administrators @Arcuza last edited by

                              @Arcuza to add a cog into your system emulationstation was just updated recently to include video and marquee tags as well just fyi

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post

                              Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                              Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.