RetroPie forum home
    • Recent
    • Tags
    • Popular
    • Home
    • Docs
    • Register
    • Login

    Gamelist Excel export script

    Scheduled Pinned Locked Moved Ideas and Development
    emulationstatioexportgamelist
    126 Posts 19 Posters 33.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      MrSco
      last edited by MrSco

      It looks like C64, pastebin

      pi@retropie:~ $ python export.py /home/pi/RetroPie/roms/export_list.xlsx -d 2018-02-18 16:33:03,732 DEBUG Starting
      2018-02-18 16:33:03,733 INFO Emulationstation systems file used: /home/pi/.emulationstation/es_systems.cfg
      2018-02-18 16:33:03,776 INFO System Kodi is skipped as configured
      2018-02-18 16:33:03,777 DEBUG Analyzing system: Commodore Amiga (amiga)
      2018-02-18 16:33:03,796 DEBUG ROM A-Train_Disk1 not found in /home/pi/RetroPie/roms/amiga, removed from export
      2018-02-18 16:33:03,798 DEBUG Found 1 game(s) for Commodore Amiga (amiga)
      2018-02-18 16:33:03,799 DEBUG Analyzing system: Amstrad CPC (amstradcpc)
      2018-02-18 16:33:03,802 DEBUG Found 0 game(s) for Amstrad CPC (amstradcpc)
      2018-02-18 16:33:03,803 DEBUG System amstradcpc has no games/roms, it's excluded from the export
      2018-02-18 16:33:03,804 DEBUG Analyzing system: Arcade (arcade)
      2018-02-18 16:33:07,499 DEBUG Found 2147 game(s) for Arcade (arcade)
      2018-02-18 16:33:07,500 DEBUG Analyzing system: Atari 2600 (atari2600)
      2018-02-18 16:33:08,648 DEBUG Found 646 game(s) for Atari 2600 (atari2600)
      2018-02-18 16:33:08,649 DEBUG Analyzing system: Atari 5200 (atari5200)
      2018-02-18 16:33:08,761 DEBUG Found 64 game(s) for Atari 5200 (atari5200)
      2018-02-18 16:33:08,763 DEBUG Analyzing system: Atari 7800 ProSystem (atari7800)
      2018-02-18 16:33:08,887 DEBUG Found 63 game(s) for Atari 7800 ProSystem (atari7800)
      2018-02-18 16:33:08,887 DEBUG Analyzing system: Atari 800 (atari800)
      2018-02-18 16:33:08,889 DEBUG Found 0 game(s) for Atari 800 (atari800)
      2018-02-18 16:33:08,889 DEBUG System atari800 has no games/roms, it's excluded from the export
      2018-02-18 16:33:08,890 DEBUG Analyzing system: Atari Lynx (atarilynx)
      2018-02-18 16:33:09,024 DEBUG Found 76 game(s) for Atari Lynx (atarilynx)
      2018-02-18 16:33:09,025 DEBUG Analyzing system: Atari ST (atarist)
      2018-02-18 16:33:09,027 DEBUG Found 0 game(s) for Atari ST (atarist)
      2018-02-18 16:33:09,028 DEBUG System atarist has no games/roms, it's excluded from the export
      2018-02-18 16:33:09,029 DEBUG Analyzing system: Commodore 64 (c64)
      Traceback (most recent call last):
      File "export.py", line 460, in <module>
      systems = parse_systems()
      File "export.py", line 241, in parse_systems
      rom = Game(game)
      File "export.py", line 146, in init
      self.info[attr] = get_xml_element_date(obj, attr)
      File "export.py", line 69, in get_xml_element_date
      if len(date_text) < len('19860101T000000'):
      TypeError: object of type 'NoneType' has no len()

      mituM 1 Reply Last reply Reply Quote 0
      • M
        MrSco
        last edited by

        Ok, I made a couple edits https://pastebin.com/uT9TjqGR to fix the errors but now I'm hitting this while writing the excel file. I get the file but it errors...

        2018-02-18 17:46:16,871 INFO Total games after parsing gamelist files - 13005
        2018-02-18 17:46:16,872 INFO Exporting to file /home/pi/RetroPie/roms/export_list.xlsx
        /usr/local/lib/python2.7/dist-packages/XlsxWriter-1.0.2-py2.7.egg/xlsxwriter/worksheet.py:2348: UserWarning: Name looks like a cell name in add_table(): 'c64'
        /usr/local/lib/python2.7/dist-packages/XlsxWriter-1.0.2-py2.7.egg/xlsxwriter/worksheet.py:2348: UserWarning: Name looks like a cell name in add_table(): 'n64'
        /usr/local/lib/python2.7/dist-packages/XlsxWriter-1.0.2-py2.7.egg/xlsxwriter/worksheet.py:2342: UserWarning: Invalid Excel characters in add_table(): 'sg-1000'
        Traceback (most recent call last):
        File "export.py", line 468, in <module>
        xlsx_export_workbook(systems, output)
        File "export.py", line 392, in xlsx_export_workbook
        xlsx_export_system_row(wb, sheet, j+1, g, g.info["system"])
        File "export.py", line 434, in xlsx_export_system_row
        game.info['desc'], {'x_scale': 4, 'y_scale': 4})
        File "build/bdist.linux-armv7l/egg/xlsxwriter/worksheet.py", line 65, in cell_wrapper
        File "build/bdist.linux-armv7l/egg/xlsxwriter/worksheet.py", line 1150, in write_comment
        TypeError: object of type 'NoneType' has no len()

        1 Reply Last reply Reply Quote 0
        • mituM
          mitu Global Moderator @MrSco
          last edited by

          @mrsco I've found the error, can you re-download the script and try again ?

          1 Reply Last reply Reply Quote 0
          • mituM
            mitu Global Moderator @cyperghost
            last edited by

            @cyperghost Sorry, I didn't see your update (probably edited). I've corrected the link, so the : is removed.
            I've thought about adding the custom collections part, I just don't use any and didn't know they're saved. I'll see about this next week and give it a try.

            1 Reply Last reply Reply Quote 1
            • cyperghostC
              cyperghost
              last edited by

              @mitu No problem
              custom collections are stored in /opt/retropie/configs/all/emulationstation/collections

              and their naming is always custom-AaBbCcDdEe.cfg
              AaBbCcDdEe represents the name of the collection ;)

              Inside is just plain text with Romname and complete path.

              Take a look here

              mituM 2 Replies Last reply Reply Quote 0
              • PokeEngineerP
                PokeEngineer @mitu
                last edited by

                @mitu

                Huh, neat.

                Don't sweat it.
                When in doubt, take a BYTE out of life.

                😎

                1 Reply Last reply Reply Quote 0
                • D
                  detron
                  last edited by

                  I get the same error as @MrSco , but I will keep a close eye on this thread, since i think this looks amazing! so excited to play with this in the future

                  @mrsco said in Gamelist Excel export script:

                  Traceback (most recent call last):
                  File "export.py", line 460, in <module>
                  systems = parse_systems()
                  File "export.py", line 241, in parse_systems
                  rom = Game(game)
                  File "export.py", line 146, in init
                  self.info[attr] = get_xml_element_date(obj, attr)
                  File "export.py", line 69, in get_xml_element_date
                  if len(date_text) < len('19860101T000000'):
                  TypeError: object of type 'NoneType' has no len()

                  mituM 1 Reply Last reply Reply Quote 0
                  • mituM
                    mitu Global Moderator @cyperghost
                    last edited by

                    @cyperghost Shoudn't be so hard to add, I just need to compute the fullpath (which I already do anyway to check if the Rom exists) and then parse the .cfg file.

                    1 Reply Last reply Reply Quote 1
                    • mituM
                      mitu Global Moderator @detron
                      last edited by

                      @detron Have you tried after my last update (1h ago ?) to download the script and try again ? If you still get the error - run with the -d flag and upload the gamelist.xml for the system with the error on pastebin.com so I can take a look.

                      D 2 Replies Last reply Reply Quote 0
                      • D
                        detron @mitu
                        last edited by

                        @mitu said in Gamelist Excel export script:

                        @detron Have you tried after my last update (1h ago ?) to download the script and try again ? If you still get the error - run with the -d flag and upload the gamelist.xml for the system with the error on pastebin.com so I can take a look.

                        I got the error about 2 minutes before my post, which was after your update. but I will try again from scratch.

                        thank you for the assistance. I would love this to be a retropie standard, allowing you to create a report with ease

                        1 Reply Last reply Reply Quote 0
                        • D
                          detron @mitu
                          last edited by

                          @mitu said in Gamelist Excel export script:

                          @detron Have you tried after my last update (1h ago ?) to download the script and try again ? If you still get the error - run with the -d flag and upload the gamelist.xml for the system with the error on pastebin.com so I can take a look.

                          I still get the same error, if there is any other info that I could provide besides the info below, I am happy to grab any info that might help.

                          here is the pastebin

                          link to pastebin

                          mituM 1 Reply Last reply Reply Quote 0
                          • mituM
                            mitu Global Moderator @detron
                            last edited by

                            @detron @MrSco Beginner's error - gist.github.com changes the URL after an edit, so my new version was at a different URL. Try again now, I have updated the URL in the initial post. Overwrite the initial export.py script by downloading it again

                            wget -O export.py https://gist.githubusercontent.com/cmitu/73cf0783e9e1e4e02d8ce5c44f7a8984/raw/7f61f714bdf9fd49a690cf75cc719b8ffcdf404f/gamelist.py
                            
                            
                            1 Reply Last reply Reply Quote 0
                            • D
                              detron
                              last edited by

                              a lot more activity now, but a different error happened.

                              again, thank you for your help.

                              pastebin version

                              Traceback (most recent call last):
                              File "export.py", line 464, in <module>
                              systems = parse_systems()
                              File "export.py", line 251, in parse_systems
                              rom.info['name'], s.info['path']))
                              UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in position 3: ordinal not in range(128)

                              mituM 1 Reply Last reply Reply Quote 0
                              • mituM
                                mitu Global Moderator @detron
                                last edited by

                                @detron Please give me the gamelist.xml file where the error occurs. When running with -d parameter, it will show you which system is trying to parse. Get the system's gamelist.xml file and upload it to pastebin.com.

                                1 Reply Last reply Reply Quote 0
                                • D
                                  detron
                                  last edited by

                                  I got it to work. the problem was with a pre-built gamelist file (for a system I have zero roms for.)

                                  this is really cool, thank you for the program, and the support

                                  the prebuilt gamelist has some foreign letters that may be the issue. the file is too big for the free pastebin, but if you really need it, I am sure I can upload it latter to google drive or something for you

                                  mituM 1 Reply Last reply Reply Quote 0
                                  • mituM
                                    mitu Global Moderator @detron
                                    last edited by

                                    @detron Please do, I'd like to have a look at it. Normally, the gamelist is generated by ES and should be valid UTF8 (which the script can handle), if it's generated externally it might have a different encoding. If you can upload the file as-is (no pasting), that would allow me to try and find a fix/solution for the error.

                                    1 Reply Last reply Reply Quote 0
                                    • D
                                      detron
                                      last edited by

                                      @mitu

                                      here you go.

                                      link

                                      let me know if it fails, I will fix it.

                                      mituM 1 Reply Last reply Reply Quote 0
                                      • mituM
                                        mitu Global Moderator @detron
                                        last edited by

                                        @detron Thank you for the file. The problem is seems was in the logging part, which was tripping on the game's game. It should be fixed now (URL updated in the 1st post), so you can re-download the script and try again with your initial gamelist.

                                        wget -O export.py https://gist.githubusercontent.com/cmitu/73cf0783e9e1e4e02d8ce5c44f7a8984/raw/0ee908ff097fca55c4db5911bd78d794666af59c/gamelist.py
                                        
                                        1 Reply Last reply Reply Quote 0
                                        • D
                                          detron
                                          last edited by

                                          @mitu

                                          thank you for the help others may be saved by your edit, but I have zero roms for that system. I just thought the idea of a gamelist with all images was brilliant. add your few roms, and the art would show up.

                                          1 Reply Last reply Reply Quote 0
                                          • meleuM
                                            meleu
                                            last edited by

                                            I have a strong conviction that @Used2BeRX will love this tool! :)

                                            • Useful topics
                                            • joystick-selection tool
                                            • rpie-art tool
                                            • achievements I made
                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Contributions to the project are always appreciated, so if you would like to support us with a donation you can do so here.

                                            Hosting provided by Mythic-Beasts. See the Hosting Information page for more information.