Pathfinder for Custom Collections - correct pathes for custom collections

cyperghost

Made annother test with a bit of fine tuning....
Used the PAC-MAN Collection

I think it's okay and represents a good hit. The represents a good value of my files I'm using.

Results are here:
43 roms are listed - 21 Not found (sounds much, by I don't have msx, coleco, gamegear. gba and all atari variants are limited)

Found write with sed: /home/pi/RetroPie/roms/fba/puckman.zip -- /home/pi/RetroPie/roms/arcade/puckman.zip
Found write with sed: /home/pi/RetroPie/roms/gb/Ms. Pac-Man (USA).zip -- /home/pi/RetroPie/roms/gb/Ms. Pac-Man (U) [!].gb
File not found: /home/pi/RetroPie/roms/msx/Pac-Man (Japan).zip
Dialog hold 7 files: /home/pi/RetroPie/roms/atari2600/Pac-Man (USA).zip -- /home/pi/RetroPie/roms/atari2600/Pac-Man 4 (Pac-Man Hack).a26 /home/pi/RetroPie/roms/atari2600/Pac-Man 8k (2005).a26 /home/pi/RetroPie/roms/atari2600/Pac-Man 8k (No Intermission) (2005).a26 /home/pi/RetroPie/roms/atari2600/Pac-Man (1981) (Atari).a26 /home/pi/RetroPie/roms/atari2600/Pac-Man (Atari) (PAL) [!].a26 /home/pi/RetroPie/roms/atari2600/Pac-Man (CCE) (PAL) [!].a26 /home/pi/RetroPie/roms/atari2600/Pac-Man (CCE).a26
File not found: /home/pi/RetroPie/roms/gamegear/Ms. Pac-Man (USA).zip
Found write with sed: /home/pi/RetroPie/roms/gba/Pac-Man Collection (USA).zip -- /home/pi/RetroPie/roms/gba/Pac-Man Collection.gba
File not found: /home/pi/RetroPie/roms/coleco/Pac-Man (USA) (Proto).col
File not found: /home/pi/RetroPie/roms/atarilynx/Ms. Pac-Man (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/megadrive/Ms. Pac-Man (USA, Europe).zip -- /home/pi/RetroPie/roms/megadrive/Ms. Pac-Man (U) [!].bin
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/pacman.zip -- /home/pi/RetroPie/roms/arcade/pacman.zip
File not found: /home/pi/RetroPie/roms/gamegear/Pac-Man (USA).zip
File not found: /home/pi/RetroPie/roms/gba/Ms. Pac-Man - Maze Madness (USA).zip
Found write with sed: /home/pi/RetroPie/roms/gbc/Ms. Pac-Man - Special Color Edition (USA).zip -- /home/pi/RetroPie/roms/gbc/Ms. Pac-Man - Special Color Edition (USA) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Pac-Man (USA).zip -- /home/pi/RetroPie/roms/gb/Pac-Man (U) (Namco Hometek) [!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Ms. Pac-Man (USA).zip -- /home/pi/RetroPie/roms/snes/Ms. Pac-Man (E) [!].smc
File not found: /home/pi/RetroPie/roms/nes/Ms. Pac-Man (USA).zip
Found write with sed: /home/pi/RetroPie/roms/mastersystem/Ms. Pac-Man (Europe).zip -- /home/pi/RetroPie/roms/mastersystem/Ms. Pac-man (E) [!].sms
File not found: /home/pi/RetroPie/roms/gba/Pac-Man World (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Pac-Man (USA) (Namco).zip -- /home/pi/RetroPie/roms/nes/Pac-Man (Namco) (E) [!].nes
Found write with sed: /home/pi/RetroPie/roms/fba/mspacman.zip -- /home/pi/RetroPie/roms/arcade/mspacman.zip
File not found: /home/pi/RetroPie/roms/n64/Ms. Pac-Man - Maze Madness (USA).n64
Found write with sed: /home/pi/RetroPie/roms/megadrive/Pac-Mania (USA, Europe).zip -- /home/pi/RetroPie/roms/megadrive/Pac-Mania (U) [!].bin
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Pac-Man (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/gba/2 Great Games! - Pac-Man World + Ms. Pac-Man - Maze Madness (USA).zip
Found write with sed: /home/pi/RetroPie/roms/fba/superpac.zip -- /home/pi/RetroPie/roms/arcade/superpac.zip
File not found: /home/pi/RetroPie/roms/nes/Pac-Mania (USA) (Unl).zip
Found write with sed: /home/pi/RetroPie/roms/fba/pacmania.zip -- /home/pi/RetroPie/roms/arcade/pacmania.zip
File not found: /home/pi/RetroPie/roms/coleco/Pac-Man Collection Demo by Opcode (2006) (PD).rom
File not found: /home/pi/RetroPie/roms/atari2600/Pac-Man 4K (USA) (Unl).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/atari7800/Ms. Pac-Man (1987) (Atari).zip -- /home/pi/RetroPie/roms/atari7800/Ms. Pac-Man (1987) (Atari).a78 /home/pi/RetroPie/roms/atari7800/Ms. Pac-Man (1987) (Atari) (PAL).a78
Dialog hold 3 files: /home/pi/RetroPie/roms/mastersystem/Pac-Mania (Europe).zip -- /home/pi/RetroPie/roms/mastersystem/Pac-Mania (E) [o1].sms /home/pi/RetroPie/roms/mastersystem/Pac-Mania (E) [!].sms /home/pi/RetroPie/roms/mastersystem/Pac-Mania (E) [b1].sms
File not found: /home/pi/RetroPie/roms/atari5200/Ms. Pac-Man (USA).bin
File not found: /home/pi/RetroPie/roms/psx/Pac-Man World 20th Anniversary (USA).PBP
Found write with sed: /home/pi/RetroPie/roms/fba/pacplus.zip -- /home/pi/RetroPie/roms/arcade/pacplus.zip
File not found: /home/pi/RetroPie/roms/intellivision/Pac-Man (World).int
File not found: /home/pi/RetroPie/roms/atari5200/Pac-Man (USA).bin
File not found: /home/pi/RetroPie/roms/msx2/Pac-Mania (Japan).zip
File not found: /home/pi/RetroPie/roms/atari5200/Super Pac-Man (USA) (Proto).bin
Found write with sed: /home/pi/RetroPie/roms/gbc/Pac-Man - Special Color Edition (USA).zip -- /home/pi/RetroPie/roms/gbc/Pac-Man - Special Color Edition (USA) (SGB Enhanced) (GB Compatible).zip
Dialog hold 12 files: /home/pi/RetroPie/roms/ngpc/Pac-Man (World) (En,Ja).zip -- /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [t2].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (PD).ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [!].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [a1][!].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [a2][!].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [b1].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [b1][T+Bra_Nenhum].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [b1][T+Fre_J-Yann].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [b2].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [T+Bra_Nenhum].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [T+Fre_J-Yann].ngc /home/pi/RetroPie/roms/ngpc/Pac-Man (W) [t1].ngc
File not found: /home/pi/RetroPie/roms/gameandwatch/Pac Man.mgw
Dialog hold 3 files: /home/pi/RetroPie/roms/atari2600/Ms. Pac-Man (USA).zip -- /home/pi/RetroPie/roms/atari2600/Ms. Pac-Man (1982) (CCE).a26 /home/pi/RetroPie/roms/atari2600/Ms. Pac-Man (1982) (Atari) (PAL) [!].a26 /home/pi/RetroPie/roms/atari2600/Ms. Pac-Man (1982) (Atari).a26

thelostsoul

@cyperghost Wow, I had a look into the source and the script is grown. Now its more organized. I see, you are using the construct with file types. :-) And now, there are 6 levels. I find it interesting to look at the source. I may test it tomorrow and report here how the results are. Need to backup prior doing it.

cyperghost

@thelostsoul Ah... well it's still a beta version. It does not change the collection it just indicates the changes that may happen. I needs more fine tuning. I used now the "ES-system" and it's possible filetypes. So if you search for a GameBoy game all supported extensions are used (gb, zip and 7z)

But I've to admit that your posted script inspired me to do a search for filetypes. But you see... ls is a wimp in between to find. iname and iregex arguments for example are case insensitive that helps a lot in handling file search results and saves a lot of work.

thelostsoul

@cyperghost Ah ok, I was confused about the echos. Thought its for debugging. But it makes sense not doing actual things. :-) I'm curious. :-) thanks for working on it. It will make exchanging collections a little bit easier.

cyperghost

@thelostsoul Well it's just small step to make it working. But at first I would like how it performs on custom collections. If you installed the systems in a correct manner (don't use folders like genesis-japan, nes-hackz...) it should find more than 90% of the roms.

cyperghost

Okay.... Please test Release Candidate 2 can be downloaded ;)
Still! I don't make any changes to Custom Collections!

It's just a report of what will happen. There are still some bugs ... But I'm satisfied with the find routine so far ;)

thelostsoul

@cyperghost Finally, I found time for this. :D so late. I downloaded it and will test this. :-)

Btw, I learned about the program "realpath" yesterday. It will get full path from anything, even with relative parts and wildcards. It can be handy at times. I use it in one of my new short scripts now.

Found out, your script would be an easy way to test existing collections for old entries. Maybe a auto-clean option would be useful. :-) sorry i already start with feature requests. :D I think your script will be really helpful with sharing collections. I test it with collections from the wild and report now. :-) Ok, here my first test with the custom-Super Mario collection by cloudlink.

The very first thing I notice is, I have Yoshi's Cookie on a different system than gb. Maybe another option to look for alternative systems? Also I have some games on the arcade, because they are better than the counter parts. Maybe this option could be used with a restrict to THIS AND THIS system only. Another idea for multiple entries for same game on different systems could be to pre define a favorite systems hierarchy. This way the user don't need to decide. Sorry for my wild brainstorming ideas. :D I just felt to tell you what I think, in terms of features. But how will this tool be used to import? Point to a file or http page like at "https://pastebin.com/raw/PZBePcDd"? Or even a folder which autoscans it for automatically inclusion on start? Oh wait, sorry another feature request. :D :D Btw to iron out, you could translate the "ii" to "2" and so on, in example for Street Fighter games. I don't know if you do that, but that comes to my mind now.

The result of main work is pretty good imho. SED works great too. I really love it, how it finds different version of the game. You did a good job with this, which I wouldn't be able to build. The dialog shows some wrong entries. In example, if the game entry did not have any number in it, then it should not try to search for a game with numbers. So this way no need to search for Super Mario Land 2, if the entry is Super Mario Land. Maybe? Same fro Game and Watch Gallery.

Here the result with SCRIPT >> log.txt:

File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 2.smc
Found write with sed: /home/pi/RetroPie/roms/fba/dkong3.zip -- /home/pi/RetroPie/roms/mame-libretro/dkong3.zip
File not found: /home/pi/RetroPie/roms/sfc/Wrecking Crew '98 (Japan).zip
File not found: /home/pi/RetroPie/roms/gbc/Super Mario Bros. Deluxe (USA, Europe) (Rev B).zip
File not found: /home/pi/RetroPie/roms/gb/Yoshi's Cookie (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (USA) (Rev 1).zip -- /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (U) (M3) (V1.0) [!].smc
File not found: /home/pi/RetroPie/roms/gba/Yoshi - Topsy-Turvy (USA).zip
File not found: /home/pi/RetroPie/roms/nes/NES Open Tournament Golf (USA).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (USA, Europe) (Rev B).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Kart 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Kart 64 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (UE) [C][!].gbc
File not found: /home/pi/RetroPie/roms/gameandwatch/Mario's Bombs Away.mgw
File not found: /home/pi/RetroPie/roms/fba/ckong.zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Numbers (USA).zip
File not found: /home/pi/RetroPie/roms/gbc/Mario Golf (USA).zip
File not found: /home/pi/RetroPie/roms/nds/0662 - Yoshi's Island DS (U)(EvlChiken).nds
Found write with sed: /home/pi/RetroPie/roms/gba/Game & Watch Gallery 4 (USA).zip -- /home/pi/RetroPie/roms/gba/Game & Watch Gallery 4 (U) [!].gba
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (U) [!].smc
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario All-Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario All-Stars (U) [!].smc
File not found: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 2 (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 4 - Super Mario Bros. 3 (USA, Australia) (Rev 1).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros (25 Anniversary Edition) (Japan).zip
File not found: /home/pi/RetroPie/roms/fba/dkongx.zip
Found write with sed: /home/pi/RetroPie/roms/gb/Mario's Picross (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Mario's Picross (UE) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Wario's Woods (USA).zip -- /home/pi/RetroPie/roms/snes/Wario's Woods (U) [!].smc
File not found: /home/pi/RetroPie/roms/mame-libretro/wrecking.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/suprmrio.zip
File not found: /home/pi/RetroPie/roms/nds/0037 - Super Mario 64 DS (U)(Trashman).nds
Found write with sed: /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (USA) (Rev A).zip -- /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (U) (PRG1) [!].nes
File not found: /home/pi/RetroPie/roms/virtualboy/Mario Clash (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 2 - Super Mario World (USA, Australia).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (USA).zip -- /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (U) [!].smc
Found level 1: /home/pi/RetroPie/roms/mame-libretro/dkong.zip
File not found: /home/pi/RetroPie/roms/nintendobsx/yoshi no panepon.smc
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (USA) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Game & Watch Gallery 2 (U) [S].gb /home/pi/RetroPie/roms/gb/Game & Watch Gallery (E) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/fba/mario.zip -- /home/pi/RetroPie/roms/mame-libretro/mario.zip
File not found: /home/pi/RetroPie/roms/nes/Yoshi's Cookie (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Undake 30 Same Game Daisakusen - Mario Version (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Yoshi's Cookie (USA).zip -- /home/pi/RetroPie/roms/snes/Yoshi's Cookie (U).smc
File not found: /home/pi/RetroPie/roms/sfc/Yoshi no Cookie - Kuruppon Oven de Cookie (Japan).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Super Mario Land (World) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land (W) (V1.1) [!].gb /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
Found write with sed: /home/pi/RetroPie/roms/gba/Mario Pinball Land (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario Pinball Land (U).gba
File not found: /home/pi/RetroPie/roms/gb/Yoshi (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (USA) (Rev A).zip -- /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (U) (PRG1) [!].nes
File not found: /home/pi/RetroPie/roms/gb/Dr. Mario (World) (Rev A).zip
Dialog hold 3 files: /home/pi/RetroPie/roms/nes/Super Mario Bros. (World).zip -- /home/pi/RetroPie/roms/nes/Super Mario Bros. (JU) [!].nes /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (U) (PRG1) [!].nes /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (U) (PRG1) [!].nes
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario Kart (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario Kart (U) [!].smc
File not found: /home/pi/RetroPie/roms/gb/Alleyway (World).zip
File not found: /home/pi/RetroPie/roms/nds/0340 - Super Princess Peach (U)(WRG).nds
File not found: /home/pi/RetroPie/roms/gameandwatch/Donkey Kong Circus.mgw
File not found: /home/pi/RetroPie/roms/ports/Super Mario War.sh
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land 3 (World).zip -- /home/pi/RetroPie/roms/gbc/Wario Land 3 (JU) (M2) [C][!].gbc
File not found: /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Letters (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Preschool Fun (USA).zip
File not found: /home/pi/RetroPie/roms/gba/2 Games in One! - Dr. Mario + Puzzle League (USA, Australia).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Super Mario World (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario World (U) [!].smc /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (U) (M3) (V1.0) [!].smc
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Dr. Mario (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 4.smc
File not found: /home/pi/RetroPie/roms/nintendobsx/wario no mori.smc
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers 2 (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/atari2600/Mario Bros. (USA).zip -- /home/pi/RetroPie/roms/atari2600/Mario Bros. (1983) (Atari, Dan Hitchens) (CX2697, CX2697P) (PAL).bin
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).zip
File not found: /home/pi/RetroPie/roms/mame-libretro/drmario.zip
Found write with sed: /home/pi/RetroPie/roms/gba/Mario Kart - Super Circuit (USA).zip -- /home/pi/RetroPie/roms/gba/Mario Kart Super Circuit (U) [!].gba
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Wario Land 3 (JU) (M2) [C][!].gbc
File not found: /home/pi/RetroPie/roms/nes/Yoshi (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nintendobsx/dr. mario.smc -- /home/pi/RetroPie/roms/nes/Dr. Mario (U) (PRG1) [!].nes
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Super Mario Bros. (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/gba/Mario & Luigi - Superstar Saga (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario & Luigi - Superstar Saga (E) (M5).gba
File not found: /home/pi/RetroPie/roms/gba/Mario Party Advance (USA).zip
File not found: /home/pi/RetroPie/roms/atari5200/Mario Bros. (USA).bin
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 1.smc
File not found: /home/pi/RetroPie/roms/gameandwatch/Mario Bros.mgw
Found write with sed: /home/pi/RetroPie/roms/gba/Wario Land 4 (USA, Europe).zip -- /home/pi/RetroPie/roms/gba/Wario Land 4 (UE) [!].gba
Found write with sed: /home/pi/RetroPie/roms/nes/Mario Bros. (World).zip -- /home/pi/RetroPie/roms/nes/Mario Bros. Classic (E) [!].nes
File not found: /home/pi/RetroPie/roms/n64/Mario Party 3 (USA).n64
Found write with sed: /home/pi/RetroPie/roms/nes/Wrecking Crew (World).zip -- /home/pi/RetroPie/roms/nes/Wrecking Crew (U) [!].nes
File not found: /home/pi/RetroPie/roms/fds/All Night Nippon Super Mario Brothers (Japan) (Promotion Cart).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 3.smc
File not found: /home/pi/RetroPie/roms/sfc/Mario to Wario (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/n64/Super Mario 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Super Mario 64 (U) [!].z64
File not found: /home/pi/RetroPie/roms/nes/Mario's Time Machine (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario Is Missing! (USA).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Wario Land II (UE) [S][!].gb
File not found: /home/pi/RetroPie/roms/n64/Mario Party 2 (USA).n64
File not found: /home/pi/RetroPie/roms/sfc/Mario no Super Picross (J).zip
File not found: /home/pi/RetroPie/roms/n64/Mario Party (USA).n64
File not found: /home/pi/RetroPie/roms/nds/0168 - Mario Kart DS (U)(SCZ).nds
File not found: /home/pi/RetroPie/roms/gb/Wario Blast Featuring Bomberman! (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers (Japan).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros. 3 (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong (E) (M5).gba
File not found: /home/pi/RetroPie/roms/nes/Mario Is Missing! (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Time Machine (USA).zip
File not found: /home/pi/RetroPie/roms/virtualboy/Mario's Tennis (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/gbc/Mario Tennis (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Dr. Mario (Japan, USA) (Rev A).zip -- /home/pi/RetroPie/roms/nes/Dr. Mario (U) (PRG1) [!].nes
-1 -- 2: 2
0 -- 2: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (USA) (Rev A).zip
1 -- 2: /home/pi/RetroPie/roms/gb/Game & Watch Gallery 2 (U) [S].gb
2 -- 2: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (E) [S][!].gb
3 -- 2: 2
Begin new array with collection name and 2 possible entries
ARRAY! Build - call dialog
0 -- 2: /home/pi/RetroPie/roms/gb/Super Mario Land (World) (Rev A).zip
1 -- 2: /home/pi/RetroPie/roms/gb/Super Mario Land (W) (V1.1) [!].gb
2 -- 2: /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
3 -- 2: 3
Begin new array with collection name and 3 possible entries
ARRAY! Build - call dialog
0 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. (World).zip
1 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. (JU) [!].nes
2 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (U) (PRG1) [!].nes
3 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (U) (PRG1) [!].nes
4 -- 3: 2
Begin new array with collection name and 2 possible entries
ARRAY! Build - call dialog
0 -- 2: /home/pi/RetroPie/roms/snes/Super Mario World (USA).zip
1 -- 2: /home/pi/RetroPie/roms/snes/Super Mario World (U) [!].smc
2 -- 2: /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (U) (M3) (V1.0) [!].smc

cyperghost

@thelostsoul That's also no problem to delete non existing entries. But I don't know what the purpose is. Because ES just ignores files that are not available... very handy!

Currently I'm working on a backup solution (done) and on a report/logging system (done)

Now I just need the selection dialog. And the sed -i command
That's all!

But I will appreciate reports of the screen output and how good the routines are working. Yes I read the manpage of realpath could be useful if you split the ROMs in different locations.
Don't have fear about your collections... Currently I do no file operations, just give screen output. You can use NotePad++ to analyse what's there is happening

level 1 finding is excellent, means collection is in the exact path - nothing to do
sed write is good means, just one file found (maybe zip extension instead of smc/bin) - automatically correction possible
dialog x files found User choice with dialog. I was able to build arrays we can send to dialog to get a graphical selection (currently working on this)

You learn a lot if you work with such tools. This is by far the very wicked script I've ever written. It's full of search and string operation routines. Needs lots of testing....

thelostsoul

@cyperghost Just wanted note here that I upgraded my post while you was posting.

cyperghost

@thelostsoul First productive version released.
It will create backups in folder ./collection_backup where your script is located.

DOWNLOAD here

My output of the Mario Collection
54 files not found
47 files found

But - I have no Japan system, no nds, no virtualboy, no sfc, no fds
If I count these systems:
5 sfc
4 nds
2 famicom
7 nintendobsx
2 virtualboy
10 NES US titels

I've 30 titles that are simply not installed ;)

Found write with sed: /home/pi/RetroPie/roms/fba/dkong3.zip -- /home/pi/RetroPie/roms/arcade/dkong3.zip
Found level 1: /home/pi/RetroPie/roms/gbc/Super Mario Bros. Deluxe (USA, Europe) (Rev B).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Yoshi's Cookie (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Yoshi's Cookie (U) [!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (USA) (Rev 1).zip -- /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (E) (M3) (V1.0) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (USA, Europe) (Rev B).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Kart 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Kart 64 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/gameandwatch/Mario's Bombs Away.mgw -- /home/pi/RetroPie/roms/gameandwatch/Mario's Bombs Away (Nintendo, Panorama Screen).mgw
Found write with sed: /home/pi/RetroPie/roms/fba/ckong.zip -- /home/pi/RetroPie/roms/arcade/ckong.zip
Found level 1: /home/pi/RetroPie/roms/gbc/Mario Golf (USA).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (U) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gba/Super Mario Advance (USA, Europe).zip -- /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).gba
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario All-Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario All-Stars + Super Mario World (U) [o1+2C].smc
Found write with sed: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 2 (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 2 (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Mario's Picross (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Mario's Picross (UE) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Wario's Woods (USA).zip -- /home/pi/RetroPie/roms/snes/Wario's Woods (U) [!].smc
Found write with sed: /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (USA).zip -- /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (E) [!].smc
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/dkong.zip -- /home/pi/RetroPie/roms/arcade/dkong.zip
Dialog hold 3 files: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (USA) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Game & Watch Gallery 2 (U) [S].gb /home/pi/RetroPie/roms/gb/Game & Watch Gallery (E) [S][!].gb /home/pi/RetroPie/roms/gb/Game & Watch Gallery (U) (V1.1) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/fba/mario.zip -- /home/pi/RetroPie/roms/arcade/mario.zip
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Super Mario Land (World) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb /home/pi/RetroPie/roms/gb/Super Mario Land (JUE) (V1.1) [!].gb
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Yoshi (USA).zip -- /home/pi/RetroPie/roms/gb/Yoshi (U) [!].gb /home/pi/RetroPie/roms/gb/Yoshi's Cookie (U) [!].gb
Found write with sed: /home/pi/RetroPie/roms/gb/Dr. Mario (World) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Dr. Mario (JU) (V1.1).gb
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario Kart (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario Kart (E) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gb/Alleyway (World).zip -- /home/pi/RetroPie/roms/gb/Alleyway (JUE) [!].gb
Found write with sed: /home/pi/RetroPie/roms/gameandwatch/Donkey Kong Circus.mgw -- /home/pi/RetroPie/roms/gameandwatch/Donkey Kong Circus (Nintendo, Panorama Screen).mgw
Found level 1: /home/pi/RetroPie/roms/ports/Super Mario War.sh
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land 3 (World).zip -- /home/pi/RetroPie/roms/gbc/Wario Land 3 (World) (En,Ja).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari).zip -- /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari).a78 /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari) (PAL).a78
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Super Mario World (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario World (E) (V1.1) [!].smc /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (E) (M3) (V1.0) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).zip -- /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).gba
Found write with sed: /home/pi/RetroPie/roms/gba/Mario Kart - Super Circuit (USA).zip -- /home/pi/RetroPie/roms/gba/Mario Kart - Super Circuit.gba
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Yoshi (USA).zip -- /home/pi/RetroPie/roms/nes/Mario & Yoshi (E) [!].nes
Found write with sed: /home/pi/RetroPie/roms/gba/Mario & Luigi - Superstar Saga (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario and Luigi - Superstar Saga.gba
Found write with sed: /home/pi/RetroPie/roms/gameandwatch/Mario Bros.mgw -- /home/pi/RetroPie/roms/gameandwatch/Mario Bros. (Nintendo, Multi Screen).mgw
Found write with sed: /home/pi/RetroPie/roms/gba/Wario Land 4 (USA, Europe).zip -- /home/pi/RetroPie/roms/gba/Wario Land 4 (UE) [!].gba
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Party 3 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Party 3 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/n64/Super Mario 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Super Mario 64 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/snes/Mario Is Missing! (USA).zip -- /home/pi/RetroPie/roms/snes/Mario is Missing! (G).smc
Found write with sed: /home/pi/RetroPie/roms/gb/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Party 2 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Party 2 (U) [!].z64
Dialog hold 3 files: /home/pi/RetroPie/roms/n64/Mario Party (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Party (U) [!].z64 /home/pi/RetroPie/roms/n64/Mario Party 3 (U) [!].z64 /home/pi/RetroPie/roms/n64/Mario Party 2 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong.gba
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Mario's Time Machine (USA).zip -- /home/pi/RetroPie/roms/snes/Mario's Time Machine (U) [!].smc /home/pi/RetroPie/roms/snes/Mario's Time Machine (G).smc
Found level 1: /home/pi/RetroPie/roms/gbc/Mario Tennis (USA).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 2.smc
File not found: /home/pi/RetroPie/roms/sfc/Wrecking Crew '98 (Japan).zip
File not found: /home/pi/RetroPie/roms/gba/Yoshi - Topsy-Turvy (USA).zip
File not found: /home/pi/RetroPie/roms/nes/NES Open Tournament Golf (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Numbers (USA).zip
File not found: /home/pi/RetroPie/roms/nds/0662 - Yoshi's Island DS (U)(EvlChiken).nds
File not found: /home/pi/RetroPie/roms/gba/Game & Watch Gallery 4 (USA).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 4 - Super Mario Bros. 3 (USA, Australia) (Rev 1).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros (25 Anniversary Edition) (Japan).zip
File not found: /home/pi/RetroPie/roms/fba/dkongx.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/wrecking.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/suprmrio.zip
File not found: /home/pi/RetroPie/roms/nds/0037 - Super Mario 64 DS (U)(Trashman).nds
File not found: /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (USA) (Rev A).zip
File not found: /home/pi/RetroPie/roms/virtualboy/Mario Clash (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 2 - Super Mario World (USA, Australia).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/yoshi no panepon.smc
File not found: /home/pi/RetroPie/roms/nes/Yoshi's Cookie (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Undake 30 Same Game Daisakusen - Mario Version (Japan).zip
File not found: /home/pi/RetroPie/roms/snes/Yoshi's Cookie (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Yoshi no Cookie - Kuruppon Oven de Cookie (Japan).zip
File not found: /home/pi/RetroPie/roms/gba/Mario Pinball Land (USA, Australia).zip
File not found: /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (USA) (Rev A).zip
File not found: /home/pi/RetroPie/roms/nes/Super Mario Bros. (World).zip
File not found: /home/pi/RetroPie/roms/nds/0340 - Super Princess Peach (U)(WRG).nds
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Letters (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Preschool Fun (USA).zip
File not found: /home/pi/RetroPie/roms/gba/2 Games in One! - Dr. Mario + Puzzle League (USA, Australia).zip
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Dr. Mario (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 4.smc
File not found: /home/pi/RetroPie/roms/nintendobsx/wario no mori.smc
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers 2 (Japan).zip
File not found: /home/pi/RetroPie/roms/atari2600/Mario Bros. (USA).zip
File not found: /home/pi/RetroPie/roms/mame-libretro/drmario.zip
File not found: /home/pi/RetroPie/roms/nintendobsx/dr. mario.smc
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Super Mario Bros. (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/gba/Mario Party Advance (USA).zip
File not found: /home/pi/RetroPie/roms/atari5200/Mario Bros. (USA).bin
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 1.smc
File not found: /home/pi/RetroPie/roms/nes/Mario Bros. (World).zip
File not found: /home/pi/RetroPie/roms/nes/Wrecking Crew (World).zip
File not found: /home/pi/RetroPie/roms/fds/All Night Nippon Super Mario Brothers (Japan) (Promotion Cart).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 3.smc
File not found: /home/pi/RetroPie/roms/sfc/Mario to Wario (Japan).zip
File not found: /home/pi/RetroPie/roms/nes/Mario's Time Machine (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Mario no Super Picross (J).zip
File not found: /home/pi/RetroPie/roms/nds/0168 - Mario Kart DS (U)(SCZ).nds
File not found: /home/pi/RetroPie/roms/gb/Wario Blast Featuring Bomberman! (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers (Japan).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros. 3 (Japan).zip
File not found: /home/pi/RetroPie/roms/nes/Mario Is Missing! (USA).zip
File not found: /home/pi/RetroPie/roms/virtualboy/Mario's Tennis (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/nes/Dr. Mario (Japan, USA) (Rev A).zip
File not found: /home/pi/RetroPie/roms/nes/Wario's Woods (USA).zip

There are lot's of things to do but it is now handled as productive tool --- finally!

thelostsoul

Very nice! Can't wait to ~~test~~ use it. :-) Will report then. Thank you for all the work you done so far.

cyperghost

@thelostsoul Do that.
You can try to improve search routines. The logic in in case selection starting in line 118. Then you see each search case ends with a statement like [[ -z $filefind ]] && file_search 2 this means if the string is empty then try next search case.

I ended it in case 3 with statement [[ -z $filefind ]] && unset array this aborts the search and switches back to next line in custom collection. You can extend as much cases as you want. But one warning. I tried the usecase you told and the result was that for example a game for gamegear was setted to mastersystem .... I don't know if this is a good behaviour ;)

So I disabled this possibility! Maybe I add it later to get called by a command-line filefinder.sh --advanced or maybe selectable with a third option button integreated into custom collection select mask.... I don't know ;)

So far I just change entries but I think the user can add ROMs later. Because I store output of every run backup folders. There the results are listed ;)

thelostsoul

@cyperghost don't forget to update initial posting. ;-)

thelostsoul

Now, I tested the v99. Sorry for trying it so late! It could have been found earlier. I was just doing other stuff (input lag investigation, playing and so on).

First something not a bug, but very annoying on the console. Backup filesnames shouldn't start with numbers. Especially if all of them have similiar numbers. That makes autocomplete a little bit confusing and I have to be very careful. In example, I have 2 collections: Street Fighter and Mario. I can't just "nano 15" TAB, it won't autocomplete. I have to type whole number and be very careful, which next number is the right one, as it autocompletes only the half. If they start with the original name, its much easier and the number on the end of filename would be unimportant.

And then an error happened while importing the Street Fighter 2 collection, but I am not sure. It was asking me which game to choose from and none of them was right. So I decided to select "Don't change !". and it stopped with a message from sed. The original collection changed, I got 8 games found from original 1 game. I think, the games after sfiii aren't checked then.

And I would say don't change or touch anything if the script isn't terminated successfully or is about to. Everything should be done on a temporary file and if script reaches the end, it just asks the user if its ok to replace. Or even if it does not asks, it should only do the change, if it reaches the end of script and copy the temp file over.

Here is the log:

Found write with sed: /home/pi/RetroPie/roms/fba/spf2t.zip -- /home/pi/RetroPie/roms/mame-libretro/spf2t.zip
File not found: /home/pi/RetroPie/roms/ngpc/SNK vs. Capcom - The Match of the Millennium (World) (En,Ja).zip
File not found: /home/pi/RetroPie/roms/psx/Street Fighter Alpha 3 (USA).PBP
Found write with sed: /home/pi/RetroPie/roms/fba/sf2.zip -- /home/pi/RetroPie/roms/fba/hsf2.zip
File not found: /home/pi/RetroPie/roms/gba/Street Fighter Alpha 3 (USA).zip
File not found: /home/pi/RetroPie/roms/psx/Street Fighter EX2 Plus (USA).PBP
Found write with sed: /home/pi/RetroPie/roms/gb/Street Fighter II (USA, Europe) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Street Fighter II (UE) [S][!].gb
File not found: /home/pi/RetroPie/roms/psx/Street Fighter EX Plus Alpha (USA).PBP
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Street Fighter II (USA).zip -- /home/pi/RetroPie/roms/snes/Street Fighter II Turbo - Hyper Fighting (U) [!].smc /home/pi/RetroPie/roms/snes/Street Fighter II - The World Warrior (E) [!].smc
Found write with sed: /home/pi/RetroPie/roms/snes/Street Fighter II Turbo (USA).zip -- /home/pi/RetroPie/roms/snes/Street Fighter II Turbo - Hyper Fighting (U) [!].smc
File not found: /home/pi/RetroPie/roms/megadrive/Super Street Fighter II - The New Challengers (USA).zip
File not found: /home/pi/RetroPie/roms/fba/sf2ce.zip
File not found: /home/pi/RetroPie/roms/fba/ssf2.zip
File not found: /home/pi/RetroPie/roms/psx/Marvel vs. Capcom - Clash of Super Heroes (USA).PBP
File not found: /home/pi/RetroPie/roms/gba/Super Street Fighter II Turbo - Revival (USA).zip
File not found: /home/pi/RetroPie/roms/megadrive-japan/Street Fighter II' Plus - Champion Edition (Japan).zip
File not found: /home/pi/RetroPie/roms/fba/xmvsf.zip
File not found: /home/pi/RetroPie/roms/megadrive/Street Fighter II' - Special Champion Edition (USA).zip
Found level 1: /home/pi/RetroPie/roms/neogeo/svc.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/sfex2p.zip
File not found: /home/pi/RetroPie/roms/fba/sf2hf.zip
Found level 1: /home/pi/RetroPie/roms/fba/sfiii2.zip
File not found: /home/pi/RetroPie/roms/gba/Super Puzzle Fighter II Turbo (USA).zip
File not found: /home/pi/RetroPie/roms/psx/Street Fighter Alpha - Warriors' Dreams (USA).PBP
File not found: /home/pi/RetroPie/roms/fba/svcpcb.zip
File not found: /home/pi/RetroPie/roms/pcengine/Street Fighter II' - Champion Edition (Japan).zip
File not found: /home/pi/RetroPie/roms/gbc/Street Fighter Alpha - Warriors' Dreams (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Street Fighter Alpha 2 (USA).zip
Found level 1: /home/pi/RetroPie/roms/fba/sfiii3.zip
Found level 1: /home/pi/RetroPie/roms/fba/hsf2.zip
File not found: /home/pi/RetroPie/roms/fba/ssf2t.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/sftm.zip
Found level 1: /home/pi/RetroPie/roms/fba/sfa3.zip
File not found: /home/pi/RetroPie/roms/fba/sfz2al.zip
File not found: /home/pi/RetroPie/roms/fba/sfzch.zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Street Fighter II (USA).zip -- /home/pi/RetroPie/roms/snes/Super Street Fighter II - The New Challengers (J).smc
Found write with sed: /home/pi/RetroPie/roms/fba/sfa.zip -- /home/pi/RetroPie/roms/fba/sfa3.zip
File not found: /home/pi/RetroPie/roms/psx/Marvel Super Heroes vs. Street Fighter (USA).PBP
File not found: /home/pi/RetroPie/roms/fba/mvsc.zip
File not found: /home/pi/RetroPie/roms/fba/sfa2.zip
Dialog hold 2 files: /home/pi/RetroPie/roms/fba/sfiii.zip -- /home/pi/RetroPie/roms/fba/sfiii2.zip /home/pi/RetroPie/roms/fba/sfiii3.zip

0_1526924825975_Bildschirmfoto von 2018-05-21 19-30-50.png

cyperghost

@thelostsoul Ahh... I know what you mean....

the find romname* won't find romname.extension name, but it will find romname1.extension romname2.extension and so on. But I don't get it why it does not find sfiii.zip because this is searched in first level.... Need to investigat.

About the dialog....
There is nothing implented.

case "$status" in

        2) # Help
           echo "help" 
        ;;

        3) # Extra 
           exit
        ;;
  
        *)  echo "$choices"
            break 
;;

If you choose "Don't change it's the CANCEL-button" and would be case 1....
You see I don't have implented this now ;) Also HELP button would just show "help" message. Not more not less.

Well I think that's the great advantage of inline changing. It's fast and it's automatic.

About the numbering and the autocomplete.... Well... There is no difference if you autocomplete 123456-filename or autocomplete filename-123456

You type first the numbers (indeed very carefully) and later got the filename which is faster to type. But I think it's better to see which file is newer/older

The highest number is the newest file. The filenumber is just the elapesed time in seconds since ... 1970? And I usw WINSCP (a graphical filemanager) to open files ;)

Thank you very much for your report - I appreciate this. But let me investigate abit the sfiii thing. That's weird.... Later I will implent a correct button action.

Things to do:

Correct Button for Cancel
HELP item will view full path of file
Show counter how much dialogs the user should process....
Optional: temp files instead of direct write to file (I prefer direct write)

It's still a work in progress ;) and the sed command failed because there was no paramter parsed to it.

thelostsoul

@cyperghost said in Pathfinder for Custom Collections - correct pathes for custom collections:

But I don't get it why it does not find sfiii.zip because this is searched in first level.... Need to investigat.

I don't have sfiii in my collection, so it can't find it. ;-)
After all, I misunderstood the "Don't change" button. Then everything is fine.
But what about sfiii, if I don't have this game? What if I don't want it to recognize as sfiii2 or sfiii3. What should have i selected then?

About the numbering and the autocomplete.... Well... There is no difference if you autocomplete 123456-filename or autocomplete filename-123456

Look at the image I uploaded. If I do "ls", I get this:

1526922783-custom-super_mario.cfg
1526922783-filefinder.log
1526923279-custom-street_fighter_ii.cfg
1526923279-filefinder.log

Now I type "nano 1" and do TAB, I get "nano 152692". Now what to do? I have to be very careful, next one is a 2 or a 3? Ok, type 3 and TAB. No problem. Now imagine there are more files with a lot of different numbers. They aren't sorted by name, just by random numbers. It would be much easier if I just type "nano c" TAB to get "nano custom-" and then "nano custom-s" TAB. Now imagine different collections with similiar titles and so many numbers. Here is how it could look like

1526922783-custom-super_mario.cfg
1526922783-filefinder.log
1526923279-custom-street_fighter_ii.cfg
1526923279-filefinder.log
1526924521-custom-street_of_rage.cfg
1526924521-filefinder.log
1526924573-custom-snes_collection.cfg
1526924573-filefinder.log

Ok, to be fair, I do most stuff on my pc connected to the raspberry pi. But I just wanted to point it out. Still not big deal.

cyperghost

@thelostsoul said in Pathfinder for Custom Collections - correct pathes for custom collections:

But what about sfiii, if I don't have this game? What if I don't want it to recognize as sfiii2 or sfiii3. What should have i selected then?

Okay ... I should implent a working "Do nothing" or "Proceed to next selection" button ;)

If you don't have a sfiii file then it's clear what happens.
It does not find the right file. Next Step is search for sfiii* files and guess... tada it will show sfiii2 and and sfiii3 ;) So there are several things that I can do...
I can add a working button or just add an "Ignore this entry" into the selection itself ;)

Again about the inline writing. It took me hours to find out how to use the sed command. It's easy to search for some words to replace but file pathes can be a bit different because there are signs in like the slash that are control characters ;) So the easiest way was - instead to replace the string by occourance - to replace the line were the string occours ;) Is the more effictive way because I wanted to avoid using temporary files!

About the filenaming. Maybe real dates would be better ;)
like "2018-05-21--21-50-10-custom-super-mario.cfg"
Would be more clearer but I was in hurry as I did a backup solution, so I used just the time gone in seconds since 1970.

thelostsoul

@cyperghost Yes, sed isn't easy to work, because of all the RegEx rules. I was once working on something different with heavy RegEx manipulations, so RegEx got my favorite function (back then, it was AutoHotkey on Windows :D). But why don't you want work with temporary files? In case something happens or I abort the process, nothing should have changed. Wait a second. And what is "Don't change !" doing? Shouldn't the file stay original afterwards? I think it changed the original file.

To be more clear, imho the options should be named to <Select>, <Stop now>, <Revert changes> and <Ignore this entry>.

cyperghost

@thelostsoul Made new updates....
You can select between advanced and simple search (I recommend simple in first try and then use advanced search in second try)

In ROM selection screen, Exit works, Skip works, Select works
Help does not work ... will display just a message box ;)

Newest version is here

thelostsoul

I have a real world use for your script now. I decided to change a lot of roms at NES and SNES, mostly from European to US version, because of 60 Hz. And now, many of my collections aren't up to date. But here comes your script and now they are. I have updated some of my collections now and I don't see any problem. Using Simple search. It works so far and it saved me some time, instead of manually checking every single file!! So a big thank you.

Edit this line: I forgot about the executable bit. To use the script without typing bash in front, you need to give the executable right for the script file with "chmod +x filefind.sh". Then for the starting script you need to type "./filefind.sh". Maybe add this info.

If the script is done, the screen don't change on my setup. It still shows the last menu entry like this:
As a sidenote, I use PuTTY client.

Ok, here is something else in my Action Adventure collection:

Found write with sed: /home/pi/RetroPie/roms/gbc/Legend of Zelda, The - Link's Awakening DX (G) [C][!].gbc -- /home/pi/RetroPie/roms/gbc/Legend of Zelda, The - Link's Awakening DX (G) [C][!].gbc

It is the same path, so no need for sed right? Is this a "BUG" or do I miss something? Same thing happened with "Kirby's Block Ball (U) [S][!].gb". Oh and with two other game boy games too. So it must be a game boy thing here, maybe because of the file endings. Or maybe not, it happened with snes entries too. Here entries when sed was used, while it was exactly the same:

Clock Tower (J) ]T+Eng1.01_AGTP].smc
Live A Live (Japan) [En by Aeon Genesis v2.0Deluxe].sfc
Alcahest (J) [T+Eng1.0_FH].smc

and some more. All entries like these above.

Another thing. It did not find alternative for

Mario Bros. Classic (E) [!].nes

while I have

Mario Bros. (JU) [!].nes

It is simple mode, I know, but after using simple mode, the entry is gone. Afterwards using advanced mode does not help. So user never knows when to use advanced mode. Maybe a function to restore a backup then?