Pathfinder for Custom Collections - correct pathes for custom collections

[cyperghost]

@thelostsoul Well it's just small step to make it working. But at first I would like how it performs on custom collections. If you installed the systems in a correct manner (don't use folders like genesis-japan, nes-hackz...) it should find more than 90% of the roms.

[cyperghost]

Okay.... Please test Release Candidate 2 can be downloaded ;)
Still! I don't make any changes to Custom Collections!

It's just a report of what will happen. There are still some bugs ... But I'm satisfied with the find routine so far ;)

[thelostsoul]

@cyperghost Finally, I found time for this. :D so late. I downloaded it and will test this. :-)

Btw, I learned about the program "realpath" yesterday. It will get full path from anything, even with relative parts and wildcards. It can be handy at times. I use it in one of my new short scripts now.

Found out, your script would be an easy way to test existing collections for old entries. Maybe a auto-clean option would be useful. :-) sorry i already start with feature requests. :D I think your script will be really helpful with sharing collections. I test it with collections from the wild and report now. :-) Ok, here my first test with the custom-Super Mario collection by cloudlink.

The very first thing I notice is, I have Yoshi's Cookie on a different system than gb. Maybe another option to look for alternative systems? Also I have some games on the arcade, because they are better than the counter parts. Maybe this option could be used with a restrict to THIS AND THIS system only. Another idea for multiple entries for same game on different systems could be to pre define a favorite systems hierarchy. This way the user don't need to decide. Sorry for my wild brainstorming ideas. :D I just felt to tell you what I think, in terms of features. But how will this tool be used to import? Point to a file or http page like at "https://pastebin.com/raw/PZBePcDd"? Or even a folder which autoscans it for automatically inclusion on start? Oh wait, sorry another feature request. :D :D Btw to iron out, you could translate the "ii" to "2" and so on, in example for Street Fighter games. I don't know if you do that, but that comes to my mind now.

The result of main work is pretty good imho. SED works great too. I really love it, how it finds different version of the game. You did a good job with this, which I wouldn't be able to build. The dialog shows some wrong entries. In example, if the game entry did not have any number in it, then it should not try to search for a game with numbers. So this way no need to search for Super Mario Land 2, if the entry is Super Mario Land. Maybe? Same fro Game and Watch Gallery.

Here the result with SCRIPT >> log.txt:

File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 2.smc
Found write with sed: /home/pi/RetroPie/roms/fba/dkong3.zip -- /home/pi/RetroPie/roms/mame-libretro/dkong3.zip
File not found: /home/pi/RetroPie/roms/sfc/Wrecking Crew '98 (Japan).zip
File not found: /home/pi/RetroPie/roms/gbc/Super Mario Bros. Deluxe (USA, Europe) (Rev B).zip
File not found: /home/pi/RetroPie/roms/gb/Yoshi's Cookie (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (USA) (Rev 1).zip -- /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (U) (M3) (V1.0) [!].smc
File not found: /home/pi/RetroPie/roms/gba/Yoshi - Topsy-Turvy (USA).zip
File not found: /home/pi/RetroPie/roms/nes/NES Open Tournament Golf (USA).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (USA, Europe) (Rev B).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Kart 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Kart 64 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (UE) [C][!].gbc
File not found: /home/pi/RetroPie/roms/gameandwatch/Mario's Bombs Away.mgw
File not found: /home/pi/RetroPie/roms/fba/ckong.zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Numbers (USA).zip
File not found: /home/pi/RetroPie/roms/gbc/Mario Golf (USA).zip
File not found: /home/pi/RetroPie/roms/nds/0662 - Yoshi's Island DS (U)(EvlChiken).nds
Found write with sed: /home/pi/RetroPie/roms/gba/Game & Watch Gallery 4 (USA).zip -- /home/pi/RetroPie/roms/gba/Game & Watch Gallery 4 (U) [!].gba
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (U) [!].smc
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario All-Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario All-Stars (U) [!].smc
File not found: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 2 (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 4 - Super Mario Bros. 3 (USA, Australia) (Rev 1).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros (25 Anniversary Edition) (Japan).zip
File not found: /home/pi/RetroPie/roms/fba/dkongx.zip
Found write with sed: /home/pi/RetroPie/roms/gb/Mario's Picross (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Mario's Picross (UE) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Wario's Woods (USA).zip -- /home/pi/RetroPie/roms/snes/Wario's Woods (U) [!].smc
File not found: /home/pi/RetroPie/roms/mame-libretro/wrecking.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/suprmrio.zip
File not found: /home/pi/RetroPie/roms/nds/0037 - Super Mario 64 DS (U)(Trashman).nds
Found write with sed: /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (USA) (Rev A).zip -- /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (U) (PRG1) [!].nes
File not found: /home/pi/RetroPie/roms/virtualboy/Mario Clash (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 2 - Super Mario World (USA, Australia).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (USA).zip -- /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (U) [!].smc
Found level 1: /home/pi/RetroPie/roms/mame-libretro/dkong.zip
File not found: /home/pi/RetroPie/roms/nintendobsx/yoshi no panepon.smc
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (USA) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Game & Watch Gallery 2 (U) [S].gb /home/pi/RetroPie/roms/gb/Game & Watch Gallery (E) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/fba/mario.zip -- /home/pi/RetroPie/roms/mame-libretro/mario.zip
File not found: /home/pi/RetroPie/roms/nes/Yoshi's Cookie (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Undake 30 Same Game Daisakusen - Mario Version (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Yoshi's Cookie (USA).zip -- /home/pi/RetroPie/roms/snes/Yoshi's Cookie (U).smc
File not found: /home/pi/RetroPie/roms/sfc/Yoshi no Cookie - Kuruppon Oven de Cookie (Japan).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Super Mario Land (World) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land (W) (V1.1) [!].gb /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
Found write with sed: /home/pi/RetroPie/roms/gba/Mario Pinball Land (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario Pinball Land (U).gba
File not found: /home/pi/RetroPie/roms/gb/Yoshi (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (USA) (Rev A).zip -- /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (U) (PRG1) [!].nes
File not found: /home/pi/RetroPie/roms/gb/Dr. Mario (World) (Rev A).zip
Dialog hold 3 files: /home/pi/RetroPie/roms/nes/Super Mario Bros. (World).zip -- /home/pi/RetroPie/roms/nes/Super Mario Bros. (JU) [!].nes /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (U) (PRG1) [!].nes /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (U) (PRG1) [!].nes
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario Kart (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario Kart (U) [!].smc
File not found: /home/pi/RetroPie/roms/gb/Alleyway (World).zip
File not found: /home/pi/RetroPie/roms/nds/0340 - Super Princess Peach (U)(WRG).nds
File not found: /home/pi/RetroPie/roms/gameandwatch/Donkey Kong Circus.mgw
File not found: /home/pi/RetroPie/roms/ports/Super Mario War.sh
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land 3 (World).zip -- /home/pi/RetroPie/roms/gbc/Wario Land 3 (JU) (M2) [C][!].gbc
File not found: /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Letters (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Preschool Fun (USA).zip
File not found: /home/pi/RetroPie/roms/gba/2 Games in One! - Dr. Mario + Puzzle League (USA, Australia).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Super Mario World (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario World (U) [!].smc /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (U) (M3) (V1.0) [!].smc
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Dr. Mario (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 4.smc
File not found: /home/pi/RetroPie/roms/nintendobsx/wario no mori.smc
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers 2 (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/atari2600/Mario Bros. (USA).zip -- /home/pi/RetroPie/roms/atari2600/Mario Bros. (1983) (Atari, Dan Hitchens) (CX2697, CX2697P) (PAL).bin
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).zip
File not found: /home/pi/RetroPie/roms/mame-libretro/drmario.zip
Found write with sed: /home/pi/RetroPie/roms/gba/Mario Kart - Super Circuit (USA).zip -- /home/pi/RetroPie/roms/gba/Mario Kart Super Circuit (U) [!].gba
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Wario Land 3 (JU) (M2) [C][!].gbc
File not found: /home/pi/RetroPie/roms/nes/Yoshi (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nintendobsx/dr. mario.smc -- /home/pi/RetroPie/roms/nes/Dr. Mario (U) (PRG1) [!].nes
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Super Mario Bros. (USA, Europe).zip
Found write with sed: /home/pi/RetroPie/roms/gba/Mario & Luigi - Superstar Saga (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario & Luigi - Superstar Saga (E) (M5).gba
File not found: /home/pi/RetroPie/roms/gba/Mario Party Advance (USA).zip
File not found: /home/pi/RetroPie/roms/atari5200/Mario Bros. (USA).bin
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 1.smc
File not found: /home/pi/RetroPie/roms/gameandwatch/Mario Bros.mgw
Found write with sed: /home/pi/RetroPie/roms/gba/Wario Land 4 (USA, Europe).zip -- /home/pi/RetroPie/roms/gba/Wario Land 4 (UE) [!].gba
Found write with sed: /home/pi/RetroPie/roms/nes/Mario Bros. (World).zip -- /home/pi/RetroPie/roms/nes/Mario Bros. Classic (E) [!].nes
File not found: /home/pi/RetroPie/roms/n64/Mario Party 3 (USA).n64
Found write with sed: /home/pi/RetroPie/roms/nes/Wrecking Crew (World).zip -- /home/pi/RetroPie/roms/nes/Wrecking Crew (U) [!].nes
File not found: /home/pi/RetroPie/roms/fds/All Night Nippon Super Mario Brothers (Japan) (Promotion Cart).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 3.smc
File not found: /home/pi/RetroPie/roms/sfc/Mario to Wario (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/n64/Super Mario 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Super Mario 64 (U) [!].z64
File not found: /home/pi/RetroPie/roms/nes/Mario's Time Machine (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario Is Missing! (USA).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Wario Land II (UE) [S][!].gb
File not found: /home/pi/RetroPie/roms/n64/Mario Party 2 (USA).n64
File not found: /home/pi/RetroPie/roms/sfc/Mario no Super Picross (J).zip
File not found: /home/pi/RetroPie/roms/n64/Mario Party (USA).n64
File not found: /home/pi/RetroPie/roms/nds/0168 - Mario Kart DS (U)(SCZ).nds
File not found: /home/pi/RetroPie/roms/gb/Wario Blast Featuring Bomberman! (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers (Japan).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros. 3 (Japan).zip
Found write with sed: /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong (E) (M5).gba
File not found: /home/pi/RetroPie/roms/nes/Mario Is Missing! (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Time Machine (USA).zip
File not found: /home/pi/RetroPie/roms/virtualboy/Mario's Tennis (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/gbc/Mario Tennis (USA).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Dr. Mario (Japan, USA) (Rev A).zip -- /home/pi/RetroPie/roms/nes/Dr. Mario (U) (PRG1) [!].nes
-1 -- 2: 2
0 -- 2: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (USA) (Rev A).zip
1 -- 2: /home/pi/RetroPie/roms/gb/Game & Watch Gallery 2 (U) [S].gb
2 -- 2: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (E) [S][!].gb
3 -- 2: 2
Begin new array with collection name and 2 possible entries
ARRAY! Build - call dialog
0 -- 2: /home/pi/RetroPie/roms/gb/Super Mario Land (World) (Rev A).zip
1 -- 2: /home/pi/RetroPie/roms/gb/Super Mario Land (W) (V1.1) [!].gb
2 -- 2: /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
3 -- 2: 3
Begin new array with collection name and 3 possible entries
ARRAY! Build - call dialog
0 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. (World).zip
1 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. (JU) [!].nes
2 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (U) (PRG1) [!].nes
3 -- 3: /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (U) (PRG1) [!].nes
4 -- 3: 2
Begin new array with collection name and 2 possible entries
ARRAY! Build - call dialog
0 -- 2: /home/pi/RetroPie/roms/snes/Super Mario World (USA).zip
1 -- 2: /home/pi/RetroPie/roms/snes/Super Mario World (U) [!].smc
2 -- 2: /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (U) (M3) (V1.0) [!].smc

[cyperghost]

@thelostsoul That's also no problem to delete non existing entries. But I don't know what the purpose is. Because ES just ignores files that are not available... very handy!

Currently I'm working on a backup solution (done) and on a report/logging system (done)

Now I just need the selection dialog. And the sed -i command
That's all!

But I will appreciate reports of the screen output and how good the routines are working. Yes I read the manpage of realpath could be useful if you split the ROMs in different locations.
Don't have fear about your collections... Currently I do no file operations, just give screen output. You can use NotePad++ to analyse what's there is happening

• level 1 finding is excellent, means collection is in the exact path - nothing to do
• sed write is good means, just one file found (maybe zip extension instead of smc/bin) - automatically correction possible
• dialog x files found User choice with dialog. I was able to build arrays we can send to dialog to get a graphical selection (currently working on this)

You learn a lot if you work with such tools. This is by far the very wicked script I've ever written. It's full of search and string operation routines. Needs lots of testing....

[thelostsoul]

@cyperghost Just wanted note here that I upgraded my post while you was posting.

[cyperghost]

@thelostsoul First productive version released.
It will create backups in folder ./collection_backup where your script is located.

DOWNLOAD here

My output of the Mario Collection
54 files not found
47 files found

But - I have no Japan system, no nds, no virtualboy, no sfc, no fds
If I count these systems:
5 sfc
4 nds
2 famicom
7 nintendobsx
2 virtualboy
10 NES US titels

I've 30 titles that are simply not installed ;)

Found write with sed: /home/pi/RetroPie/roms/fba/dkong3.zip -- /home/pi/RetroPie/roms/arcade/dkong3.zip
Found level 1: /home/pi/RetroPie/roms/gbc/Super Mario Bros. Deluxe (USA, Europe) (Rev B).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Yoshi's Cookie (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Yoshi's Cookie (U) [!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (USA) (Rev 1).zip -- /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (E) (M3) (V1.0) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (USA, Europe) (Rev B).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Kart 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Kart 64 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 3 (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/gameandwatch/Mario's Bombs Away.mgw -- /home/pi/RetroPie/roms/gameandwatch/Mario's Bombs Away (Nintendo, Panorama Screen).mgw
Found write with sed: /home/pi/RetroPie/roms/fba/ckong.zip -- /home/pi/RetroPie/roms/arcade/ckong.zip
Found level 1: /home/pi/RetroPie/roms/gbc/Mario Golf (USA).zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario RPG - Legend of the Seven Stars (U) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gba/Super Mario Advance (USA, Europe).zip -- /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).gba
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario All-Stars (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario All-Stars + Super Mario World (U) [o1+2C].smc
Found write with sed: /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 2 (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Game & Watch Gallery 2 (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/gb/Mario's Picross (USA, Europe).zip -- /home/pi/RetroPie/roms/gb/Mario's Picross (UE) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/snes/Wario's Woods (USA).zip -- /home/pi/RetroPie/roms/snes/Wario's Woods (U) [!].smc
Found write with sed: /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (USA).zip -- /home/pi/RetroPie/roms/snes/Tetris & Dr. Mario (E) [!].smc
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/dkong.zip -- /home/pi/RetroPie/roms/arcade/dkong.zip
Dialog hold 3 files: /home/pi/RetroPie/roms/gb/Game & Watch Gallery (USA) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Game & Watch Gallery 2 (U) [S].gb /home/pi/RetroPie/roms/gb/Game & Watch Gallery (E) [S][!].gb /home/pi/RetroPie/roms/gb/Game & Watch Gallery (U) (V1.1) [S][!].gb
Found write with sed: /home/pi/RetroPie/roms/fba/mario.zip -- /home/pi/RetroPie/roms/arcade/mario.zip
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Super Mario Land (World) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Super Mario Land 2 - 6 Golden Coins (UE) (V1.2) [!].gb /home/pi/RetroPie/roms/gb/Super Mario Land (JUE) (V1.1) [!].gb
Dialog hold 2 files: /home/pi/RetroPie/roms/gb/Yoshi (USA).zip -- /home/pi/RetroPie/roms/gb/Yoshi (U) [!].gb /home/pi/RetroPie/roms/gb/Yoshi's Cookie (U) [!].gb
Found write with sed: /home/pi/RetroPie/roms/gb/Dr. Mario (World) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Dr. Mario (JU) (V1.1).gb
Found write with sed: /home/pi/RetroPie/roms/snes/Super Mario Kart (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario Kart (E) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gb/Alleyway (World).zip -- /home/pi/RetroPie/roms/gb/Alleyway (JUE) [!].gb
Found write with sed: /home/pi/RetroPie/roms/gameandwatch/Donkey Kong Circus.mgw -- /home/pi/RetroPie/roms/gameandwatch/Donkey Kong Circus (Nintendo, Panorama Screen).mgw
Found level 1: /home/pi/RetroPie/roms/ports/Super Mario War.sh
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land 3 (World).zip -- /home/pi/RetroPie/roms/gbc/Wario Land 3 (World) (En,Ja).zip
Dialog hold 2 files: /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari).zip -- /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari).a78 /home/pi/RetroPie/roms/atari7800/Mario Brothers (1988) (Atari) (PAL).a78
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Super Mario World (USA).zip -- /home/pi/RetroPie/roms/snes/Super Mario World (E) (V1.1) [!].smc /home/pi/RetroPie/roms/snes/Super Mario World 2 - Yoshi's Island (E) (M3) (V1.0) [!].smc
Found write with sed: /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).zip -- /home/pi/RetroPie/roms/gba/Super Mario Advance 3 - Yoshi's Island (USA).gba
Found write with sed: /home/pi/RetroPie/roms/gba/Mario Kart - Super Circuit (USA).zip -- /home/pi/RetroPie/roms/gba/Mario Kart - Super Circuit.gba
Found write with sed: /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/nes/Yoshi (USA).zip -- /home/pi/RetroPie/roms/nes/Mario & Yoshi (E) [!].nes
Found write with sed: /home/pi/RetroPie/roms/gba/Mario & Luigi - Superstar Saga (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario and Luigi - Superstar Saga.gba
Found write with sed: /home/pi/RetroPie/roms/gameandwatch/Mario Bros.mgw -- /home/pi/RetroPie/roms/gameandwatch/Mario Bros. (Nintendo, Multi Screen).mgw
Found write with sed: /home/pi/RetroPie/roms/gba/Wario Land 4 (USA, Europe).zip -- /home/pi/RetroPie/roms/gba/Wario Land 4 (UE) [!].gba
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Party 3 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Party 3 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/n64/Super Mario 64 (USA).n64 -- /home/pi/RetroPie/roms/n64/Super Mario 64 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/snes/Mario Is Missing! (USA).zip -- /home/pi/RetroPie/roms/snes/Mario is Missing! (G).smc
Found write with sed: /home/pi/RetroPie/roms/gb/Wario Land II (USA, Europe).zip -- /home/pi/RetroPie/roms/gbc/Wario Land II (USA, Europe) (SGB Enhanced) (GB Compatible).zip
Found write with sed: /home/pi/RetroPie/roms/n64/Mario Party 2 (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Party 2 (U) [!].z64
Dialog hold 3 files: /home/pi/RetroPie/roms/n64/Mario Party (USA).n64 -- /home/pi/RetroPie/roms/n64/Mario Party (U) [!].z64 /home/pi/RetroPie/roms/n64/Mario Party 3 (U) [!].z64 /home/pi/RetroPie/roms/n64/Mario Party 2 (U) [!].z64
Found write with sed: /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong (USA, Australia).zip -- /home/pi/RetroPie/roms/gba/Mario vs. Donkey Kong.gba
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Mario's Time Machine (USA).zip -- /home/pi/RetroPie/roms/snes/Mario's Time Machine (U) [!].smc /home/pi/RetroPie/roms/snes/Mario's Time Machine (G).smc
Found level 1: /home/pi/RetroPie/roms/gbc/Mario Tennis (USA).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 2.smc
File not found: /home/pi/RetroPie/roms/sfc/Wrecking Crew '98 (Japan).zip
File not found: /home/pi/RetroPie/roms/gba/Yoshi - Topsy-Turvy (USA).zip
File not found: /home/pi/RetroPie/roms/nes/NES Open Tournament Golf (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Numbers (USA).zip
File not found: /home/pi/RetroPie/roms/nds/0662 - Yoshi's Island DS (U)(EvlChiken).nds
File not found: /home/pi/RetroPie/roms/gba/Game & Watch Gallery 4 (USA).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 4 - Super Mario Bros. 3 (USA, Australia) (Rev 1).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros (25 Anniversary Edition) (Japan).zip
File not found: /home/pi/RetroPie/roms/fba/dkongx.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/wrecking.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/suprmrio.zip
File not found: /home/pi/RetroPie/roms/nds/0037 - Super Mario 64 DS (U)(Trashman).nds
File not found: /home/pi/RetroPie/roms/nes/Super Mario Bros. 3 (USA) (Rev A).zip
File not found: /home/pi/RetroPie/roms/virtualboy/Mario Clash (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/gba/Super Mario Advance 2 - Super Mario World (USA, Australia).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/yoshi no panepon.smc
File not found: /home/pi/RetroPie/roms/nes/Yoshi's Cookie (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Undake 30 Same Game Daisakusen - Mario Version (Japan).zip
File not found: /home/pi/RetroPie/roms/snes/Yoshi's Cookie (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Yoshi no Cookie - Kuruppon Oven de Cookie (Japan).zip
File not found: /home/pi/RetroPie/roms/gba/Mario Pinball Land (USA, Australia).zip
File not found: /home/pi/RetroPie/roms/nes/Super Mario Bros. 2 (USA) (Rev A).zip
File not found: /home/pi/RetroPie/roms/nes/Super Mario Bros. (World).zip
File not found: /home/pi/RetroPie/roms/nds/0340 - Super Princess Peach (U)(WRG).nds
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Fun with Letters (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Mario's Early Years! - Preschool Fun (USA).zip
File not found: /home/pi/RetroPie/roms/gba/2 Games in One! - Dr. Mario + Puzzle League (USA, Australia).zip
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Dr. Mario (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 4.smc
File not found: /home/pi/RetroPie/roms/nintendobsx/wario no mori.smc
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers 2 (Japan).zip
File not found: /home/pi/RetroPie/roms/atari2600/Mario Bros. (USA).zip
File not found: /home/pi/RetroPie/roms/mame-libretro/drmario.zip
File not found: /home/pi/RetroPie/roms/nintendobsx/dr. mario.smc
File not found: /home/pi/RetroPie/roms/gba/Classic NES Series - Super Mario Bros. (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/gba/Mario Party Advance (USA).zip
File not found: /home/pi/RetroPie/roms/atari5200/Mario Bros. (USA).bin
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 1.smc
File not found: /home/pi/RetroPie/roms/nes/Mario Bros. (World).zip
File not found: /home/pi/RetroPie/roms/nes/Wrecking Crew (World).zip
File not found: /home/pi/RetroPie/roms/fds/All Night Nippon Super Mario Brothers (Japan) (Promotion Cart).zip
File not found: /home/pi/RetroPie/roms/nintendobsx/super mario usa power challenge 3.smc
File not found: /home/pi/RetroPie/roms/sfc/Mario to Wario (Japan).zip
File not found: /home/pi/RetroPie/roms/nes/Mario's Time Machine (USA).zip
File not found: /home/pi/RetroPie/roms/sfc/Mario no Super Picross (J).zip
File not found: /home/pi/RetroPie/roms/nds/0168 - Mario Kart DS (U)(SCZ).nds
File not found: /home/pi/RetroPie/roms/gb/Wario Blast Featuring Bomberman! (USA, Europe).zip
File not found: /home/pi/RetroPie/roms/fds/Super Mario Brothers (Japan).zip
File not found: /home/pi/RetroPie/roms/famicom/Super Mario Bros. 3 (Japan).zip
File not found: /home/pi/RetroPie/roms/nes/Mario Is Missing! (USA).zip
File not found: /home/pi/RetroPie/roms/virtualboy/Mario's Tennis (Japan, USA).zip
File not found: /home/pi/RetroPie/roms/nes/Dr. Mario (Japan, USA) (Rev A).zip
File not found: /home/pi/RetroPie/roms/nes/Wario's Woods (USA).zip

There are lot's of things to do but it is now handled as productive tool --- finally!

[thelostsoul]

Very nice! Can't wait to test use it. :-) Will report then. Thank you for all the work you done so far.

[cyperghost]

@thelostsoul Do that.
You can try to improve search routines. The logic in in case selection starting in line 118. Then you see each search case ends with a statement like [[ -z $filefind ]] && file_search 2 this means if the string is empty then try next search case.

I ended it in case 3 with statement [[ -z $filefind ]] && unset array this aborts the search and switches back to next line in custom collection. You can extend as much cases as you want. But one warning. I tried the usecase you told and the result was that for example a game for gamegear was setted to mastersystem .... I don't know if this is a good behaviour ;)

So I disabled this possibility! Maybe I add it later to get called by a command-line filefinder.sh --advanced or maybe selectable with a third option button integreated into custom collection select mask.... I don't know ;)

So far I just change entries but I think the user can add ROMs later. Because I store output of every run backup folders. There the results are listed ;)

[thelostsoul]

@cyperghost don't forget to update initial posting. ;-)

[thelostsoul]

Now, I tested the v99. Sorry for trying it so late! It could have been found earlier. I was just doing other stuff (input lag investigation, playing and so on).

First something not a bug, but very annoying on the console. Backup filesnames shouldn't start with numbers. Especially if all of them have similiar numbers. That makes autocomplete a little bit confusing and I have to be very careful. In example, I have 2 collections: Street Fighter and Mario. I can't just "nano 15" TAB, it won't autocomplete. I have to type whole number and be very careful, which next number is the right one, as it autocompletes only the half. If they start with the original name, its much easier and the number on the end of filename would be unimportant.

And then an error happened while importing the Street Fighter 2 collection, but I am not sure. It was asking me which game to choose from and none of them was right. So I decided to select "Don't change !". and it stopped with a message from sed. The original collection changed, I got 8 games found from original 1 game. I think, the games after sfiii aren't checked then.

And I would say don't change or touch anything if the script isn't terminated successfully or is about to. Everything should be done on a temporary file and if script reaches the end, it just asks the user if its ok to replace. Or even if it does not asks, it should only do the change, if it reaches the end of script and copy the temp file over.

Here is the log:

Found write with sed: /home/pi/RetroPie/roms/fba/spf2t.zip -- /home/pi/RetroPie/roms/mame-libretro/spf2t.zip
File not found: /home/pi/RetroPie/roms/ngpc/SNK vs. Capcom - The Match of the Millennium (World) (En,Ja).zip
File not found: /home/pi/RetroPie/roms/psx/Street Fighter Alpha 3 (USA).PBP
Found write with sed: /home/pi/RetroPie/roms/fba/sf2.zip -- /home/pi/RetroPie/roms/fba/hsf2.zip
File not found: /home/pi/RetroPie/roms/gba/Street Fighter Alpha 3 (USA).zip
File not found: /home/pi/RetroPie/roms/psx/Street Fighter EX2 Plus (USA).PBP
Found write with sed: /home/pi/RetroPie/roms/gb/Street Fighter II (USA, Europe) (Rev A).zip -- /home/pi/RetroPie/roms/gb/Street Fighter II (UE) [S][!].gb
File not found: /home/pi/RetroPie/roms/psx/Street Fighter EX Plus Alpha (USA).PBP
Dialog hold 2 files: /home/pi/RetroPie/roms/snes/Street Fighter II (USA).zip -- /home/pi/RetroPie/roms/snes/Street Fighter II Turbo - Hyper Fighting (U) [!].smc /home/pi/RetroPie/roms/snes/Street Fighter II - The World Warrior (E) [!].smc
Found write with sed: /home/pi/RetroPie/roms/snes/Street Fighter II Turbo (USA).zip -- /home/pi/RetroPie/roms/snes/Street Fighter II Turbo - Hyper Fighting (U) [!].smc
File not found: /home/pi/RetroPie/roms/megadrive/Super Street Fighter II - The New Challengers (USA).zip
File not found: /home/pi/RetroPie/roms/fba/sf2ce.zip
File not found: /home/pi/RetroPie/roms/fba/ssf2.zip
File not found: /home/pi/RetroPie/roms/psx/Marvel vs. Capcom - Clash of Super Heroes (USA).PBP
File not found: /home/pi/RetroPie/roms/gba/Super Street Fighter II Turbo - Revival (USA).zip
File not found: /home/pi/RetroPie/roms/megadrive-japan/Street Fighter II' Plus - Champion Edition (Japan).zip
File not found: /home/pi/RetroPie/roms/fba/xmvsf.zip
File not found: /home/pi/RetroPie/roms/megadrive/Street Fighter II' - Special Champion Edition (USA).zip
Found level 1: /home/pi/RetroPie/roms/neogeo/svc.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/sfex2p.zip
File not found: /home/pi/RetroPie/roms/fba/sf2hf.zip
Found level 1: /home/pi/RetroPie/roms/fba/sfiii2.zip
File not found: /home/pi/RetroPie/roms/gba/Super Puzzle Fighter II Turbo (USA).zip
File not found: /home/pi/RetroPie/roms/psx/Street Fighter Alpha - Warriors' Dreams (USA).PBP
File not found: /home/pi/RetroPie/roms/fba/svcpcb.zip
File not found: /home/pi/RetroPie/roms/pcengine/Street Fighter II' - Champion Edition (Japan).zip
File not found: /home/pi/RetroPie/roms/gbc/Street Fighter Alpha - Warriors' Dreams (USA).zip
File not found: /home/pi/RetroPie/roms/snes/Street Fighter Alpha 2 (USA).zip
Found level 1: /home/pi/RetroPie/roms/fba/sfiii3.zip
Found level 1: /home/pi/RetroPie/roms/fba/hsf2.zip
File not found: /home/pi/RetroPie/roms/fba/ssf2t.zip
File not found: /home/pi/RetroPie/roms/mame-libretro/sftm.zip
Found level 1: /home/pi/RetroPie/roms/fba/sfa3.zip
File not found: /home/pi/RetroPie/roms/fba/sfz2al.zip
File not found: /home/pi/RetroPie/roms/fba/sfzch.zip
Found write with sed: /home/pi/RetroPie/roms/snes/Super Street Fighter II (USA).zip -- /home/pi/RetroPie/roms/snes/Super Street Fighter II - The New Challengers (J).smc
Found write with sed: /home/pi/RetroPie/roms/fba/sfa.zip -- /home/pi/RetroPie/roms/fba/sfa3.zip
File not found: /home/pi/RetroPie/roms/psx/Marvel Super Heroes vs. Street Fighter (USA).PBP
File not found: /home/pi/RetroPie/roms/fba/mvsc.zip
File not found: /home/pi/RetroPie/roms/fba/sfa2.zip
Dialog hold 2 files: /home/pi/RetroPie/roms/fba/sfiii.zip -- /home/pi/RetroPie/roms/fba/sfiii2.zip /home/pi/RetroPie/roms/fba/sfiii3.zip

[cyperghost]

@thelostsoul Ahh... I know what you mean....

the find romname* won't find romname.extension name, but it will find romname1.extension romname2.extension and so on. But I don't get it why it does not find sfiii.zip because this is searched in first level.... Need to investigat.

About the dialog....
There is nothing implented.

case "$status" in

        2) # Help
           echo "help" 
        ;;

        3) # Extra 
           exit
        ;;
  
        *)  echo "$choices"
            break 
;;

If you choose "Don't change it's the CANCEL-button" and would be case 1....
You see I don't have implented this now ;) Also HELP button would just show "help" message. Not more not less.

Well I think that's the great advantage of inline changing. It's fast and it's automatic.

About the numbering and the autocomplete.... Well... There is no difference if you autocomplete 123456-filename or autocomplete filename-123456

You type first the numbers (indeed very carefully) and later got the filename which is faster to type. But I think it's better to see which file is newer/older

The highest number is the newest file. The filenumber is just the elapesed time in seconds since ... 1970? And I usw WINSCP (a graphical filemanager) to open files ;)

Thank you very much for your report - I appreciate this. But let me investigate abit the sfiii thing. That's weird.... Later I will implent a correct button action.

Things to do:

• Correct Button for Cancel
• HELP item will view full path of file
• Show counter how much dialogs the user should process....
• Optional: temp files instead of direct write to file (I prefer direct write)

It's still a work in progress ;) and the sed command failed because there was no paramter parsed to it.

[thelostsoul]

@cyperghost said in Pathfinder for Custom Collections - correct pathes for custom collections:

But I don't get it why it does not find sfiii.zip because this is searched in first level.... Need to investigat.

I don't have sfiii in my collection, so it can't find it. ;-)
After all, I misunderstood the "Don't change" button. Then everything is fine.
But what about sfiii, if I don't have this game? What if I don't want it to recognize as sfiii2 or sfiii3. What should have i selected then?

About the numbering and the autocomplete.... Well... There is no difference if you autocomplete 123456-filename or autocomplete filename-123456

Look at the image I uploaded. If I do "ls", I get this:

1526922783-custom-super_mario.cfg
1526922783-filefinder.log
1526923279-custom-street_fighter_ii.cfg
1526923279-filefinder.log

Now I type "nano 1" and do TAB, I get "nano 152692". Now what to do? I have to be very careful, next one is a 2 or a 3? Ok, type 3 and TAB. No problem. Now imagine there are more files with a lot of different numbers. They aren't sorted by name, just by random numbers. It would be much easier if I just type "nano c" TAB to get "nano custom-" and then "nano custom-s" TAB. Now imagine different collections with similiar titles and so many numbers. Here is how it could look like

1526922783-custom-super_mario.cfg
1526922783-filefinder.log
1526923279-custom-street_fighter_ii.cfg
1526923279-filefinder.log
1526924521-custom-street_of_rage.cfg
1526924521-filefinder.log
1526924573-custom-snes_collection.cfg
1526924573-filefinder.log

Ok, to be fair, I do most stuff on my pc connected to the raspberry pi. But I just wanted to point it out. Still not big deal.

[cyperghost]

@thelostsoul said in Pathfinder for Custom Collections - correct pathes for custom collections:

But what about sfiii, if I don't have this game? What if I don't want it to recognize as sfiii2 or sfiii3. What should have i selected then?

Okay ... I should implent a working "Do nothing" or "Proceed to next selection" button ;)

If you don't have a sfiii file then it's clear what happens.
It does not find the right file. Next Step is search for sfiii* files and guess... tada it will show sfiii2 and and sfiii3 ;) So there are several things that I can do...
I can add a working button or just add an "Ignore this entry" into the selection itself ;)

Again about the inline writing. It took me hours to find out how to use the sed command. It's easy to search for some words to replace but file pathes can be a bit different because there are signs in like the slash that are control characters ;) So the easiest way was - instead to replace the string by occourance - to replace the line were the string occours ;) Is the more effictive way because I wanted to avoid using temporary files!

About the filenaming. Maybe real dates would be better ;)
like "2018-05-21--21-50-10-custom-super-mario.cfg"
Would be more clearer but I was in hurry as I did a backup solution, so I used just the time gone in seconds since 1970.

[thelostsoul]

@cyperghost Yes, sed isn't easy to work, because of all the RegEx rules. I was once working on something different with heavy RegEx manipulations, so RegEx got my favorite function (back then, it was AutoHotkey on Windows :D). But why don't you want work with temporary files? In case something happens or I abort the process, nothing should have changed. Wait a second. And what is "Don't change !" doing? Shouldn't the file stay original afterwards? I think it changed the original file.

To be more clear, imho the options should be named to <Select>, <Stop now>, <Revert changes> and <Ignore this entry>.

[cyperghost]

@thelostsoul Made new updates....
You can select between advanced and simple search (I recommend simple in first try and then use advanced search in second try)

In ROM selection screen, Exit works, Skip works, Select works
Help does not work ... will display just a message box ;)

Newest version is here

[thelostsoul]

I have a real world use for your script now. I decided to change a lot of roms at NES and SNES, mostly from European to US version, because of 60 Hz. And now, many of my collections aren't up to date. But here comes your script and now they are. I have updated some of my collections now and I don't see any problem. Using Simple search. It works so far and it saved me some time, instead of manually checking every single file!! So a big thank you.

Edit this line: I forgot about the executable bit. To use the script without typing bash in front, you need to give the executable right for the script file with "chmod +x filefind.sh". Then for the starting script you need to type "./filefind.sh". Maybe add this info.

If the script is done, the screen don't change on my setup. It still shows the last menu entry like this:
As a sidenote, I use PuTTY client.

Ok, here is something else in my Action Adventure collection:

Found write with sed: /home/pi/RetroPie/roms/gbc/Legend of Zelda, The - Link's Awakening DX (G) [C][!].gbc -- /home/pi/RetroPie/roms/gbc/Legend of Zelda, The - Link's Awakening DX (G) [C][!].gbc

It is the same path, so no need for sed right? Is this a "BUG" or do I miss something? Same thing happened with "Kirby's Block Ball (U) [S][!].gb". Oh and with two other game boy games too. So it must be a game boy thing here, maybe because of the file endings. Or maybe not, it happened with snes entries too. Here entries when sed was used, while it was exactly the same:

Clock Tower (J) ]T+Eng1.01_AGTP].smc
Live A Live (Japan) [En by Aeon Genesis v2.0Deluxe].sfc
Alcahest (J) [T+Eng1.0_FH].smc

and some more. All entries like these above.

Another thing. It did not find alternative for

Mario Bros. Classic (E) [!].nes

while I have

Mario Bros. (JU) [!].nes

It is simple mode, I know, but after using simple mode, the entry is gone. Afterwards using advanced mode does not help. So user never knows when to use advanced mode. Maybe a function to restore a backup then?

[cyperghost]

@thelostsoul said in Pathfinder for Custom Collections - correct pathes for custom collections:

It is the same path, so no need for sed right? Is this a "BUG" or do I miss something? Same thing happened with "Kirby's Block Ball (U) [S][!].gb". Oh and with two other game boy games too. So it must be a game boy thing here, maybe because of the file endings. Or maybe not, it happened with snes entries too. Here entries when sed was used, while it was exactly the same:

Clock Tower (J) ]T+Eng1.01_AGTP].smc
Live A Live (Japan) [En by Aeon Genesis v2.0Deluxe].sfc
 Alcahest (J) [T+Eng1.0_FH].smc

I hunted that down. Please update the script... it's an error in find routine! The find command seems to be unable to hunt ] chars. So I escaped that.

You can try manually. Go to that directory and use find -name "Clock Tower (J) ]T+Eng1.01_AGTP].smc" and you will get no result. Type find-name "Clock Tower (J) ]T+Eng1.01_AGTP*" will get the result. Now type "Clock Tower (J) ]T+Eng1.01_AGTP/].smc"` and you will get a result. Don't ask me why!

and some more. All entries like these above.

Another thing. It did not find alternative for

Mario Bros. Classic (E) [!].nes
and 
Mario Bros. (JU) [!].nes

No chance!
The string compare is *Mario*Bros.* and *Mario*Bros.*Classic*
You can edit the ignorelist in line 13 and add Classic, then Classic will be escaped with a star and the search string is *Mario*Bros.* vs *Mario*Bros.*** and this will be a hit!

PS: Please tag my name, I just searched the forum today and saw an update done to this post. So the bug was very easy to resolve but took some time because I don't checked that post ;)

EDIT:::
Reverted the changes.... they don't work escaping /] is a failure

[cyperghost]

Final release

Fixed error in search level 1 @thelostsoul reported

• So there is no sed if file is found (I just escaped opening square bracket)
• Added Region settings mode inspired by @thelostsoul .... This is simply a search with all brackets removed. It will not work very good on arcade games!
• Added Info text in the beginning (therefore it's a final release because the script explains what it does now ;))
• All textoutput is hidden now (except if file is not found), so please let the program take it's time, you can enable logging if you edit calls to record() "MESSAGE" "#" the # is a number....
  • 0 enables text log only
  • 1 is text log and screen log
  • 2 is screen log only
  • last entry is -1, the disables all logging
  • Guys you will find out

Examples of it's work

I used @jamesnj entry for a custom collection: ARCADE COLLECTION and processed with my script

log output is a 100% conversion!

Found write with sed: /home/pi/RetroPie/roms/fba/timeplt.zip -- /home/pi/RetroPie/roms/arcade/timeplt.zip
Found write with sed: /home/pi/RetroPie/roms/fba/atetris.zip -- /home/pi/RetroPie/roms/arcade/atetris.zip
Found write with sed: /home/pi/RetroPie/roms/fba/qbert.zip -- /home/pi/RetroPie/roms/arcade/qbert.zip
Found write with sed: /home/pi/RetroPie/roms/fba/jrpacman.zip -- /home/pi/RetroPie/roms/arcade/jrpacman.zip
Found write with sed: /home/pi/RetroPie/roms/fba/btime.zip -- /home/pi/RetroPie/roms/arcade/btime.zip
Found write with sed: /home/pi/RetroPie/roms/fba/altbeast.zip -- /home/pi/RetroPie/roms/arcade/altbeast.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/superpac.zip -- /home/pi/RetroPie/roms/arcade/superpac.zip
Found write with sed: /home/pi/RetroPie/roms/fba/dkong3.zip -- /home/pi/RetroPie/roms/arcade/dkong3.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/pacman.zip -- /home/pi/RetroPie/roms/arcade/pacman.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/astdelux.zip -- /home/pi/RetroPie/roms/arcade/astdelux.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/galaxian.zip -- /home/pi/RetroPie/roms/arcade/galaxian.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/mrdo.zip -- /home/pi/RetroPie/roms/arcade/mrdo.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/mspacman.zip -- /home/pi/RetroPie/roms/arcade/mspacman.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/mpatrol.zip -- /home/pi/RetroPie/roms/arcade/mpatrol.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/digdug.zip -- /home/pi/RetroPie/roms/arcade/digdug.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/kangaroo.zip -- /home/pi/RetroPie/roms/arcade/kangaroo.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/qix.zip -- /home/pi/RetroPie/roms/arcade/qix.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/gravitar.zip -- /home/pi/RetroPie/roms/arcade/gravitar.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/junglek.zip -- /home/pi/RetroPie/roms/arcade/junglek.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/ddragon.zip -- /home/pi/RetroPie/roms/arcade/ddragon.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/spyhunt2.zip -- /home/pi/RetroPie/roms/arcade/spyhunt2.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/ladybug.zip -- /home/pi/RetroPie/roms/arcade/ladybug.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/paperboy.zip -- /home/pi/RetroPie/roms/arcade/paperboy.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/phoenix.zip -- /home/pi/RetroPie/roms/arcade/phoenix.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/sinistar.zip -- /home/pi/RetroPie/roms/arcade/sinistar.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/asteroid.zip -- /home/pi/RetroPie/roms/arcade/asteroid.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/spacedx.zip -- /home/pi/RetroPie/roms/arcade/spacedx.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/defender.zip -- /home/pi/RetroPie/roms/arcade/defender.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/robotron.zip -- /home/pi/RetroPie/roms/arcade/robotron.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/frogger.zip -- /home/pi/RetroPie/roms/arcade/frogger.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/joust.zip -- /home/pi/RetroPie/roms/arcade/joust.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/joust2.zip -- /home/pi/RetroPie/roms/arcade/joust2.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/congo.zip -- /home/pi/RetroPie/roms/arcade/congo.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/dkong.zip -- /home/pi/RetroPie/roms/arcade/dkong.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/dkongjr.zip -- /home/pi/RetroPie/roms/arcade/dkongjr.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/galaga3.zip -- /home/pi/RetroPie/roms/arcade/galaga3.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/galaga.zip -- /home/pi/RetroPie/roms/arcade/galaga.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/gorf.zip -- /home/pi/RetroPie/roms/arcade/gorf.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/invaders.zip -- /home/pi/RetroPie/roms/arcade/invaders.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/vanguard.zip -- /home/pi/RetroPie/roms/arcade/vanguard.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/xevious.zip -- /home/pi/RetroPie/roms/arcade/xevious.zip
Found write with sed: /home/pi/RetroPie/roms/mame-libretro/zaxxon.zip -- /home/pi/RetroPie/roms/arcade/zaxxon.zip

[thelostsoul]

@cyperghost Thank you for the update. I am currently rebuilding all of my collections. This may take some time. I will test your script someday later and report then.

[cyperghost]

@thelostsoul I used the scrip for your genesis custom collection....
2 files are missing....

1. Sonic Blast .... This file is not in my collection, so impossible to find
2. DECapAttack ... That's an error in writing, so no chance to discover

oUTPUT OF LOG
https://pastebin.com/9L9D3iU6