crt-pi shader users - reduce scaling artifacts with these configs in lr-mame2003, lr-fbalpha, lr-nestopia (and more to come)

[dankcushions]

@RumblinBuffalo said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

@caver01

I don't believe this is going to work as I had hoped. Using Sega Genesis as an example, with the integer scaled height being either 1120 or 896, I'm always going to be either slightly taller or slightly shorter than the display. I tried customizing at 1080 height but of course that is not the proper scale, and thus the banding is noticeable (NHL Hockey for example has noticeable banding on the ice as the screen moves up/down).

Integer scaling looks great, but again I'm limited to the black bars top/bottom. After re-reading and better understanding some of the above, it looks like I may have taken the long way around the block on this.

home consoles often accounted for varying overscan capabilities of consumer TVs. that is, you can use a vertical scale that is BIGGER than your screen, and not worry about the bit of image you've cut off at the top and bottom, because it will not have anything crucial to the gameplay. e.g., the score in sonic and super mario bros isn't right at the top of the screen, because some (perhaps most?) TVs might not show that.

this is what i do for nes snes and megadrive (along with getting the correct horizontal scale via my algorithm). i'll release my cfgs at some point if anyone cares!

[RumblinBuffalo]

@caver01 said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

The real benefit was for scaling vertical arcade titles on horizontal displays where you were going to have black borders on the sides anyway. The beauty was you could scale the horizontal dimension of vertical games to an integer magnification to prevent banding artifacts of the shader, then stretch the vertical all the way to the edge of the screen because that dimension carried no banding problems.

@caver01 Agreed and thanks. I'm gaining a much better understanding of this now. It works with vertical arcade games because they have plenty of room (on my wide screen) to be scaled to a usable "integer magnification", which eliminates the banding (which is essentially horizontal banding sideways due to the vertical shader). Trying this with a Genesis or NES game doesn't work because the integer scale height (1120) is taller than my 1080 display - hence the cutoff. How (if at all) do you apply shaders for these systems in your roadcase?

@dankcushions said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

home consoles often accounted for varying overscan capabilities of consumer TVs. that is, you can use a vertical scale that is BIGGER than your screen, and not worry about the bit of image you've cut off at the top and bottom, because it will not have anything crucial to the gameplay. e.g., the score in sonic and super mario bros isn't right at the top of the screen, because some (perhaps most?) TVs might not show that.

@dankcushions Thank you - I think that explains it exactly for me. So some games - Sonic and Mario are perfect examples - look fine if I stretch to the 1120 scale because the scores don't cutoff. However, a few games like Streets of Rage or Revenge of Shinobi that put information in a yellow border right at the top of the screen, are partly hidden above the screen (presumably because the developer didn't take the overscan into account?)

this is what i do for nes snes and megadrive (along with getting the correct horizontal scale via my algorithm). i'll release my cfgs at some point if anyone cares!

I'd definitely be interested to see your cfgs. So you actually scale your nes/snes/megadrive larger than your screen?

[caver01]

@dankcushions said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

home consoles often accounted for varying overscan capabilities of consumer TVs. that is, >you can use a vertical scale that is BIGGER than your screen, and not worry about the bit of >image you've cut off at the top and bottom, because it will not have anything crucial to the >gameplay. e.g., the score in sonic and super mario bros isn't right at the top of the screen, >because some (perhaps most?) TVs might not show that.

this is what i do for nes snes and megadrive (along with getting the correct horizontal scale via my algorithm). i'll release my cfgs at some point if anyone cares!

Are you saying that you setup a viewport for some of the home consoles that exceeds the vertical dimensions of your display? If so, I am very interested in that, or however you are doing it. I guess I must be just living with some shader issues on the home consoles. I do see some odd stuff that was normally offscreen in the good old days, so I am curious about your setup. Perhaps you could share an example, and I can take it from there. I think we are running different display resolutions anyway, but I'd love an example config for say, Atari 2600 or NES if you are willing.

[Furluge]

@dankcushions Could I by any chance get a version of the 720p configs that use the curvature versions of the shaders?

[dankcushions]

@Furluge there's no need for integer scaling on the curved version i think. it doesn't line up the same way

[Furluge]

@dankcushions Ok, but it is still useful to have the override for all the vertical games.

[dankcushions]

@Furluge said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

@dankcushions Ok, but it is still useful to have the override for all the vertical games.

very true! i've done this also now - check the top post :) I've also updated the other links to have the 'tolerance' version also. not tested any of this yet but it looks ok.

[Nataq]

Hi !

I am very interested in this. My Samsung UN28H4000 has a 1366x768 resolution though. Can you share a version of your work for that specific resolution ? Unless you think its too odd ? There is some part of the conversation, specifically about aspect ratio, I dont fully understand. All I am interested in is to get the proper vertical shader for vertical game and not touch my horizontal games since I am happy with the result.

Thank you for your help !

If it is easy to do, it would be nice to add a few more resolutions to your first post so you get less requests :P

[dankcushions]

@Nataq said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

Hi !

I am very interested in this. My Samsung UN28H4000 has a 1366x768 resolution though. Can you share a version of your work for that specific resolution ? Unless you think its too odd ?

Done! see original post :)

There is some part of the conversation, specifically about aspect ratio, I dont fully understand. All I am interested in is to get the proper vertical shader for vertical game and not touch my horizontal games since I am happy with the result.

the scripts do change horizontal games, but i think you will either not notice or be happy with what it does. if you only want to do vertical games i can generate that for you, but try first :)

[Nataq]

@dankcushions Awesome ! Can't wait to try this out. Thank you :)

[Nataq]

Ok I extracted the file into /opt/retropie/configs/all/retroarch/config/MAME 2003/ and I can see all the files there although the vertical shader isn't loaded in games.

• I still see the horizontal rainbow effect on vertical games
• I am using version 4.1 of retropie
• My Roms are located directly into retropie\roms\mame-libretro
• Even if I add .zip to the cfg file name and drop in roms folder it isn't working
• I can see the message saying override cfg file has been loaded when launching games

Can some part of my config block the shader change somehow ?

[dankcushions]

@Nataq said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

Ok I extracted the file into /opt/retropie/configs/all/retroarch/config/MAME 2003/ and I can see all the files there although the vertical shader isn't loaded in games.

• I still see the horizontal rainbow effect on vertical games
• I am using version 4.1 of retropie
• My Roms are located directly into retropie\roms\mame-libretro
• Even if I add .zip to the cfg file name and drop in roms folder it isn't working
• I can see the message saying override cfg file has been loaded when launching games

Can some part of my config block the shader change somehow ?

it's maybe possible! what i would suggest is updating to the latest retroarch binary, which should be via retropie-setup > manage packages > core > retroarch > update by binary. this should make sure you have the latest shaders in the right place, and the version of retroarch that supports these overrides (which I guess you should already have but still...)

if that doesn't work, can you upload your configs:
/opt/retropie/configs/all/retroarch.cfg
/opt/retropie/configs/mame-libretro/retroarch.cfg

maybe something in there, but i thought that overrides should override all!

[Nataq]

@dankcushions Will my config files be overwritten by updating to the latest retroarch binary ? I have put so much work in this hehe. Will make sure to backup first anyway but would like to know.

Will post my main retroarch.cfg and mame-libreto one later tonight as I can't access it right now.

I have seen in another post that those lines are needed for per rom config to work :

core_specific_config=false
auto_overrides_enable=true

Can you confirm ?

Thanks again for your time !

[dankcushions]

@Nataq said in crt-pi shader users - reduce scaling artifacts in lr-mame2003/lr-fbalpha (horizontal AND vertical games):

@dankcushions Will my config files be overwritten by updating to the latest retroarch binary ? I have put so much work in this hehe. Will make sure to backup first anyway but would like to know.

no :)

Will post my main retroarch.cfg and mame-libreto one later tonight as I can't access it right now.

I have seen in another post that those lines are needed for per rom config to work :

core_specific_config=false
auto_overrides_enable=true

Can you confirm ?

oh, this might be it! yes the second one is required. the first... i don't think so. i wouldn't change it.

[Furluge]

@dankcushions Thank you, you're a real lifesaver. It was so strange having all my crt based systems doing curve but arcades.

[Nataq]

@dankcushions

Well, it didnt worked :(

Updated to latest binaries and tried the two strings in retrorach.cfg all and libretro-mame.

Here is my \retropie\configs\all\retroarch.cfg : https://dl.dropboxusercontent.com/u/26446913/all-cfg/retroarch.cfg
And \retropie\configs\mame-libretro\retroarch.cfg : https://dl.dropboxusercontent.com/u/26446913/mame-libretro-cfg/retroarch.cfg

[dankcushions]

@Nataq i see some problems with your cfgs. you should put
auto_overrides_enable="true"
as the first line in both to be sure.

also what game are you running, from which directory and using which emulator?

[Nataq]

@dankcushions

Spent another few hours on this this morning and found a few interesting things although still not working.

I did realized the .cfg files located in /opt/retropie/configs/all/retroarch/config/MAME 2003/ are actually doing something : When I load a game, like Aliens, the screen is now more squished vertically with smaller black bars on the left and right of the screen. If I remove the aliens.cfg from that folder then the screen is back to normal or unaltered format with bigger black bars on the sides. Seems like the config files are taken into account finally BUT, and this is where I really scratch my head now, whatever shader I specify from those game config files isn't loaded properly thus explaining why vertical games are not showing the vertical shader.

So my only focus now is to figure out why I can't specify a shader in those config files.

For example, the command line for an horizontal game as per your game cfg files is this :
video_shader = "/opt/retropie/configs/all/retroarch/shaders/crt-pi.glslp"

If I change it for video_shader = "/opt/retropie/configs/all/retroarch/shaders/crt-pi-curvature.glslp" its should be pretty obvious if working by seeing the curved screen. But it isn't showing. Whatever shader I specify there has no effect (still show the crt-pi shader) although the other format settings related to the format are taken into account.

I can see all the shaders in the folder located here: /opt/retropie/configs/all/retroarch/shaders so its not like they are not present.

I am wondering if MAME somehow has more privilege over the per game cfg files (as for the button mapping for example) and is not taking control of the shader... if that make sense...

My MAME roms are located in : \retropie\roms\mame-libretro and as far as I know I am using MAME2003. I would like to confirm this but somehow my retroarch menu binding isn't working in MAME (that is another story).

I appreciate your help and wouldn't mind opening another thread for that "can't change shader" issue since I understand it might not be totally related to the solution you offer here.

Thank you again very much.

[dankcushions]

ok i have a 1080p override file for nes that i'm playing around with. name it Nestopia.cfg:

# Auto-generated crt-pi.glslp .cfg
# Place in /opt/retropie/configs/all/retroarch/config/Nestopia
video_shader_enable = "true"
video_shader = "/opt/retropie/configs/all/retroarch/shaders/crt-pi.glslp"
custom_viewport_width = "1536"
custom_viewport_height = "1120"
custom_viewport_x = "192"
custom_viewport_y = "-20"
aspect_ratio_index = "22"

it requires lr-nestopia as your default nes emulator (it's lr-fceumm by default i think). this is because fceumm seems to have some dropped frames at 1080p. plus it handles resolutions slightly differently.

i need to try it with more games but it seems to work quite nicely. you lose a bit of the extreme top and bottom of the image but this doesn't seem to cut off anything relevant to gameplay so far. plus with these settings it's properly integer scaled, and pretty close to 4:3 resolution :)

[Nataq]

I have created another thread not to pollute this one with my issue above but since I have found a solution I will put it here too.

In short, the path to the shader was the issue. I don't know why since I can find the shaders in the folder but using the Retroarch GUI to save a shader change, I have found it created this path to get to the shader :

video_shader = "~/.config/retroarch/shaders/crt-pi-vertical.glslp"

If I use that same line in any .cfg files I have, it works fine.

I am wondering why your path isn't working though but I can now easily adjust.

I hope that can help others getting this to work.

Thanks for the help again !

Edit: My issue might have something to do with this : https://github.com/libretro/RetroArch/issues/349