Thanx @UDb23 and @pjft!
It was the config_save_on_exit = "true" thing that messed it up.
I must have changed that a while back ago when I tried to get hi-scores to be saved.
Got it back to "false" now and the overlays work as intended!
And also thanx for the awesome overlays @UDb23!