@mitu
Thanks sudo /usr/sbin/sshd -d to debug helped a lot.
It was the very first line /etc/ssh/sshd_config that had been uncommented, I noticed it wasn't in yours but it kind of blends in and I kept ignoring it for some reason.