A little update about this situation.
I've contacted my ISP and i can't seem to switch out the modem. They sent me some firmware updates, which also didn't help. The solution they offered me was, buying an external WiFi adapter or hookup a router to the modem. Both options are out of the question for me.
But now something I can't put my head around. As said previously most of times i get speed under 1 Mbit/s, but as soon I transfer files over to the pi by SFTP i get much better speeds (atleast 5 Mbit/s stable). This proves there is nothing wrong with the signal or antenna in my case.