@mediamogul I think I found out the source of the bug, it seems to be the steamcontroller driver. For whatever reason there was no log of it yesterday, but the syslog is filled to the brim with error message from its py script. Plus the timing fit perfectly, one message every 2 secs.
Gotta afk for a couple of minutes, but will report back on it soon enough.
I'm just gonna leave snipet of the log there: http://pastebin.com/qk9uW2dh

Gonna uninstall the steamcontroller driver for now and report the bug to github

EDIT : confirmed steam controller driver is faulty. Back to smooth footage and xbox controller for now I guess. Thanks for not leaving me alone on this one guys ^^.