We actually just improved the algorithm to address exactly that scenario:

http://blog.highlightcam.com/post/176798199/highlighting-now...

Camera motion is no longer considered "interesting" unless there's other motion against the static background. Works especially well with jittery cameras and panning security cameras.