Most real-time video processing systems/techniques only address relationships of objects within the same frame, disregarding time information. Optical flow accounts for this temporal relationship between frames. Advances in Optical Flow have changed the game in Object Tracking and Human Activity Recognition in videos.

This article explains the fundamentals and gives you the code to try it out for yourself.