In this real world, many public or open areas are facilitates with cameras at multiple angles to monitor the activities in that area for keeping human safe. This is a very growing research area of computer vision. In order to support this surveillances system, an object detection and tracking over consecutive video frames, is developed. The goal of this book is to provide a detailed overview with algorithm which will be able to detect and track the moving object to monitor their activity in consecutive video frames. Here we have taken two video sequences.