Moving object detection and segmentation is important for traffic surveillance and object recognition in security surveillance. Moving object detection in dynamic environment video is more complex than the static environment videos. This proposed methodology consists of background subtraction and classification modules. The absolute difference image is constructed in the background subtraction module. The features are extracted from this difference image and these extracted features are trained and classified using ANFIS classification module. The moving object detection for video surveillance is proposed using classification approach Co-Active Neuro Fuzzy Expert System (CANFES) classifier.