Design and implementation a robotic vision system to distinguish the color for object and his position coordinate, and then sort the object (product) on the right branch conveyor belt according to color at real time. The system was build based on HVS mode algorithm for sorting the color. Furthermore, the system can be distinguished the object shape and then find his position to picking the object shape and putting on the right branch conveyor belt. The assumptions for the object shape were based on the shape properties, centroid algorithm and border extraction. The main objective is met by sorting the object based on color feature from a group of objects. The robot movement (open and close griper, move up and down the arm, and move to the left and right) controlled by a micro-controller which control the movement to right branch conveyor belt. When the color or the object is detected, the micro-controller will initiate the actions on the robot. It was found that the accuracy of results based on the approach that developed in this paper which are 92% for shape sorting and 97% for colors sorting objects.