We present a method for the detection and tracking of multiple people totally occluded or out of sight in a scene for some period of time in image sequences. Our approach is to use time weighted color information, i.e., the temporal color, for robust medium-term people tracking. It assures our system to continuously track people moving in a group with occlusion. Experimental results show that the temporal color is more stable than shape or intensity when used in various cases.