Mean shift tracking fails when the velocity of target is so large that the target’s window kernel in the previous frame can not cover the target in the current frame. Combination of mean shift and single Kalman filter also fails when the target’s velocity changed suddenly. To deal with the problem of tracking image target that has large and changing velocity, an efficient image tracking method integrated mean shift and double model filters is proposed. Two motion models can switch each other by using a probabilistic likelihood. Experiment results show the method integrated mean shift and double model filters can successfully keep tracking target, no matter the target’s velocity is large or small, changing or constant, with modest requirement of computation resource.