This paper focus on one of the major problems in model-based object tracking, the problem of how to dynamically update the model to adapt changes in the structure and appearance of the target object. We adopt Irregular Graph Pyramids to hierarchically represent the topological structure of a rigid moving object with multiresolution, making it possible to add new details observed from an approaching object by expanding the pyramid.