© 2019 Association for Computing Machinery. Phase shifting profilometry (PSP) is one of the most popular technologies for 3D shape reconstruction. However, as multiple fringe patterns are used in PSP, the object is required to be kept static during the measurement. Errors will be introduced when moving object is reconstructed. This paper proposes a new method to reconstruct the multiple moving objects based on PSP. The multiple objects can have different movement. At first, the objects are tracked separately. Then, the rotation matrix and translation vector describing the movement for each object are obtained. With the relationship between the object movement and the phase value, the reconstruction model employing the movement information is used to eliminate the errors caused by the movement. At last, the objects are reconstructed separately with high accuracy. The effectiveness of the proposed method is verified by experiments.