In the infrared imaging detection system, the effective suppression of infrared image background is the prerequisite of accurate detection of small and dim targets. In this paper, we propose a new method of infrared image background suppression based on spatial-temporal filtering based on the constraint of the target in the local gray stability in spatial domain and the motion continuity in temporal domain. First, the stable and strong fluctuation complex background suppression is processed in temporal and spatial domain using the superiority of guided image filtering in image detail preservation and partial differential equations in mutation area extraction. Then, the OR-operation is applied to eliminate the clutter similar to the small target. Finally, in order to recover the target information that lost in the early suppression, the result of OR-operation is used as the guided image to further optimize the suppression results. In the simulation experiment, two real low signal-to-clutter ratio (SCR) infrared imagery sequences containing moving dim small target are applied to verify the efficiency of the proposed method. Compared with several conventional methods, the experimental results show that the performance of proposed method is superior to these methods both in aspects of subjective visual and objective evaluation index.