The present invention relates to digital image processing and high dynamic range image processing. In order to detect and correct ghosting generated in the image fusing process, the present invention adopts the technical scheme that a multi-exposure image fusion ghosting removing method based on background modeling comprises the following steps of: firstly, converting images into gray-scale images and carrying out histogram equalization on a series of images with different exposures, so that the gray scales of the images are normalized into a range of 0 to 255 and are uniformly distributed; then a moving object is used as a singular point and obtaining a modeling result of removing a background image of the moving object by utilizing median filtering; respectively subtracting the background image from the images comprising the moving object to obtain the images which only comprise the moving object after the background is removed; and by morphological operations comprising erosion and dilation, carrying out precision processing on the moving object images, using an obtained result as a weight map and then according to the weight map, carrying out fusion on the images. The multi-exposure image fusion ghosting removing method based on background modeling is mainly applied to digital image processing.