The invention discloses an oily water separation device suitable for ships. The oily water separation device comprises a control device, and an oily water collection tank, an oil-water coarse separator, an oil-water separator and a sump oil separation dryer, which are communicated in sequence. A water discharging hole of the oily water collection tank is communicated with an input hole of the oil-water coarse separator; a sewage output hole of the oil-water coarse separator is communicated with an input hole of the oil-water separator; a water outlet of the oil-water separator is communicated with an input hole of a water pump; an oil discharging hole of the oily water collection tank, a sump oil discharging hole of the oil-water coarse separator and an oil outlet of the oil-water separator are communicated with a sump oil input hole of the sump oil separation dryer; heaters are arranged in the oily water collection tank, the oil-water coarse separator, the oil-water separator respectively. According to the oily water separation device suitable for the ships, impurities and one part of sump oil in oily water are primarily removed through the oily water collection tank and the oil-water coarse separator, so that the separation effect on the oily water by the oil-water separator is improved; meanwhile, disturbance and emulsification caused by the water pump on the oily water are reduced and the service life of the water pump is prolonged.