Provided is an image recognition system with which it is possible to recognize, with a lower calculation load, an image having sequentiality. An image information regression unit accepts a reference image I(t) as input and outputs reference image information y(t) according to a reference image information regression function. A change amount calculation unit calculates an image change amount ΔI from the reference image I(t) and a close reference image I(t+Δt). A difference image information regression unit accepts the change amount ΔI as input and outputs difference image information Δy according to a difference image information regression function. An image information integration unit integrates the difference image information Δy outputted from the difference image information regression unit and the reference image information y(t) outputted from the image information regression unit.