The invention discloses a fingerprint recognition device, a driving method thereof, a display panel and a display device, which comprises a plurality of fingerprint recognition units distributed in a matrix; signal input lines respectively in one to one correspondence with each column of the fingerprint recognition units and used for loading detection signals; and signal reading lines used for reading and recognizing signals. Each fingerprint recognition unit is composed of a fingerprint recognition electrode, a first switch unit and a second switch unit, wherein the first switch unit and the second switch unit are connected with the fingerprint recognition electrode respectively. The first switch units are used for controlling the switching-on states of the fingerprint recognition electrodes with the signal input lines. The second switch units are used for controlling the switching-on states of the fingerprint recognition electrodes with the signal reading lines. In this way, under the effects of the first switch units and the second switch units, each row of the fingerprint recognition units are controlled to successively load detection signals row by row and are simultaneously controlled to successively read and recognize the signals row by row. Therefore, the scanning time is shortened, and the scanning efficiency is improved. The recognition accuracy is also improved.