A bearing abnormal sound detection system provided by the present invention comprises a test bed, a processing terminal, a reference object sensor set and a to-be-tested object sensor set. The reference object sensor set is arranged to correspond to a reference bearing box and is used to acquire a reference sound signal sent out by the reference bearing box, the to-be-tested object sensor set is arranged to correspond to a to-be-tested bearing box and is used to acquire a to-be-tested sound signal sent out by the to-be-tested bearing box, and the processing terminal is used to compare the to-be-tested sound signal and the reference sound signal, and determine whether the to-be-tested bearing box generates a fault according to a comparison result, so that when the fault of the to-be-tested bearing box is detected, the influence of an interference noise signal generated on a vehicle shaft and relative to the bearing box at one end can be eliminated effectively, the accuracy of a detection result is improved, and the problem in the prior art that a bearing abnormal sound detection device is interfered and influenced by an environmental background noise signal, so that an accurate bearing running-in abnormal sound signal analysis result is difficult to obtain, is solved.