The invention discloses a multi-bit Delta-Sigma modulation-based digital speaker system implementation method and device. The method comprises the following steps: 1) converting digital input formats; 2) performing oversampling interpolation filtering; 3) performing multi-bit Delta-Sigma modulation; 4) encoding a thermometer; 5) performing multi-channel mismatch-shaping; 6) converting encoding formats; 7) performing multi-channel digital power amplification; 8) driving a speaker array or a multi-voice coil speaker unit to phonate. The device comprises a digital input interface, an oversampling interpolation filter, a multi-bit Delta-Sigma modulator, a thermometer encoder, a multi-channel mismatch-shaper, an encoding format converter, a multi-channel digital amplifier, and a speaker array or multi-voice coil speaker unit which are sequentially connected. By adopting the method and the device, the high-power output under low-voltage power supply can be realized; the power consumption is reduced; the single chip integration of a multi-channel playback system is realized; the volume weight and the implementation cost of the system are reduced; the quality of playback voice is improved.