A video surveillance and processing system with smoke detection capability is developed based on the high-performance AM5728 chip, which features a low-power floating-point DSP and dual-core ARM architecture. The system leverages SysLink—the foundational component of Davinci heterogeneous multi-core communication—to enable efficient communication and processing of video signals across heterogeneous multi-core processors. It features compact size, low power consumption, flexible and efficient algorithm implementation, and the ability to operate independently without a host computer. On the DSP side of the AM5728, a smoke detection algorithm based on image frequency characteristics is implemented. By comprehensively analyzing the correlation coefficients of frequency-domain images and grayscale images relative to a reference image, the system can detect both dense and thin smoke. Furthermore, by utilizing unique characteristics of smoke, it effectively avoids false alarms caused by moving objects or changes in illumination.