We have implemented input from a Sony camera module and a Gaode infrared module, along with compression, storage, and RTSP forwarding. Tracking and recognition functionalities have been added, including ByteTrack for multi-target ID assignment. We have also addressed and improved dual-channel transmission and control issues from previous models. If you are interested in using this solution, please contact me. I'm open to discussing it at a reasonable price, offering two options: open-source availability or direct shipment using my proprietary protocol.

There are still some issues, such as OSD overlay speed. For example, we lack sufficient training samples to achieve recognition of specific target types. Also, the current tracking algorithm is designed for ship targets and hasn't been truly tested in flight for target tracking on a UAV. Some parameters might still require adjustment. Nevertheless, some functionalities have been achieved overall. The basic ideal block diagram is shown below.

Here are some photos from the debugging process.

Visible Imaging

Infrared Imaging

Ground Station Picture-in-Picture

Approximate Hardware Wiring: Gigabit Ethernet + Power Supply

Mosquitoes at night, screen window not open.