Vehicle AI Box: AI-Based 360-Degree Surround View Safety Monitoring Solution for Excavators and Construction Vehicles

Reconstructing risk control service models with big data, aligning with enterprises' development trend of "reducing costs and increasing efficiency."

2.1.1 DMS Safe Operation System Upgrade DMS (Driver Monitor System) is an abbreviation for Driver Monitoring System, which refers to an information technology system that continuously monitors the driver's fatigue status and dangerous driving behaviors during vehicle operation. Upon detecting driver fatigue, yawning, squinting, or other incorrect driving states, the DMS system will promptly analyze these behaviors and provide audible and visual alerts, serving to warn the driver and correct incorrect driving behaviors. DMS is generally divided into active DMS and passive DMS. Passive DMS judges the driver's state based on steering wheel turns and driving trajectory characteristics. Active DMS systems typically use cameras and near-infrared technology to detect driver status from eyelid closure, blinking, gaze direction, yawning, and head movements. This system adopts active DMS. The schematic diagram for existing excavator modification is as follows:

High-Precision Positioning Product Features:
- Gyro Drift: Eliminates drift to obtain high-precision attitude and heading information.
- Acceleration Noise: Eliminates vibration acceleration to obtain high-precision speed.
- Zero-Velocity Update: Zero-velocity update algorithm prevents navigation drift.
- Software Algorithm: Based on the Extended Kalman Filter (EKF) algorithm model.
- Intelligent Recognition: Identifies and isolates data with significant errors.
- Eliminates Odometer Reliance: Pure inertial navigation achieves high-precision positioning.
- Navigation Technology: Autonomous switching between integrated navigation and pure inertial navigation.
- Driving Behavior: Analysis of harsh acceleration, harsh braking, sudden lane changes, and sharp turns. The objectives achieved after the upgrade are as follows:
- Implement DMS warnings: e.g., fatigue driving, distraction warnings.
- Achieve real-time video recording during excavator operation (front, rear, left, and right sides), configured with two 256GB high-capacity SD cards to ensure long-term data storage, with loop recording support.
- 4G real-time monitoring of each vehicle's working status, allowing for constant tracking of vehicle location and operational status, with centralized management of all vehicles via a unified management platform.
- The recorder also features WiFi communication, supporting data upload and backup to a central storage server at any time within WiFi-covered work areas.
- The right and rear cameras also feature BSD (Blind Spot Detection) functionality, accurately identifying pedestrians and non-motorized vehicles within the blind spots in front of and behind the vehicle during operation. When a potential danger is detected, the system promptly issues an alert via an intelligent audible and visual alarm to prevent accidents.

Features
- Supports 4-channel AHD HD input (1080P*30FPS, 720P, D1, CIF resolutions, etc.); supports connecting IPC via network port.
- Video files use H.265 & H.264 encoding/decoding, saving storage space and transmission bandwidth.
- Supports 4-channel audio input, 1-channel audio output; 1-channel voice intercom; external speaker support.
- Supports 1-channel CVBS video output (optional 1-channel VGA video output).
- Supports manual or scheduled recording to 2 SD cards, with a maximum capacity of 512GB.
- Supports 1 USB 2.0 interface for exporting video files and mouse operation.
- Supports 1 SIM card for 4G communication and internet access; supports Beidou 3/GPS dual-mode positioning; supports built-in WiFi function.
- Supports emergency alarm function and 4-channel switch signal input, 1-channel switch output, 2 RS232 serial ports (optional 1 RS232, 1 RS485).
- Built-in AI intelligent algorithms, supporting ADAS, DMS, BSD, and 360° surround view.
- Supports mobile APP, client software, and platform software for video preview and parameter configuration.
- Dedicated file system to improve disk read/write efficiency and ensure more stable recording.
- Exquisite and portable product design, aluminum alloy casing, lightweight, robust, and good heat dissipation. Wide-Angle Low-Light Full-Color FBSD Camera Features
- Applicable to trucks, buses, and other vehicles.
- Provides high-definition images and videos.
- Analog High Definition (AHD) video signal output.
- Wide horizontal angle, up to 150°.
- 4P aviation connector interface, secure and reliable.
- Full metal zinc alloy casing, unique appearance.
- Aesthetically pleasing structure, convenient for interior and exterior vehicle installation.
- Day and night full-color.
- Stable and reliable, capable of high-temperature resistance.
- Good shock resistance.
- Good waterproof performance.
- Suitable for forward blind spot detection.

Audible and Visual Alarm
- Applicable to dump trucks, cargo trucks, construction machinery, and other vehicles.
- Provides voice and audible/visual alarms.
- Signal-triggered alarm (9V or higher).
- Blind spot alarm.
- Built-in automotive-grade high-power speaker.
- Built-in 4 high-brightness LED lights, fog and rain penetrating.
- ABS+PC plastic casing.
- Aesthetically pleasing structure, convenient for rear vehicle installation.
- Wide voltage design, DC9V-36V, can be externally connected to vehicle ACC power and DVR power.
- Equipped with a 4P aviation female connector.
- Stable and reliable, capable of high-temperature resistance.
- Good shock resistance.
Big Data Platform Management

- Real-time vehicle location viewing, real-time status updates.
- Supports simultaneous playback for multiple vehicles.
- System covers various types of vehicles.
- Accurate historical trajectories, big data algorithms remove outliers and disconnected data to ensure data precision.
- Real-time multi-angle vehicle video (cabin, anti-fatigue, 360-degree panoramic, ADAS monitoring, DMS monitoring).
- Safety early warning models (anti-fatigue, distraction, smoking, phone calls).
- Route Scheduling: Freely schedule daily vehicle routes and review historical vehicle routes.
- Task Scheduling: Supports assigning periodic tasks and generating batch scheduling plans.
- Precise Measurement: Based on task scheduling, precisely measure each vehicle's travel distance, ascent, payload, route, loading points, unloading points, and other information.

