Back to Blog

Nvidia Jetson/Orin +FPGA+AI High-Performance Edge Computing Box: Real-time VR Content Creation with 3D Scanners

#人工智能#边缘计算#3d

While VR technology has revolutionized various aspects of daily life, such as entertainment, healthcare, architecture, education, and product design, creating VR content remains a challenging hurdle.

At the Jetson TX2 launch event held by Nvidia in San Francisco, it was demonstrated how the Jetson TX2 can accelerate AI computing, graphics, and computer vision operations, and power workflows for VR content creation.

The Artec Leo, a handheld scanner developed by Artec 3D using the Jetson TX1, can perform real-time 3D capture, fusion, modeling, and visualization on its own display, and can also stream to mobile phones and tablets.

The Artec Leo is powered by the ultra-fast, credit card-sized Jetson TX1 platform, scanning 8 million points per second, integrating color and texture data into 3D depth information, to create 3D models with 0.1 mm accuracy in real-time.

Artyom Yukhin, President and CEO of Artec, said: "The Artec Leo makes 3D scanning as simple as shooting video. The Jetson TX1 is small yet powerful and easy to integrate. Using it, we can quickly create lifelike models, significantly simplifying the workflow for CG artists, designers, engineers, and other VR professionals."

    1. Product Overview

The XM-AIBOX-32 Smart Edge Analysis All-in-One Machine is a high-performance, low-power edge computing product. Equipped with the BM1684X main chip, it delivers up to 32 TOPS of INT8 computing power, up to 16 TFLOPS of FP16/BF16 computing power, and up to 2 TFLOPS of FP32 computing power. It can process 32 channels of high-definition video simultaneously, supporting hardware decoding for 32 channels of 1080P HD video and encoding for 12 channels.

This product highly integrates high-precision AI intelligent algorithms based on computer vision and deep learning networks, as well as a comprehensive video intelligent management platform. The AI intelligent algorithms cover various scenarios such as parks, communities, construction sites, and campuses, and can be combined and configured on demand for specific scenarios. The comprehensive video intelligent management platform supports front-end device management, real-time video preview, alarm push, forensic capture, online algorithm loading and optimization, and large-screen data trend analysis display. The device is easy to operate and plug-and-play, and features rich northbound API interfaces to empower upper-layer business application platforms.

    1. Product Features

Ultra-High Performance Computing and Codec Capabilities

  • Supports up to 32 TOPS of INT8 peak computing power;
  • Supports up to 16 TFLOPS of FP16/BF16 half-precision computing power;
  • Supports 2 TFLOPS of FP32 high-precision computing power;
  • Supports hardware decoding for up to 32 channels of H.264/H.265 1080P@25FPS video;
  • Supports hardware encoding for up to 12 channels of H.264/H.265 1080P@25FPS video.

Rich Built-in AI Algorithms

  • Built-in with over 30 AI algorithms, supporting free combination and custom configurations;

(Supports Human Structuring / Face Recognition / Vehicle Structuring / License Plate Recognition / Flame Detection / Smoke Detection / Smoking Detection / Phone Call Detection / Mobile Phone Usage Detection / Mask Non-compliance Detection / Personnel Absenteeism Detection / Personnel Sleeping on Duty Detection / Fall Detection / Personnel Static Elimination Detection / Area Occupancy Counting / Under-occupancy Detection / Over-occupancy Detection / Abnormal Area Occupancy Detection / Area Intrusion Detection / Work Uniform Detection / Safety Helmet Detection / Reflective Vest Detection / Electric Bicycle Detection / Standardized Parking (Illegal Parking) / Entrance/Exit Flow Statistics / Perimeter Crossing Intrusion / Personnel Boundary Crossing Detection / Loitering Detection / Fire Lane Occupancy / Fire Escape Route Occupancy / Waste Not in Bin Detection / Overflowing Bin Detection / Waste Disposal Reminder / Camera Abnormal Movement Detection, and other algorithms)

  • Each video channel supports up to 3 AI analysis tasks simultaneously;
  • Supports up to 32 video AI analysis tasks running concurrently; when exceeding 32 tasks, analysis can be performed via polling.

Rich Interfaces, Flexible Deployment

  • Supports rich interfaces: 1000M Ethernet port, USB3.0/USB2.0, HDMI, RS-485, RS-232;
  • Supports wide operating temperature environment from -20℃ to +60℃;
  • Supports IP30 protection rating, supports fanless cooling (subject to specific model);
  • Adapts to support SATA storage, supports 2TB storage capacity (subject to specific model);
  • Optional support for LTE wireless backhaul function (subject to specific model);
  • Northbound interfaces: Supports HTTP protocol, MQTT protocol, GB28281
  • Southbound interfaces: Supports GB28281, Onvif, RTSP

High Reliability, Encryption Protection

  • Supports high-capacity eMMC with developable support for primary/secondary partitions;
  • Supports abnormal fault alarm and protection handling mechanisms;
  • Supports programmable encryption chip for privacy information protection.

User-Friendly Toolchain, Flexible Development

  • One-stop deep learning development toolkit Sophon SDK;
  • Supports mainstream deep learning frameworks such as Caffe/DarkNet/TensorFlow/PyTorch/MXNet/ONNX/PaddlePaddle;
  • Supports mainstream classification and detection network models, supports custom operator development;
  • Supports Docker containerization for rapid deployment of algorithm applications.
    1. Technical Specifications

Specifications

XM-AIBOX-32

Technical Specifications

Chip

SOC

BM1684X

CPU

8-core A53@2.3GHz

AI Computing Power

INT8

32 TOPS

BF16/FP16

16 TFLOPS

FP32

2 TFLOPS

Video/Image Codec

Video Decoding Capability

H.264/H.265: 1080P @800fps

Video Decoding Resolution

8K / 4K / 1080P / 720P / D1 / CIF

Video Encoding Capability

H.264/H.265:1080P @300fps

Video Encoding Resolution

4K / 1080P / 720P / D1 / CIF

Image Encoding/Decoding Capability

600 frames/sec (JPEG)

Max Image Decoding Resolution

32768 * 32768

Memory and Storage

Memory

16 GB

eMMC

64 GB

External Interfaces

Network Port

10/100/1000Mbps adaptive *2

USB

USB3.0 *2, USB2.0 *2

Storage

MicroSD *1

Display

HDMI *1

Serial Port

RS232 *1/RS485 *1

Extended Storage

SSD (Optional)

M.2 SSD

Wireless Features

4G/5G Wireless Module (Optional)

Mini-PCIE 4G Module/M.2 5G Module

Antenna

SMA Female *1(LTE)

SMA Female *4(5G), requires baseboard replacement

SMA Female *2 (Wi-Fi)

SMA Female *1(BT)

SIM

Standard SIM Card Slot

Wi-Fi/BT

Wi-Fi supports 802.11a/b/g/n/ac

BT5