2U rack-mounted computing power server

ARM architecture

12 compute blades (96 distributed compute nodes) + 1 control node

Hexa-core 64-bit processor Qualcomm QCS8550, up to 3.36GHz

Octa-core 64-bit processor RK3588, main frequency up to 2.4GHz, the highest computing power is 6TOPS

4608TOPS (48T × 96, INT8)

14 high-speed cooling fans

8K@60fps/4K@240fps H.264/VP9/AV1

16GB LPDDR5X × 96

256GB UFS4.0 × 96

3.5-inch/2.5-inch SATA3.0 SSD hard drive slot × 3 (Supports hot swapping; BMC can directly operate the hard drive, and computing child nodes can indirectly access the hard drive through the network sharing method provided by BMC)

2 × 1300W hot-swappable power supplies, 1+1 redundancy support

Standard 2U rack servers: 495.60mm × 928.51mm × 88.80mm

Operating Temperature: 0ºC ~ 30ºC, Storage Temperature: -40ºC ~ 60ºC, Operating Humidity: 5% ~ 80%RH (non-condensing)

IEC 297 Universal Cabinet Installation: 19 inches wide and 800 mm deep and above
Retractable slideway installation: The distance between the front and rear holes of the cabinet is 543.5mm~848.5mm

The BMC management system is integrated with the web-based management interface, supporting Redfish, VNC, NTP, monitoring advanced and virtual media, and the BMC management system can be redeveloped

All models support private deployment of ultra-large-scale parameter models under the Transformer architecture, such as large language models including Deepseek-R1 Series, Gemma Series, Llama Series, ChatGLM Series, Qwen Series, Phi Series, etc.

K3: Supports private deployment of all vision large models
QCS8550: Supports private deployment of vision large models including Qwen2.5-VL, InternVL3, etc.

All models: Support traditional network architectures such as CNN, RNN, LSTM, and support various deep learning frameworks such as TensorFlow, PyTorch, PaddlePaddle, ONNX, and Caffe. Support custom operator development and Docker containerization management technology

8 × 10Gbps SFP+, 1 × Gigabit Ethernet (RJ45, MGMT is used as BMC management network)

1 × Console (RJ45, BMC debug serial port, baud rate 115200)

1 × VGA (maximum resolution 1080P, BMC management display)

3 × USB3.0, 1 × Type-C (OTG)

1 × Power, 1 × UID, 1 × Recovery, 1 × Reset