Journal Article DKFZ-2026-02608

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
AIcXR+: Spiking Neural Network (SNN) Semantic Compression for 3-D Point Clouds

 ;  ;  ;  ;  ;  ;  ;

2026
IEEE New York, NY

IEEE access 14, 155269 - 155286 () [10.1109/ACCESS.2026.3740821]
 GO

Abstract: Existing Artificial Intelligence (AI) approaches for compressing three-dimensional (3-D) pointclouds for real-time immersion over communication networks are commonly based on energy-intensive AIarchitectures, e.g., transformer and autoencoder architectures. We design and evaluate the first 3-D pointcloud compression based on the energy-efficient Spiking Neural Network (SNN) architecture. We conductthis evaluation within our framework of AI-based semantic compression for networked eXtended Reality(AIcXR+). We first design a goal-oriented autoencoder, wherein an Artificial Neural Network (ANN)encodes a 3-D point cloud into a compact Vector Code (VC) at the sender, and a Convolutional NeuralNetwork (CNN) decodes the VC into volumetric pixels (voxels) for rendering at the receiver. We jointlytrain the ANN encoder and CNN decoder to map 3-D point cloud frames into VCs that compactly representthe volumetric semantics of the 3-D point clouds. Then, we convert this trained ANN/CNN into an SNN,bypassing the standard backpropagation training of SNNs. For robotic surgery datasets, we evaluate the SNNrelative to the ANN/CNN as well as a (non-AI-based) semantic color-coding approach (cXR+). We findthat both SNN- and ANN-AIcXR+ achieve approximately the same compression ratios as cXR+, whileachieving substantially shorter computing (encoding + decoding) latencies than cXR+; thus, AIcXR+substantially reduces the aggregate (computing + communication network transmission) latency comparedto the non-AI-based cXR+. Importantly, we find that the SNN reduces the energy consumption by nearlyan order of magnitude compared to the ANN while achieving essentially the same reconstruction quality.

Classification:

Note: #NCTZFB26#

Contributing Institute(s):
  1. Koordinierungsstelle NCT Dresden (DD04)
  2. NCT DD Translationale Chirurgische Onkologie (DD06)
Research Program(s):
  1. 315 - Bildgebung und Radioonkologie (POF4-315) (POF4-315)

Appears in the scientific report 2026
Database coverage:
Medline ; DOAJ ; Article Processing Charges ; Clarivate Analytics Master Journal List ; Current Contents - Electronics and Telecommunications Collection ; Current Contents - Engineering, Computing and Technology ; DOAJ Seal ; Essential Science Indicators ; Fees ; IF < 5 ; JCR ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Public records
Publications database

 Record created 2026-10-26, last modified 2026-10-27



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)