Journal Article DKFZ-2026-01282

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Anticipating Human Hand Grasps for Enhanced Interaction: A Bayesian Approach to Negative Latency in Human–Machine Interfaces

 ;  ;  ;  ;  ;  ;

2026
IEEE New York, NY

IEEE access 14, 77381 - 77400 () [10.1109/ACCESS.2026.3693875]
 GO

Abstract: Human–machine interfaces increasingly rely on hand gesture recognition to enable intuitive interaction in immersive technologies and robotic systems. However, the inherent latency of gesture recognition pipelines, exacerbated by computational and network delays, remains a major obstacle to seamless real-time interaction. In this work, we introduce a lightweight, Bayesian model that leverages hand kinematics to predict target gestures before their completion, thereby recognizing hand gestures before they are completed (i.e. negative latency). Our approach is based on the continuous updating of posterior beliefs over a set of internal models, each with its gesture-specific dynamical system. These posteriors represent the probability that a gesture will be performed. We validate the model using a novel dataset of reach-tograsp tasks recorded with a sensor glove. Our results show that our model consistently predicts gestures several hundred milliseconds prior to completion. Furthermore, we show that reliable gesture prediction is achievable with reduced sensor dimensionality. These findings illustrate how anticipatory computing can substantially improve responsiveness and naturalness in a range of latency-sensitive applications, including immersive environments and robotic systems.

Classification:

Note: #NCTZFB26#

Contributing Institute(s):
  1. Koordinierungsstelle NCT Dresden (DD04)
  2. NCT DD Translationale Chirurgische Onkologie (DD06)
Research Program(s):
  1. 315 - Bildgebung und Radioonkologie (POF4-315) (POF4-315)

Appears in the scientific report 2026
Database coverage:
Medline ; DOAJ ; Article Processing Charges ; Clarivate Analytics Master Journal List ; Current Contents - Electronics and Telecommunications Collection ; Current Contents - Engineering, Computing and Technology ; DOAJ Seal ; Essential Science Indicators ; Fees ; IF < 5 ; JCR ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Public records
Publications database

 Record created 2026-05-29, last modified 2026-05-29



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)