Body‐Coupled‐Driven Object‐Oriented Natural Interactive Interface

Abstract

Abstract The metaverse progressively demands heightened sophistication in human‐multi‐machine collaboration, accelerating development of hybrid immersive 2D tactile and 3D spatial perception interfaces. However, current interfaces struggle with the precision and adaptability in complex human‐multi‐machine interaction scenarios. This paper presents a transparent stretchable sensing interface synergizing 2D tactile and 3D spatial perception through body‐coupled electromagnetic coupling. Its bi‐modal coupling (resistive coupling and capacitive coupling) mechanism enables micrometer‐scale 2D tactile sensing alongside broad 3D spatial perception (200 mm range). The contact mode achieves calligraphy‐grade trajectory reconstruction (200 µm precision) with force tactile sensing, while the non‐contact mode recognizes 38 gestures at 97.11% accuracy. The interface's mechanical transparency and elasticity permit seamless integration on curved surfaces (e.g., gloves and clothes) without perceptual interference. An object‐oriented human‐machine interaction (HMI) framework is developed to enable single‐interface control of multiple devices through electromagnetic signature recognition, enhancing collaborative efficiency. This work can inspire designs of smart interfaces in intelligent healthcare monitoring, industrial robotics coordination, and cross‐domain augmented reality applications.