Bilateral teleoperation robot intelligent control and information processing technology for visual-touch integration

The development history of mobile communications and networks in the past thirty years is a history of pursuit of extending human senses. The emergence of portable phones in the late 1980s broke the geographical barriers of the "landline" system, making it possible for people to demand voice communication anytime and anywhere. In the past decade, the vigorous development of mobile communication networks has enabled Internet access anytime and anywhere. A large number of Internet services targeting vision and hearing have emerged, such as streaming media services, Internet calls, video calls, etc., making long-distance audio-visual interaction possible. With the vigorous development of cyber-physical systems and the continuous advancement of European Industry 4.0, tactile communication has attracted widespread attention in recent years. By introducing "tactile perception" information and "tactile interaction", the existing network is realized by two-dimensional audio-visual services. The revolutionary expansion to three-dimensional audio-visual-tactile services enables operators thousands of miles away to have an immersive experience and remotely transform the physical world through the network.

Tactile signals reflect the human body's perception of shape, position, surface texture, hardness, roughness, temperature, etc., including kinesthetic signals based on muscle movement perception and texture sensory signals based on skin touch perception. Current research hotspots related to tactile communication include psychophysical modeling technology for tactile perception, tactile coding technology, audio-visual-tactile multi-modal human-computer interaction technology based on virtual environment, and teleoperation and tactile communication technology based on 5G network wait.