Peking Union Medical College Hospital and the Institute of Automation, Chinese Academy of Sciences, Release a Vision-Touch Integrated Intelligent Minimally Invasive Neuroendoscopic Robot ---- Institute of Automation, Chinese Academy of Sciences

### Abstract: Introduction of a Visuo-Tactile Fusion Intelligent Minimally Invasive Neuroendoscopic Robot On September 1, 2022, the China International Trade Fair for Services (CIFTIS), a national-level exhibition organized by the Ministry of Commerce and the Beijing Municipal Government, officially opened. President Xi Jinping emphasized that the CIFTIS serves as a crucial platform for China to expand openness, deepen cooperation, and lead innovation, significantly contributing to the global development of the service industry and service trade. A notable highlight of the exhibition was the unveiling of a visuo-tactile fusion intelligent minimally invasive neuroendoscopic robot system, a collaborative effort between the Department of Neurosurgery at Peking Union Medical College Hospital (PUMCH) and the research team led by Professor Hongbin Liu from the Institute of Automation, Chinese Academy of Sciences (CAS). This innovative system addresses a significant international challenge in robotic-assisted surgery: the lack of tactile feedback, which is particularly critical in neuroendoscopic procedures. #### Key Technological Breakthroughs The robot system integrates advanced algorithms and technologies to provide real-time, high-precision tactile feedback. According to Liu, the system overcomes the technological bottleneck of achieving real-time perception of contact force and contact position during intracranial surgery. Specifically, the system can detect contact forces with an error margin of less than 0.1N and contact positions with an error margin of less than 1mm. This is achieved through a custom-developed algorithm for surgical instrument contact point detection, which ensures that the robot can safely navigate within the brain, avoiding damage to critical tissues. Additionally, the system incorporates a multimodal fusion compliant force control technology based on endoscopic images and tactile perception. This technology enables the robot to autonomously and safely advance the endoscope, effectively preventing the compression of vital brain structures, thereby enhancing patient safety. #### Intelligent Surgical Navigation System The robot is equipped with an intelligent surgical navigation system co-developed by PUMCH's Department of Neurosurgery and Tencent AI Lab. This navigation system can track surgical instruments in real-time without the need for a head frame or reference frame, allowing surgeons to view the lesion from multiple angles and receive critical anatomical structure alerts. The integration of PUMCH's surgical techniques and experience with preoperative imaging data helps in accurately locating the lesion and guiding the surgical instrument, thus reducing the complexity and risk of the procedure. The navigation platform, when paired with a mechanical arm, can perform puncture procedures, further simplifying the surgery and improving its accuracy. The system's compact size, portability, low cost, efficiency, and ease of use make it an ideal tool for widespread adoption in primary healthcare institutions, potentially enhancing the surgical capabilities of neurosurgeons in these settings. #### Expert Insights Dr. Ming Feng, a professor at PUMCH's Department of Neurosurgery, highlighted the importance of tactile and navigational capabilities in neurosurgery. Given the complexity of neuroanatomy and the high risk associated with neurosurgical procedures, the robot can significantly improve the accuracy and safety of surgeries. It can help surgeons plan safe surgical pathways, avoid damaging normal tissues, and, in the future, enable remote surgeries through 5G technology, benefiting a broader patient base, especially in remote and underserved areas. #### Conclusion The visuo-tactile fusion intelligent minimally invasive neuroendoscopic robot system represents a significant advancement in robotic-assisted neurosurgery. By providing real-time tactile feedback and integrating an intelligent navigation system, it addresses key challenges in the field, making neurosurgical procedures safer, more accurate, and more accessible. The collaboration between PUMCH and CAS demonstrates the potential of interdisciplinary research in developing innovative medical technologies that can have a profound impact on patient care and the broader healthcare ecosystem.