New Technology / Robotics
Human Skill Augmentation in Robot-Assisted Surgery
Track robotics trends, industrial automation, machine intelligence and commercial deployment signals through curated technology summaries.
Source material: HAI Seminar: Human Skill Augmentation in Robot-Assisted Surgery
Key insights
- There are around 230 million procedures conducted worldwide
- The world is short of at least 140 million surgical procedures
- Medical errors are the third leading cause of death in the United States
- Around a quarter of a million Americans die each year due to medical errors
- % of medical errors occur inside the operating room
- % of surgical complications from medical errors are avoidable
Perspectives
Structured analysis of arguments presented in the seminar.
Proponents of Robot-Assisted Surgery
- Highlights the shortage of surgical procedures leading to medical errors
- Claims that robot-assisted surgery can reduce avoidable surgical complications
- Proposes designing systems to augment human skills in surgery
- Argues that robots possess unique capabilities that enhance surgical precision
- Emphasizes the importance of automating repetitive tasks to assist surgeons
- Warns that traditional surgery methods have significant disadvantages
Skeptics of Full Autonomy in Surgery
- Questions the readiness for fully autonomous surgical systems
- Argues that gaining surgeon trust is crucial for technology adoption
- Highlights the need for evidence of improved patient outcomes
- Questions the effectiveness of low force applications in all surgical contexts
- Raises concerns about the cognitive limitations of human surgeons compared to robots
- Questions the reliance on technology without understanding its limitations
Neutral / Shared
- Acknowledges the importance of understanding surgical errors to target automation
- Recognizes the potential for collaboration between robotics and other fields
- Notes the ongoing research into the effectiveness of robotic systems in surgery
Metrics
procedures_conducted
230 million procedures
total surgical procedures conducted worldwide
Understanding the scale of surgical procedures helps identify the gap in healthcare services.
So worldwide, there are around 230 million procedures that are being conducted.
procedures_shortage
140 million procedures
shortage of surgical procedures needed worldwide
This highlights the urgent need for improved surgical capacity and intervention.
the world is yet short of at least 140 million procedures.
annual_deaths_medical_errors
250,000 deaths
annual deaths in the United States due to medical errors
This statistic underscores the critical impact of medical errors on public health.
killing around a quarter and million American every year.
avoidable_complications
50%
percentage of surgical complications from medical errors that are avoidable
This indicates a significant opportunity for improving surgical outcomes through better systems.
50% of the surgical complications resulting from these errors are simply avoidable.
da_vinci_procedures
2.5 million procedures
number of procedures performed using the DaVinci surgical system in 2024
This reflects the growing adoption of robotic systems in surgery, indicating a shift in surgical practices.
in 2024, this particular system have been used in 2.5 million procedures and counting.
robotic_manipulators
four units
typical surgical system like the Da Vinci
Indicates the complexity and capability of current robotic surgical systems.
a typical surgical system like the Da Vinci here would have four robotic manipulators.
force_torque_sensor
six degree freedom force torque sensor
measures forces and torques during interaction
This sensor is crucial for ensuring the robotic arm applies the correct force during surgery.
we blazed underneath the setup a six degree freedom force torque sensor that gives us forces and torques
success_rate
3 times more successful times
success rate of the force policy compared to the no force policy on 50 rollouts
Higher success rates indicate improved surgical outcomes and efficiency.
the force policy is three times more successful than the no force policy on those 50 roll outs.
Key entities
Timeline highlights
00:00–05:00
The shortage of surgical procedures leads to significant medical errors, which are a major cause of death, prompting the need for augmented systems in robot-assisted surgery.
- There are around 230 million procedures conducted worldwide
- The world is short of at least 140 million surgical procedures
- Medical errors are the third leading cause of death in the United States
- Around a quarter of a million Americans die each year due to medical errors
- % of medical errors occur inside the operating room
- % of surgical complications from medical errors are avoidable
05:00–10:00
Robots possess unique capabilities that allow them to perform multiple tasks simultaneously, enhancing surgical precision and situational awareness for surgeons.
- Robots have unique capabilities that are fundamentally different than humans
- Most systems in the market have only one robotic manipulator holding one camera for the surgeon
- Robots can have more than one pair of eyes, providing better situational awareness
- Robots can focus on multiple locations simultaneously without cognitive overload
- Typical surgical systems like the da Vinci have four robotic manipulators
- Robotic manipulators are singularly controlled by the human surgeon through a switching control system
10:00–15:00
The automation of an extra robotic arm enhances surgical precision by allowing autonomous assistance, reducing the risk of human error during operations.
- The surgeon can accidentally move robots outside the field of view
- The goal is to automate an extra robotic arm to assist the surgeon
- The third or fourth arm can be autonomous, helping the surgeon
- Test cases for the robotic arm fall into two categories: physical interaction and non-physical interaction
- The design of the robotic arm must be force aware to handle different tissue stiffness levels
- Applying too little force may prevent proper grasping, while too much force can tear tissue
15:00–20:00
The force policy demonstrates superior performance by applying significantly less force and achieving higher success rates in surgical tasks, leading to safer and more effective procedures.
- Collected 60 demonstrations over one hour using the da Vinci surgical system
- Trained two policies: a force policy and a no force policy
- The force policy is three times more successful than the no force policy on 50 rollouts
- The force policy applied 62% less force compared to the no force policy
- The force policy applied smaller values of forces, typically less than one Newton, more often
- The force policy was more gentle over time in its interaction with the tissue
20:00–25:00
The updated teleoperation system enables two humans to control three robotic arms simultaneously, enhancing surgical precision and collaboration.
- The extrobotic arm can work with teleoperated arm surgeons surgeons for tri-lateral manipulation
- A data collection system was updated to allow two humans to control three robotic arms simultaneously
- One human controls two arms with two hands, while a second human uses the Phantom Omni device device to control the third arm
- The architecture uses the action-tracking transformer model with kinematic and vision data as inputs
- The system can predict the motion of one robotic arm autonomously while the others are teleoperated
- The project started with a two-handed task of object handover and progressed to a trial-literal task with three arms
25:00–30:00
Robots can operate in parallel at multiple locations without cognitive limitations, enhancing efficiency in delicate tasks like suturing.
- Lift arm is teleoperated, right arm is autonomous
- Successful handover of objects
- Middle arm is teleoperated, two side arms are autonomous
- Goal is to pick Z3 objects and place them into a common location
- ACT architecture could be used for three handed tests
- Three handed tests can be collaborative