Robot Technology News
SPACE MEDICINE
Robot learns surgery skills by watching videos, matches human precision
illustration only
Robot learns surgery skills by watching videos, matches human precision
by Clarence Oxford
Los Angeles CA (SPX) Nov 12, 2024

A surgical robot trained by observing videos of experienced surgeons has successfully executed surgical tasks with a level of skill matching human doctors.

This breakthrough in robotic training employs imitation learning, significantly simplifying the process of programming surgical robots. By using visual input rather than coding each movement, this approach advances the potential for robots to perform complex surgeries autonomously.

"It's really magical to have this model and all we do is feed it camera input and it can predict the robotic movements needed for surgery," said senior author Axel Krieger. "We believe this marks a significant step forward toward a new frontier in medical robotics."

The research, highlighted at the Conference on Robot Learning in Munich, showcases collaboration between Johns Hopkins University and Stanford University. The team trained the da Vinci Surgical System, known for its widespread use but also its precision limitations, to perform tasks like needle manipulation, tissue lifting, and suturing. Unlike traditional training, which requires precise, step-by-step programming, this model uses machine learning similar to that behind ChatGPT. Instead of processing language, this model interprets kinematic data - breaking robotic motion into mathematical expressions.

Researchers trained their model using hundreds of wrist camera recordings from da Vinci robots during surgeries. These recordings, collected globally for postoperative analysis, provide a vast dataset for imitation learning. The da Vinci system, employed in nearly 7,000 units worldwide and familiar to over 50,000 surgeons, offered ample video data.

The innovation lies in training the model to recognize and execute relative motions, avoiding inaccuracies associated with absolute actions. "All we need is image input and then this AI system finds the right action," explained lead author Ji Woong "Brian" Kim. With just a few hundred demonstrations, the model can learn and adapt to new environments.

The robot demonstrated proficiency in performing the selected surgical tasks, mirroring human skill levels. Remarkably, it adapted to unexpected situations, such as picking up a dropped needle autonomously. "Here the model is so good learning things we haven't taught it," Krieger noted.

The researchers envision rapid training for various surgical procedures, contrasting with the lengthy hand-coding previously required. "It's very limiting," Krieger said. "What is new here is we only have to collect imitation learning of different procedures, and we can train a robot to learn it in a couple days. It allows us to accelerate to the goal of autonomy while reducing medical errors and achieving more accurate surgery."

The team is now working on expanding this method to train robots for complete surgeries. Contributors from Johns Hopkins included PhD student Samuel Schmidgall, Associate Research Engineer Anton Deguet, and Associate Professor Marin Kobilarov. The Stanford team included PhD student Tony Z. Zhao.

Related Links
Johns Hopkins University
Space Medicine Technology and Systems

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
SPACE MEDICINE
Oxford space lab sends first human tissue samples to ISS for ageing study
London, UK (SPX) Nov 05, 2024
The first human tissue samples from Oxford's Space Innovation Lab (SIL) are now en route to the International Space Station (ISS) to support a study examining how space microgravity influences human ageing. Researchers from SIL traveled to the Kennedy Space Centre in Florida, USA, where they integrated the samples into a payload ahead of the Tuesday morning launch (UK time). Housed within a Science Cube, the samples will be installed in the ICE Cubes Facility upon arrival at the ISS. This platform ... read more

SPACE MEDICINE
Indian capital plans drone flights to combat smog crisis

U.S. Navy conducted live control flight demonstration of carrier-based UAVs

Taiwan students design drones for mock battle, as China threat looms

MARSS showcases advanced AI-driven CUAS system at Red Sands 2024

SPACE MEDICINE
NASA to transform in-space manufacturing with laser beam welding collaboration

Startup turns mining waste into critical metals for the U.S.

A smart screen for cooling and sun protection

Toxic towns in Kyrgyzstan battling radioactive danger

SPACE MEDICINE
China's top chipmaker reports surge in profits

Nvidia surpasses Apple as world's biggest company

Nvidia asks S Korea SK hynix to pull forward chip deliveries

NRL Develops Innovative Method for Quantum Emitter Control

SPACE MEDICINE
Framatome and Nuclearelectrica partner to produce Lutetium-177 in Romania

Nuclear energy gains importance in Europe's green energy plans

Climate cash should also go to nuclear, says UN atomic chief

Framatome opens new Italian offices to bolster European nuclear energy growth

SPACE MEDICINE
U.S. military judge rules government plea deals with 9/11 suspects are 'enforceable contracts'

Poland alleges 'foreign agents' plotted using int'l parcel couriers to target transatlantic air traffic

American strikes killed up to 35 jihadists in Syria: US military

Ex-US Marine sentenced to seven years for white supremacist plot

SPACE MEDICINE
Climate 'financing gap' is widening: ECB chief

Preparing Taiwan for a decarbonized economy

World leaders meet for climate talks, but big names missing

China passes energy law to 'promote carbon neutrality'

SPACE MEDICINE
NASA opens Power Systems essay contest for K12 students

Tackling the energy revolution, one sector at a time

In search of high-performance materials for fusion reactors

Texas A&M to train machine learning tools to design materials for fusion power plants

SPACE MEDICINE
Shenzhou 18 brings back samples for space habitability and materials research

Shenzhou 18 crew back in China after 6-month mission to Tiangong station

Chinese space station crew returns after six months in orbit

Shenzhou XIX Crew Joins Tiangong Space Station for Crew Rotation

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.