Robot Technology News
SPACE MEDICINE
Robot learns surgery skills by watching videos, matches human precision
illustration only
Robot learns surgery skills by watching videos, matches human precision
by Clarence Oxford
Los Angeles CA (SPX) Nov 18, 2024

A surgical robot trained by observing videos of experienced surgeons has successfully executed surgical tasks with a level of skill matching human doctors.

This breakthrough in robotic training employs imitation learning, significantly simplifying the process of programming surgical robots. By using visual input rather than coding each movement, this approach advances the potential for robots to perform complex surgeries autonomously.

"It's really magical to have this model and all we do is feed it camera input and it can predict the robotic movements needed for surgery," said senior author Axel Krieger. "We believe this marks a significant step forward toward a new frontier in medical robotics."

The research, highlighted at the Conference on Robot Learning in Munich, showcases collaboration between Johns Hopkins University and Stanford University. The team trained the da Vinci Surgical System, known for its widespread use but also its precision limitations, to perform tasks like needle manipulation, tissue lifting, and suturing. Unlike traditional training, which requires precise, step-by-step programming, this model uses machine learning similar to that behind ChatGPT. Instead of processing language, this model interprets kinematic data - breaking robotic motion into mathematical expressions.

Researchers trained their model using hundreds of wrist camera recordings from da Vinci robots during surgeries. These recordings, collected globally for postoperative analysis, provide a vast dataset for imitation learning. The da Vinci system, employed in nearly 7,000 units worldwide and familiar to over 50,000 surgeons, offered ample video data.

The innovation lies in training the model to recognize and execute relative motions, avoiding inaccuracies associated with absolute actions. "All we need is image input and then this AI system finds the right action," explained lead author Ji Woong "Brian" Kim. With just a few hundred demonstrations, the model can learn and adapt to new environments.

The robot demonstrated proficiency in performing the selected surgical tasks, mirroring human skill levels. Remarkably, it adapted to unexpected situations, such as picking up a dropped needle autonomously. "Here the model is so good learning things we haven't taught it," Krieger noted.

The researchers envision rapid training for various surgical procedures, contrasting with the lengthy hand-coding previously required. "It's very limiting," Krieger said. "What is new here is we only have to collect imitation learning of different procedures, and we can train a robot to learn it in a couple days. It allows us to accelerate to the goal of autonomy while reducing medical errors and achieving more accurate surgery."

The team is now working on expanding this method to train robots for complete surgeries. Contributors from Johns Hopkins included PhD student Samuel Schmidgall, Associate Research Engineer Anton Deguet, and Associate Professor Marin Kobilarov. The Stanford team included PhD student Tony Z. Zhao.

Related Links
Johns Hopkins University
Space Medicine Technology and Systems

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
SPACE MEDICINE
Health research on the ISS aims to uncover impacts of spaceflight on blood
Los Angeles CA (SPX) Nov 07, 2024
The International Space Station (ISS) showcases remarkable engineering that sustains human life in the extreme environment of space. However, it cannot fully counter the health risks posed by zero gravity and increased cosmic radiation, which may significantly impact astronauts' well-being. A collaborative team of ground-based scientists and NASA crew members is extending health research into space, with the goal of mitigating the risk of blood clots for astronauts and advancing treatment options ... read more

SPACE MEDICINE
NASA Armstrong builds sensor pod for autonomous flight

Silent Arrow secures Air Force contract for new 200-mile logistics drone

ANELLO Photonics secures Series B funding to advance inertial navigation technology

N. Korean leader orders 'mass production' of attack drones

SPACE MEDICINE
Enormous potential for rare Earth elements found in US coal ash

Scientists show how a laser beam can cast a shadow

MIT engineers make converting CO2 into useful products more practical

British Museum secures record 1bn donation of Chinese ceramics

SPACE MEDICINE
MIT physicists predict exotic form of matter with potential for quantum computing

US finalizes up to $6.6 bn funding for chip giant TSMC

China's top chipmaker reports surge in profits

Nvidia surpasses Apple as world's biggest company

SPACE MEDICINE
Framatome's PROtect fuel achieves key milestone at Gosgen Nuclear Plant in Switzerland

Framatome and Nuclearelectrica partner to produce Lutetium-177 in Romania

Vietnam looks to restart nuclear power projects

US touts Trump-proof nuclear expansion plans at COP29

SPACE MEDICINE
Thai military accused of beating Myanmar man to death

Syrians, Iraqis archive IS jail crimes in virtual museum

U.S. military judge rules government plea deals with 9/11 suspects are 'enforceable contracts'

Poland alleges 'foreign agents' plotted using int'l parcel couriers to target transatlantic air traffic

SPACE MEDICINE
Climate finance can be hard sell, says aide to banks and PMs

'Vague' net zero rules threaten climate targets, scientists warn

US says its climate financing reached $11 bn this year

Trump picks Doug Burgum as energy czar in new administration

SPACE MEDICINE
Spinning fusion fuel for efficiency

Tackling the energy revolution, one sector at a time

NASA opens Power Systems essay contest for K12 students

In search of high-performance materials for fusion reactors

SPACE MEDICINE
China's commercial space sector expands as firms outline ambitious plans

China prepares Tianzhou 8 for upcoming launch to Tiangong station

Model of Haoloong Space Cargo Shuttle to Be Unveiled at Airshow China

Shenzhou 18 brings back samples for space habitability and materials research

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.