AI in Surgery - Revision history

Wordpad: BloomWiki: AI in Surgery

2026-04-25T01:46:23Z

BloomWiki: AI in Surgery

← Older revision		Revision as of 01:46, 25 April 2026
Line 1:		Line 1:
			<div style="background-color: #4B0082; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
	{{BloomIntro}}		{{BloomIntro}}
	AI for surgery applies computer vision, robotics, and machine learning to assist surgeons before, during, and after operations. Surgical AI encompasses robotic-assisted surgery systems that improve precision and reduce tremor, computer vision systems that provide real-time intraoperative guidance, predictive models that estimate surgical risk and plan procedures, and AI that detects complications early. The da Vinci surgical robot — used in over 1.5 million procedures annually — is a foundational example. The next generation of surgical AI moves beyond tool control toward true intelligent assistance: recognizing surgical phases, warning of dangerous tissue proximity, and predicting optimal technique.		AI for surgery applies computer vision, robotics, and machine learning to assist surgeons before, during, and after operations. Surgical AI encompasses robotic-assisted surgery systems that improve precision and reduce tremor, computer vision systems that provide real-time intraoperative guidance, predictive models that estimate surgical risk and plan procedures, and AI that detects complications early. The da Vinci surgical robot — used in over 1.5 million procedures annually — is a foundational example. The next generation of surgical AI moves beyond tool control toward true intelligent assistance: recognizing surgical phases, warning of dangerous tissue proximity, and predicting optimal technique.
			</div>

	== Remembering ==		__TOC__

			<div style="background-color: #000080; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Remembering</span> ==
	* '''Robotic-assisted surgery''' — Surgery performed using robotic systems that translate surgeon hand movements into precise instrument movements (da Vinci, Verb Surgical).		* '''Robotic-assisted surgery''' — Surgery performed using robotic systems that translate surgeon hand movements into precise instrument movements (da Vinci, Verb Surgical).
	* '''da Vinci Surgical System''' — Intuitive Surgical's flagship platform; used for urology, gynecology, colorectal, and general surgery.		* '''da Vinci Surgical System''' — Intuitive Surgical's flagship platform; used for urology, gynecology, colorectal, and general surgery.
Line 17:		Line 22:
	* '''Predictive surgical outcomes''' — ML models predicting complication risk, blood loss, operative time from patient and procedure characteristics.		* '''Predictive surgical outcomes''' — ML models predicting complication risk, blood loss, operative time from patient and procedure characteristics.
	* '''CHOLEC80 dataset''' — 80 laparoscopic cholecystectomy videos with phase and instrument annotations; standard surgical AI benchmark.		* '''CHOLEC80 dataset''' — 80 laparoscopic cholecystectomy videos with phase and instrument annotations; standard surgical AI benchmark.
			</div>

	== Understanding ==		<div style="background-color: #006400; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Understanding</span> ==
	Surgical AI operates in three time domains: '''preoperative''' (planning and risk prediction), '''intraoperative''' (real-time guidance and safety), and '''postoperative''' (complication detection and outcomes).		Surgical AI operates in three time domains: '''preoperative''' (planning and risk prediction), '''intraoperative''' (real-time guidance and safety), and '''postoperative''' (complication detection and outcomes).

Line 28:		Line 35:

	'''The Human-Robot Continuum''': Current surgical robots are master-slave systems — the surgeon controls every movement. Semi-autonomous systems (STAR robot for bowel anastomosis; Smart Tissue Autonomous Robot) demonstrate specific autonomous surgical subtasks. Full surgical autonomy is a long-term research goal, not a near-term reality.		'''The Human-Robot Continuum''': Current surgical robots are master-slave systems — the surgeon controls every movement. Semi-autonomous systems (STAR robot for bowel anastomosis; Smart Tissue Autonomous Robot) demonstrate specific autonomous surgical subtasks. Full surgical autonomy is a long-term research goal, not a near-term reality.
			</div>

	== Applying ==		<div style="background-color: #8B0000; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Applying</span> ==
	'''Surgical phase recognition from laparoscopic video:'''		'''Surgical phase recognition from laparoscopic video:'''
	<syntaxhighlight lang="python">		<syntaxhighlight lang="python">
Line 94:		Line 103:
	: '''Surgical AI platform''' → Caresyntax, Touch Surgery (Medtronic), Theator		: '''Surgical AI platform''' → Caresyntax, Touch Surgery (Medtronic), Theator
	: '''Outcome prediction''' → ACS NSQIP Surgical Risk Calculator (web), Surgical AI Labs		: '''Outcome prediction''' → ACS NSQIP Surgical Risk Calculator (web), Surgical AI Labs
			</div>

	== Analyzing ==		<div style="background-color: #8B4500; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Analyzing</span> ==
	{\| class="wikitable"		{\| class="wikitable"
	\|+ Surgical AI Application Status		\|+ Surgical AI Application Status
Line 114:		Line 125:

	'''Failure modes''': Blood and smoke obscuring the operative field causes computer vision failures. Domain shift across different hospital setups, camera systems, and surgeon styles. Real-time latency requirements for intraoperative AI (must be <1 second). Liability ambiguity when AI-assisted surgery leads to complications. Over-reliance on AI recommendations causing surgeons to ignore their own clinical judgment.		'''Failure modes''': Blood and smoke obscuring the operative field causes computer vision failures. Domain shift across different hospital setups, camera systems, and surgeon styles. Real-time latency requirements for intraoperative AI (must be <1 second). Liability ambiguity when AI-assisted surgery leads to complications. Over-reliance on AI recommendations causing surgeons to ignore their own clinical judgment.
			</div>

	== Evaluating ==		<div style="background-color: #483D8B; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Evaluating</span> ==
	Surgical AI evaluation:		Surgical AI evaluation:
	# '''Phase recognition''': frame-level and segmental accuracy (jaccard index); evaluate separately for each surgical phase.		# '''Phase recognition''': frame-level and segmental accuracy (jaccard index); evaluate separately for each surgical phase.
Line 122:		Line 135:
	# '''Prospective clinical validation''': test AI on prospective cases in the OR; measure surgeon trust, time-to-alert, and complication rates vs. historical control.		# '''Prospective clinical validation''': test AI on prospective cases in the OR; measure surgeon trust, time-to-alert, and complication rates vs. historical control.
	# '''Multi-center generalization''': validate across hospitals, camera systems, and surgeon demographics.		# '''Multi-center generalization''': validate across hospitals, camera systems, and surgeon demographics.
			</div>

	== Creating ==		<div style="background-color: #2F4F4F; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Creating</span> ==
	Deploying surgical AI in an OR:		Deploying surgical AI in an OR:
	# Video infrastructure: HD laparoscopic tower with video capture card; HIPAA-compliant secure video storage.		# Video infrastructure: HD laparoscopic tower with video capture card; HIPAA-compliant secure video storage.
Line 135:		Line 150:
	[[Category:Surgery]]		[[Category:Surgery]]
	[[Category:Medical Robotics]]		[[Category:Medical Robotics]]
			</div>

Wordpad: BloomWiki: AI in Surgery

2026-04-23T14:36:25Z

BloomWiki: AI in Surgery

← Older revision		Revision as of 14:36, 23 April 2026
Line 116:		Line 116:

	== Evaluating ==		== Evaluating ==
	Surgical AI evaluation: ~~(1)~~ '''Phase recognition''': frame-level and segmental accuracy (jaccard index); evaluate separately for each surgical phase. ~~(2)~~ '''Real-time latency''': measure end-to-end inference time; must be <1 second for clinical utility. ~~(3)~~ '''Instrument detection''': mAP at IoU=0.5; per-instrument class performance. ~~(4)~~ '''Prospective clinical validation''': test AI on prospective cases in the OR; measure surgeon trust, time-to-alert, and complication rates vs. historical control. ~~(5)~~ '''Multi-center generalization''': validate across hospitals, camera systems, and surgeon demographics.		Surgical AI evaluation:
			# '''Phase recognition''': frame-level and segmental accuracy (jaccard index); evaluate separately for each surgical phase.
			# '''Real-time latency''': measure end-to-end inference time; must be <1 second for clinical utility.
			# '''Instrument detection''': mAP at IoU=0.5; per-instrument class performance.
			# '''Prospective clinical validation''': test AI on prospective cases in the OR; measure surgeon trust, time-to-alert, and complication rates vs. historical control.
			# '''Multi-center generalization''': validate across hospitals, camera systems, and surgeon demographics.

	== Creating ==		== Creating ==
	Deploying surgical AI in an OR: ~~(1)~~ Video infrastructure: HD laparoscopic tower with video capture card; HIPAA-compliant secure video storage. ~~(2)~~ Real-time processing: GPU workstation in OR or edge device; streaming inference pipeline. ~~(3)~~ Display integration: overlay AI outputs on surgical monitor or head-mounted display. ~~(4)~~ Surgeon interface: non-distracting alerts (color cues, audio for critical warnings). ~~(5)~~ Feedback loop: surgeons review and annotate AI decisions post-procedure; use for continuous model improvement. ~~(6)~~ Regulatory: work with FDA for SaMD (Software as Medical Device) pathway; collect prospective clinical evidence.		Deploying surgical AI in an OR:
			# Video infrastructure: HD laparoscopic tower with video capture card; HIPAA-compliant secure video storage.
			# Real-time processing: GPU workstation in OR or edge device; streaming inference pipeline.
			# Display integration: overlay AI outputs on surgical monitor or head-mounted display.
			# Surgeon interface: non-distracting alerts (color cues, audio for critical warnings).
			# Feedback loop: surgeons review and annotate AI decisions post-procedure; use for continuous model improvement.
			# Regulatory: work with FDA for SaMD (Software as Medical Device) pathway; collect prospective clinical evidence.

	[[Category:Artificial Intelligence]]		[[Category:Artificial Intelligence]]
	[[Category:Surgery]]		[[Category:Surgery]]
	[[Category:Medical Robotics]]		[[Category:Medical Robotics]]

Wordpad: BloomWiki: AI in Surgery

2026-04-23T14:21:08Z

BloomWiki: AI in Surgery

New page

{{BloomIntro}}
AI for surgery applies computer vision, robotics, and machine learning to assist surgeons before, during, and after operations. Surgical AI encompasses robotic-assisted surgery systems that improve precision and reduce tremor, computer vision systems that provide real-time intraoperative guidance, predictive models that estimate surgical risk and plan procedures, and AI that detects complications early. The da Vinci surgical robot — used in over 1.5 million procedures annually — is a foundational example. The next generation of surgical AI moves beyond tool control toward true intelligent assistance: recognizing surgical phases, warning of dangerous tissue proximity, and predicting optimal technique.

== Remembering ==
* '''Robotic-assisted surgery''' — Surgery performed using robotic systems that translate surgeon hand movements into precise instrument movements (da Vinci, Verb Surgical).
* '''da Vinci Surgical System''' — Intuitive Surgical's flagship platform; used for urology, gynecology, colorectal, and general surgery.
* '''Laparoscopic surgery''' — Minimally invasive surgery through small incisions; creates video feed that can be analyzed by AI.
* '''Surgical phase recognition''' — AI classifying the current phase of surgery (e.g., dissection, hemostasis, closure) from video.
* '''Instrument tracking''' — Detecting and tracking surgical instruments in laparoscopic video.
* '''Surgical skill assessment''' — AI analyzing video to assess surgeon skill level; used for training and credentialing.
* '''Intraoperative navigation''' — Real-time guidance systems showing surgeons instrument position relative to anatomy.
* '''Image-guided surgery''' — Overlaying preoperative imaging (CT, MRI) onto the surgical field in real time.
* '''Augmented reality (surgical)''' — Overlaying digital information (vessels, tumor margins) onto the surgeon's view.
* '''Surgical safety checklist AI''' — AI monitoring adherence to WHO surgical safety checklists.
* '''Autonomous anastomosis''' — Automated suturing of bowel segments; demonstrated in preclinical robotic studies.
* '''Computer vision (OR)''' — Using cameras to monitor operating room workflow, equipment, and safety compliance.
* '''Predictive surgical outcomes''' — ML models predicting complication risk, blood loss, operative time from patient and procedure characteristics.
* '''CHOLEC80 dataset''' — 80 laparoscopic cholecystectomy videos with phase and instrument annotations; standard surgical AI benchmark.

== Understanding ==
Surgical AI operates in three time domains: '''preoperative''' (planning and risk prediction), '''intraoperative''' (real-time guidance and safety), and '''postoperative''' (complication detection and outcomes).

'''Preoperative AI''': Risk models trained on surgical outcome data (NSQIP database: 6M+ surgical cases) predict complication probability — pneumonia, wound infection, VTE, 30-day mortality — from patient demographics, comorbidities, and procedure type. Surgeons and patients can use these to make informed decisions about surgical risk vs. benefit. AI also helps plan complex surgeries: automatic segmentation of CT/MRI defines anatomy, and virtual surgery simulations plan the safest operative approach.

'''Intraoperative phase recognition''': Laparoscopic cameras create a continuous video stream of the surgical field. CNNs and transformers trained on annotated surgical videos can classify surgical phases (preparation, dissection, clipping, cutting) and detect specific events (bleeding, instrument exchange). This enables: automatic operating room documentation, trainee guidance, context-sensitive decision support, and safety alerts (e.g., alerting when approaching a critical structure).

'''Critical View of Safety (CVS) AI''': In laparoscopic cholecystectomy, bile duct injury is a catastrophic complication. CVS is the standard safety criterion ensuring correct identification of the cystic duct. AI systems (Shoichi Kimura's group at Osaka; multiple startups) assess CVS from laparoscopic video, alerting surgeons when CVS has not been achieved before clipping. This targets one of the highest-impact surgical safety problems.

'''The Human-Robot Continuum''': Current surgical robots are master-slave systems — the surgeon controls every movement. Semi-autonomous systems (STAR robot for bowel anastomosis; Smart Tissue Autonomous Robot) demonstrate specific autonomous surgical subtasks. Full surgical autonomy is a long-term research goal, not a near-term reality.

== Applying ==
'''Surgical phase recognition from laparoscopic video:'''
<syntaxhighlight lang="python">
import torch
import torch.nn as nn
from torchvision import models, transforms
from torch.utils.data import Dataset
import cv2
import numpy as np

# CHOLEC80 surgical phase labels
PHASES = ['Preparation', 'CalotTriangleDissection', 'ClippingCutting',
'GallbladderDissection', 'GallbladderPackaging', 'CleaningCoagulation',
'GallbladderRetraction']

class SurgicalPhaseModel(nn.Module):
"""CNN+LSTM for temporal surgical phase recognition."""
def __init__(self, n_phases=7, hidden=512):
super().__init__()
# ResNet50 feature extractor
resnet = models.resnet50(weights='IMAGENET1K_V1')
self.cnn = nn.Sequential(*list(resnet.children())[:-1]) # Remove FC
self.cnn_dim = 2048
# LSTM for temporal modeling across frames
self.lstm = nn.LSTM(self.cnn_dim, hidden, 2, batch_first=True, dropout=0.3)
self.classifier = nn.Linear(hidden, n_phases)

def forward(self, frames):
# frames: (B, T, C, H, W)
B, T, C, H, W = frames.shape
# Extract CNN features per frame
frame_feats = self.cnn(frames.view(B*T, C, H, W)).squeeze(-1).squeeze(-1)
frame_feats = frame_feats.view(B, T, -1) # (B, T, 2048)
# Temporal modeling
lstm_out, _ = self.lstm(frame_feats)
logits = self.classifier(lstm_out) # Per-frame predictions: (B, T, n_phases)
return logits

# Instrument detection (using YOLO v8 fine-tuned on surgical tools)
def detect_instruments_in_frame(frame: np.ndarray, model) -> list:
"""Detect surgical instruments in a laparoscopic video frame."""
results = model(frame)
instruments = []
for r in results:
for box, cls, conf in zip(r.boxes.xyxy, r.boxes.cls, r.boxes.conf):
instruments.append({
'instrument': model.names[int(cls)],
'confidence': float(conf),
'bbox': box.tolist()
})
return instruments

# Real-time phase + instrument pipeline for OR
transform = transforms.Compose([
transforms.ToPILImage(), transforms.Resize(224), transforms.CenterCrop(224),
transforms.ToTensor(), transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])
])
</syntaxhighlight>

; Surgical AI tools and systems
: '''Robotic surgery''' → da Vinci (Intuitive Surgical), Hugo (Medtronic), VERSIUS (CMR Surgical)
: '''Phase recognition''' → Academic: TeCNO, Trans-SVNet; Commercial: Activ Surgical
: '''Navigation''' → Stryker Mako (orthopedics), Brainlab, Medtronic StealthStation
: '''Surgical AI platform''' → Caresyntax, Touch Surgery (Medtronic), Theator
: '''Outcome prediction''' → ACS NSQIP Surgical Risk Calculator (web), Surgical AI Labs

== Analyzing ==
{| class="wikitable"
|+ Surgical AI Application Status
! Application !! AI Performance !! Clinical Deployment !! Key Barrier
|-
| Phase recognition (cholecystectomy) || >90% accuracy || Research → early commercial || Dataset annotation cost
|-
| Instrument detection || 85-95% mAP || Research || Occlusion, bleeding
|-
| CVS assessment || Moderate (70-80%) || Early commercial || Generalization across surgeons
|-
| Outcome prediction (NSQIP) || C-stat 0.85-0.95 || Deployed (web calculator) || EHR integration
|-
| Skill assessment || Moderate || Research/training programs || Ground truth subjectivity
|-
| Autonomous suturing || Demonstrated (preclinical) || Animal models only || Regulatory, safety
|}

'''Failure modes''': Blood and smoke obscuring the operative field causes computer vision failures. Domain shift across different hospital setups, camera systems, and surgeon styles. Real-time latency requirements for intraoperative AI (must be <1 second). Liability ambiguity when AI-assisted surgery leads to complications. Over-reliance on AI recommendations causing surgeons to ignore their own clinical judgment.

== Evaluating ==
Surgical AI evaluation: (1) '''Phase recognition''': frame-level and segmental accuracy (jaccard index); evaluate separately for each surgical phase. (2) '''Real-time latency''': measure end-to-end inference time; must be <1 second for clinical utility. (3) '''Instrument detection''': mAP at IoU=0.5; per-instrument class performance. (4) '''Prospective clinical validation''': test AI on prospective cases in the OR; measure surgeon trust, time-to-alert, and complication rates vs. historical control. (5) '''Multi-center generalization''': validate across hospitals, camera systems, and surgeon demographics.

== Creating ==
Deploying surgical AI in an OR: (1) Video infrastructure: HD laparoscopic tower with video capture card; HIPAA-compliant secure video storage. (2) Real-time processing: GPU workstation in OR or edge device; streaming inference pipeline. (3) Display integration: overlay AI outputs on surgical monitor or head-mounted display. (4) Surgeon interface: non-distracting alerts (color cues, audio for critical warnings). (5) Feedback loop: surgeons review and annotate AI decisions post-procedure; use for continuous model improvement. (6) Regulatory: work with FDA for SaMD (Software as Medical Device) pathway; collect prospective clinical evidence.

[[Category:Artificial Intelligence]]
[[Category:Surgery]]
[[Category:Medical Robotics]]