Download PDFOpen PDF in browser

Depth Camera Augmented Fluoroscopy with Video Overlay

4 pagesPublished: October 26, 2019

Abstract

In many orthopedic surgeries, the surgeon relies on a C-arm fluoroscopy machine with the images usually displayed on a bedside monitor. The mental effort that surgeons expend transferring information from the imaging display back to the surgical site can lead to distraction causing errors that could directly influence quality of surgery. Depth Camera Augmented Fluoroscopy (DeCAF) uses an Intel RealSense depth camera to provide real-time visualization of the surgical site by overlaying x-ray images from the C-arm onto live video of the patient’s surface anatomy. Using geometric data acquired via the depth camera, the device facilitates transforming a real-time video feed aligned with the camera coordinate system to a perspective aligned with the x-ray source. The x- ray overlay is attained while restricting incursion on the surgeon’s work area and allowing the C-arm to be used in its normal position to minimize radiation exposure. DeCAF successfully facilitates an x-ray video overlay feature while eliminating key limitations such as size, radiation exposure and acquisition time associated with other similar devices. Future work will involve evaluating overlay accuracy, the addition of second depth camera to aid in filling in areas with missing details, and a design iteration involving bagging of the camera with a sterile cover to ensure compliance with asepsis requirements prior to evaluating the system in the operating room.

Keyphrases: coordinate transformation calibration, decaf, depth camera, image transformation, medical imaging, orthopedic & trauma surgery, video augmented c arm flouroscopy, video x ray overlay, x ray vision

In: Patrick Meere and Ferdinando Rodriguez Y Baena (editors). CAOS 2019. The 19th Annual Meeting of the International Society for Computer Assisted Orthopaedic Surgery, vol 3, pages 173-176.

BibTeX entry
@inproceedings{CAOS2019:Depth_Camera_Augmented_Fluoroscopy,
  author    = {Matthew Hickey and Pierre Guy and Antony J. Hodgson},
  title     = {Depth Camera Augmented Fluoroscopy with Video Overlay},
  booktitle = {CAOS 2019. The 19th Annual Meeting of the International Society for Computer Assisted Orthopaedic Surgery},
  editor    = {Patrick Meere and Ferdinando Rodriguez Y Baena},
  series    = {EPiC Series in Health Sciences},
  volume    = {3},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-5305},
  url       = {/publications/paper/ZDBk},
  doi       = {10.29007/tpbf},
  pages     = {173-176},
  year      = {2019}}
Download PDFOpen PDF in browser