Surgical Workflow Analysis in Laparoscopy for Monitoring and Documentation Project duration: 2005/09/01 - 2010/12/31 In medical collaboration with: Dr. Hubertus Feussner (Klinikum rechts der Isar) Dr. Thomas Mussack (Klinikum Innenstadt) Contact Person: Nicolas Padoy

Keywords: Surgical Workflow

Abstract

Surgical workflow recovery is a crucial step towards the development of intelligent support systems in surgical environments. The objective of the project is to create a system which is able to recognize automatically the current steps of a surgical laparoscopic procedure using a set of signals recorded from the OR. The project adresses several issues such as the simultaneous recordings of various signals within the OR, the design of methods and algorithms for processing and interpreting the information, and finally the development of a convenient user interface to display context sensitive information inside the OR. The current clinical focus is on laparoscopic cholecystectomies but the concepts developed in the project also apply to laparoscopic surgeries of other kinds.

Publications

2008
	T. Blum, N. Padoy, H. Feußner, N. Navab Workflow Mining for Visualization and Analysis of Surgeries International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 5, November 2008, pp. 379-386 (bib)
	A. Ahmadi, N. Padoy, S.M. Heining, H. Feußner, M. Daumer, N. Navab Introducing Wearable Accelerometers in the Surgery Room for Activity Detection 7. Jahrestagung der Deutschen Gesellschaft f{\"u}r Computer-und Roboter-Assistierte Chirurgie (CURAC 2008) (bib)
	T. Blum, N. Padoy, H. Feußner, N. Navab Modeling and Online Recognition of Surgical Phases using Hidden Markov Models Medical Image Computing and Computer-Assisted Intervention (MICCAI 2008), New York, USA, September 2008, pp. 627-635 (bib)
	N. Padoy, T. Blum, H. Feußner, M.O. Berger, N. Navab On-line Recognition of Surgical Activity for Monitoring in the Operating Room Proceedings of the 20th Conference on Innovative Applications of Artificial Intelligence (IAAI 2008) held in conjunction with the 23rd AAAI Conference on Artificial Intelligence, Chicago, Illinois, USA, July 2008, pp. 1718-1724 (bib)
	U.F. Klank, N. Padoy, H. Feußner, N. Navab An Automatic Approach for Feature Generation in Endoscopic Images Proceedings of Computer Assisted Radiology and Surgery (CARS 2008), 22nd International Congress and Exhibition, Barcelona, Spain, June 2008 (bib)
	T. Blum, N. Padoy, H. Feußner, N. Navab Workflow Mining for Visualization and Analysis of Surgeries Proceedings of Computer Assisted Radiology and Surgery (CARS 2008), Barcelona, Spain, June 2008, pp. 134-135 (bib)
2007
	N. Padoy, T. Blum, I. Essa, H. Feußner, M.O. Berger, N. Navab A Boosted Segmentation Method for Surgical Workflow Analysis Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Australia, October 2007, pp. 102-109 (bib)
	N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007 (bib)
	N. Padoy, M. Horn, H. Feußner, M.O. Berger, N. Navab Recovery of Surgical Workflow: a Model-based Approach Proceedings of Computer Assisted Radiology and Surgery (CARS 2007), 21st International Congress and Exhibition, Berlin, Germany, June 2007 (bib)
	T. Sielhorst, R. Stauder, M. Horn, T. Mussack, A. Schneider, H. Feußner, N. Navab Simultaneous replay of automatically synchronized videos of surgeries for feedback and visual assessment Journal of Computer Assisted Radiology and Surgery (CARS 2007), 21st International Congress and Exhibition, Berlin, Germany, Volume 2, Supplement 1, pp. 433-434 (bib)
	T. Blum, T. Sielhorst, N. Navab Advanced Augmented Reality Feedback for Teaching 3D Tool Manipulation New Technology Frontiers in Minimally Invasive Therapies, 2007, pp. 223-236 (bib)
2006
	A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feußner, N. Navab Recovery of surgical workflow without explicit models Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Denmark, October 2006, pp. 420-428 (bib)
2005
	T. Sielhorst, T. Blum, N. Navab Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2005), Vienna, Austria, October 2005, pp. 38-47 (bib)

Team

Contact Person

Nicolas Padoy

Working Group

Ahmad Ahmadi

Armin Schneider

Hubertus Feussner

Nassir Navab

Nicolas Padoy

Thomas Mussack

Tobias Blum

Alumni

Daniel Butnaru

Michael Bothmann

Ralf Stauder

Tobias Sielhorst

Uli Klank

Yury Oleynik

Location

Technische Universität München Institut für Informatik / I16 Boltzmannstr. 3 85748 Garching bei München Tel.: +49 89 289-17058 Fax: +49 89 289-17059

Visit our lab at Garching.

Ludwig-Maximilians-Universität München Chirurgische Klinik und Poliklinik - Innenstadt, AG CAS Nussbaumstr. 20 80336 München Room: C2.06 Tel.: +49 89 5160-3615 Tel.: +49 89 5160-3635 Fax: +49 89 5160-3630

Visit our lab at Klinikum Innenstadt.

Klinikum rechts der Isar der Technischen Universitüt München Ismaninger Str. 22 81675 München IFL Lab - Room: 01.3a-c Tel.: +49 89 4140-6457 Fax: +49 89 4140-6458

Visit our lab at Klinikum rechts der Isar.



internal project page

Please contact Nicolas Padoy for available student projects within this research project.