LOYOLA ICAM COLLEGE OF ENGINEERING AND TECHNOLOGY (LICET) Loyola College Campus, Nungambakkam , Chennai 34

PROJECT REVIEW : 29.8.2013 VAAT [Virtual Anatomy and Autopsy Tool] SDK A software toolkit for rapid application development in Virtual Anatomy Domain: Pilot Modeling (Bio Info)

Done by Antony Joseph Ephrem .R Arjun .V Deepak John .J 4th Year, CSE Dept.

Guide Dr. K. Gopalakrishnan

Pre Project Review

There is a lot of domains in the medical field to be dealt with, how is VAAT going to implement all of them ? What is VAAT contributing on Technical aspects ? Comparison chart on existing works ?

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

Introduction
VAAT [Virtual Anatomy and Autopsy Tool] SDK is a software toolkit intended for developers to create intuitive and productive applications to aide Doctors and MBBS candidates The SDK is developed for Unity 3D platform thereby allowing developers to deploy on various platforms such as Android, iOS, Windows & MAC Taking the concept of contraction and retraction, VAAT SDK incorporated various scripting tools for different anatomical based movements
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 3

Purpose
To create an open source SDK for Unity3D Which possess capabilities to develop autopsy related function's Hence developers incorporating the VAAT SDK can contribute to meet the needs of a MBBS candidate or Doctor.

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

Overall Description
VAAT SDK comprises of Tools Section Anatomical Movement Scripts Info View Module Scenario Section

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

Product Perspective
System Interface
C# and Java Script

User Interface
Unity 3D

Hardware Interface
Minimum 20GB Hard-disk Minimum 512MB Graphics Card Minimum 2GB RAM Minimum Dual Core - 2Ghz Processor
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 6

Constraints
Scenario section requires developer support due to the numerous case studies available Hence VAAT as an SDK paves a new way for developers to build applications for various case studies and anatomical parts

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

Assumptions
The human body's every single movement is based on contraction and retraction Theoretically weve devised a script to produce anatomical movements on a Method Call:
VAATMov(Xaxis,Yaxis,Zaxis,Increment,Decrement,DurationDelay)

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

Schematic Representation
VAATMov( Xaxis, Yaxis, Zaxis, Increment, Decrement, DurationDelay ) VAATMov( YES, YES, NO, 25, 25, 500 )

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

Specific Requirements
Functional requirements
Import Tools section prefab
A prefab in unity is a predefined component which can be utilized in a scene

Create and Link info view prefab with the specific anatomical object (eg: Brain Info on brain) Import anatomical scripts related to object (eg: Heart Pumping script) Import scenario views
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 10

Specific Requirements
Non-Functional requirements
Reliability
Utilizes C# or Java scripts

Availability
Unity 3D Deployment to Android, iOS, Mac and Windows

Maintainability
Based on spiral model of development Every iteration will incorporate better code optimization or functionality Scripts will posses lesser dependency among themselves

Portability
Unity 3D is available for MAC, Linux and Windows

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

11

Specific Requirements
Design Requirements
Unity 3D
Tools and Info View Design

Blender
Model Rendering

Photoshop
Texture support

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

12

Comparison of Existing works

Paper/Method Anatomic VisualizeR[1] PROSOPON[2]

Main Focus Virtual Reality Human Head

Research Method Virtual Reality-Multimedia Synthesis (VR-MMS) Step 1:Anatomical Structures' Contours Step 2:Morphological Operations Step 3:Discretized Marching Cubes

Virtual Human[3]
Real-Time Photorealistic Anatomy[4] Virtual

Based on CAD
Human Texture Based

Musculoskeletal Anatomy
Voxel Based Surface Reconstruction Medical Imaging Systems

Efficient shape-based algorithms for modeling Texture Based patient specific anatomy from 3D medical images[5] Virtual Human Anatomy [6]
Friday, November 22, 2013

Texture Based
Virtual Anatomy and Autopsy Tool

Cryosection images
13

Drawbacks
Paper/Method Anatomic VisualizeR[1] PROSOPON[2] Texture Utilization YES NO 3D Bone Utilization NO YES Animation YES NO

Virtual Human[3]
Real-Time Photorealistic Virtual Human Anatomy[4] Efficient shape-based algorithms for modeling patient specific anatomy from 3D medical images[5] Virtual human anatomy[6]

YES
YES YES

YES
YES NO

NO
NO NO

YES

NO

YES

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

14

Proposed System
Tools section Prefab
In this module, the user is given various tools such as a palette knife to perform incision related activities

Anatomical Movement Scripts

In this module various scripting based anatomical movements are created and incorporated for easier access using the SDK.

Info View Prefab

In this module the user is provided the information pertaining to the parts selected on the 3D human anatomy

Scenario View Prefab

In this module the user is allowed to perform autopsy related operations on the 3D model

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

15

Pre Project Review

There is a lot of domains in the medical field to be dealt with, how is VAAT going to implement all of them ? What is VAAT contributing on Technical aspects ? Comparison chart on existing works ?

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

16

Conclusion
VAAT [Virtual Anatomy and Autopsy Tool] SDK provides developers with an immersive virtual experience in terms of performing various autopsy related function's on a human cadaver. Hence the project is much needed with Developers, Doctors, MBBS candidates, Lecturers and R&D sectors where a virtual experience can be obtained by means of VAAT.

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

17

References
Published Papers:
[1]Anatomic VisualizeR: Teaching and Learning Anatomy with Virtual Reality; Akay, M. ; Marsh, A. Wiley IEEE Papers 2001 [2]PROSOPON: A virtual anatomical 3D head model; Sagonas C. I. ; Kirgidis, A. ; Lyroudia, K. Nov 2011 [3]Virtual Human: a computer graphics model for biomechanical simulations and computer-aided instruction; Sellberg, M.S. ; Vanderploeg, M.J. Nov 1994 [4]Real-Time Photorealistic Virtual Human Anatomy; Yanling Liu; Chen, J.X. ; Lin Yang; April 2008 [5]Efficient shape-based algorithms for modeling patient specific anatomy from 3D medical images: applications in virtual endoscopy and surgery; Robb, R.A. ; Cameron, B.M. ; Aharon, S; March 1997 [6]Virtual human anatomy; Lin Yong ; Chen, J.X. ; Yanling Liu; Oct 2005
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 18

References
Conference Papers:
[7]Primary Research of Digital Atlas of Human Anatomy on Virtual Reality; Qin Lu ; Luo, Shuqian [8]Efficient shape-based algorithms for modeling patient specific anatomy from 3D medical images: applications in virtual endoscopy and surgery; Robb, R.A.; Cameron, B.M. ; Aharon, S. [9]Three dimensional interactive virtual anatomy laboratory design and its application; Erdogan, U.; Dokuz Eylul; Ozkurt, A. ; Ozgoren, M. ; Guzelis, C. ; Alpkocak, A. ; Abacioglu, Y.H. ; Dicle, O.

[10]The virtual surgery patient: development of a digital, threedimensional model of human anatomy designed for surgical education; Qualter, J.; Triola, M.M. ; Weiner, M.J. ; Hopkins, M.A. ; Kirov, M. ; Nachbar, M.S.
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 19

Thank You

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

20

[1] Anatomic VisualizeR: Teaching and Learning Anatomy with Virtual Reality
The resultant product, VisualizeR, is a virtual environment (VE) designed to support the teaching and learning of any subject that requires an understanding of three-dimensional (3-D) structures and complex spatial relationships. VisualizeR's multimodal application interface approach, named virtual reality-multimedia synthesis (VR-MMS), enables interaction with 3-D models and concurrent access to multimedia resources, including text, images, animations, video, and sound.
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 21

[2] PROSOPON: A virtual anatomical 3D head model

A new high-resolution model of a virtual human head is introduced, aiming to build an educational tool for anatomy studies of the head, oral/nasal cavities and teeth. Firstly, anatomical structures' contours were extracted on head slices in a semi-automatic way. Secondly, morphological operations were applied in the extracted contours for smoothing the anatomical structure volume. For anatomical structure surface extraction, Discretized Marching Cubes were employed. One hundred thirteen head anatomical structures have been segmented and modeled.

Friday, November 22, 2013

Virtual Anatomy and Autopsy Tool

22

[3] Virtual Human: a computer graphics model for biomechanical simulations and computer-aided instruction
A comprehensive database of 3D geometric models of the human musculoskeletal anatomy has been created along with Virtual Human software that utilizes the models for both biomechanics and computer-aided instruction applications. In addition to the software, results include a lower extremity muscle model for biomechanical and rehabilitation analysis, a lumped set of muscles for rehabilitation controls systems research, an animation of knee motion including deforming muscles, and bone metabolism and muscle ion flux physiology animations for computer-aided instruction
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 23

[4] Real-Time Photorealistic Virtual Human Anatomy

The authors' voxel-based surfacereconstruction algorithm provides fast surface reconstruction and real-time modification to volume data. Focusing on high-quality human parts rendering as well as real-time interaction, the system provides a better platform for virtually learning human anatomy.
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 24

[5] Efficient shape-based algorithms for modeling patient specific anatomy from 3D medical images: applications in virtual endoscopy and surgery Virtual reality environments provide highly interactive, natural control of the visualization process, significantly enhancing the scientific value of the data produced by medical imaging systems. In this paper, it presents two new algorithms for the production of anatomic surface models containing a pre-specified number of polygons from patient- or subject-specific volumetric image data sets. The advantage of these algorithms is that they efficiently tile complex surfaces with a specified number of polygons selected to optimize the trade-off between surface detail and real-time display rates.
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 25

[6] Virtual human anatomy

To learn human anatomy, medical students must practice on cadavers, as must physicians when they want to brush up on their anatomy knowledge. VHASS uses cryosection images - cross-section natural-color images generated by slicing a frozen cadaver-to reconstruct the human body.
Friday, November 22, 2013 Virtual Anatomy and Autopsy Tool 26