Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation...

8
Virtual Heart: Cardiac Simulation for Surgical Training & Education Vassilios Hurmusiadis 1 (1) Primal Pictures Ltd, 159-163 Great Portland Street, London W1W 5PA, UK email: [email protected] Abstract An investigation into the technical and commercial feasibility of computer-based interactive simulation of the human heart was conducted. An experimental research application was developed and served as a proof of concept for the simulation models during the research phase. The follow-on development phase will be directed towards a pre-production prototype of a virtual heart organ. The prototype will be customised for clinical skills training for interventional cardiology and for cardiac electrophysiology. Further, the prototype will be customised for general cardiology education. Keywords: virtual human, medical simulation, surgical simulation, medical education. 1 Modelling the Cardiac Anatomy A combination of automatic and manual segmentation techniques were used to extract a detailed 3D model of cardiac anatomy using the Visible Male image dataset (Visible Human). The technique was based on a recursive 3D region-growing algorithm and the marching cubes algorithm. A total of 190 image sections were used, with each section consisting of 2048x1216 pixels x 24 bits of colour. The sections were at 1 mm distance from each other and each pixel represented a block of 0.33x0.33x1.0mm of tissue. The resulting model consists of approximately 500K triangles. a. b. Figure 1. a) The high resolution 3D heart model was reconstructed from the Visible Male dataset. b) The simplified 3D heart model is suitable for near real-time interactive manipulation. The model is capable of representing high anatomical accuracy as seen in the cross-sections in figure 1a. This level of detail is useful for demonstrating the internal anatomical structures of the heart chambers. Additionally, a lighter and simplified heart model was developed using polygon reduction and surface smoothening on the heart model. The simplified model consists of 83K triangles and incorporates only the most essential structures (see figure 1b). 1

Transcript of Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation...

Page 1: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

Virtual Heart: Cardiac Simulation for Surgical Training & Education

Vassilios Hurmusiadis1

(1) Primal Pictures Ltd, 159-163 Great Portland Street, London W1W 5PA, UKemail: [email protected]

AbstractAn investigation into the technical and commercial feasibility of computer-based interactive simulation of the human heart was conducted. An experimental research application was developed and served as a proof of concept for the simulation models during the research phase. The follow-on development phase will be directed towards a pre-production prototype of a virtual heart organ. The prototype will be customised for clinical skills training for interventional cardiology and for cardiac electrophysiology. Further, the prototype will be customised for general cardiology education.

Keywords: virtual human, medical simulation, surgical simulation, medical education.

1 Modelling the Cardiac AnatomyA combination of automatic and manual segmentation techniques were used to extract a detailed 3D model of cardiac anatomy using the Visible Male image dataset (Visible Human). The technique was based on a recursive 3D region-growing algorithm and the marching cubes algorithm. A total of 190 image sections were used, with each section consisting of 2048x1216 pixels x 24 bits of colour. The sections were at 1 mm distance from each other and each pixel represented a block of 0.33x0.33x1.0mm of tissue. The resulting model consists of approximately 500K triangles.

a. b.

Figure 1. a) The high resolution 3D heart model was reconstructed from the Visible Male dataset.b) The simplified 3D heart model is suitable for near real-time interactive manipulation.

The model is capable of representing high anatomical accuracy as seen in the cross-sections in figure 1a. This level of detail is useful for demonstrating the internal anatomical structures of the heart chambers. Additionally, a lighter and simplified heart model was developed using polygon reduction and surface smoothening on the heart model. The simplified model consists of 83K triangles and incorporates only the most essential structures (see figure 1b).

1

Page 2: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

2 Myocardium Fibre OrientationsThe fibre orientations of the myocytes (myocardium cells) are an important physical property for the following reasons (Sermesant 2003):

o For the electrical action potential propagation, the fibres represent the preferential propagation direction.

o For the contractile element of the muscle simulation model, the fibres provide the direction of the contraction.

o For the passive elastic element of the muscle simulation model, the fibres provide the transverse direction.

a. b. c.Figure 2. a) Myocardium fibre orientations in left and right ventricles. b) A section of the

dataset in reduced resolution. c) Fibres fitted in corresponding section of the left ventricle.

A dataset of muscle fibre orientations in the myocardium was downloaded by permission from the Bioengineering Lab of the University of California, UCSD FTP site. This dataset was originally extracted from a canine heart using the method of Diffusion Tensor Magnetic Resonance (DT-MRI) – an imaging process that registers the orientations of water molecules in the tissue. The dataset covers the region of the two ventricles and consists of approximately 1 million fibre nodes (see figure 2a). A section of the left ventricle was specially constructed to accommodate a volumetric sample of the cell-nodes and their respective fibre orientations (see figures 2b, c). A number of versions of the sample with varying resolutions were created, ranging from 200K nodes down to 10K nodes. The sample versions were used to test near real-time performance of the simulation models.

3 Specialised Conduction SystemThe action potential in the heart is generated by specialised cells in the SA (Sino-Atrial) node and spread throughout the atria primarily by cell-to-cell conduction (see figure 3a). The conduction velocity in the atrial muscle is about 0.5m/sec. At the AV (Atrio-Ventricular) node the conduction slows down to about 0.05m/sec, thereby allowing sufficient time for a complete atrial contraction (systole). At this stage the action potential then enters the base of the ventricle at the Bundle of His and then follows the left and right bundle branches along the inter-ventricular septum. These specialised fibres conduct the impulses at a very rapid velocity, about 2m/sec. The bundle branches then divide into an extensive system of Purkinje fibres that conduct the impulses at high velocity of about 4m/sec throughout the ventricles. This results in depolarisation of ventricular myocytes and ventricular contraction.

2

Page 3: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

a. b.

Figure 3. a) Action potential velocities in the conduction tree (image from (Klabunde 2004). b) A simplified conduction tree with action potential (yellow lines) travelling from the SA node towards the AV

node.

A 3D model of the conduction tree was constructed to fit the heart model (see figure 3b). There are no recorded methods for extracting the tree from medical imaging data, so the modelling process was based on anatomical descriptions and illustrations available in medical publications. An action potential velocity simulation model was developed. The velocity model was adapted to the 3D conduction tree (see figure 3b). The model is capable of generating the above mentioned average velocity values in the various parts of the conduction tree. The rate of the SA node can be interactively modified with immediate visual feedback.

4 Electrical Excitation Model

4.1 Single CellA number of simulation models of cardiac cellular electrophysiology exist in research literature. Such models usually compute the trans-membrane potential, currents, ion concentrations and other parameters of a cardiac cell for a specific type of tissue (Hodgkin 1952). Usually, these models contain a set of differential equations. The number of these differential equations has been increasing within the last years and has reached over 50 (Jafri 1998). Solving such systems of differential equations requires a lot of computational power and is prohibitive for real-time applications. The Cell Electrophysiology Simulation Environment (CESE) is a comprehensive framework, specifically designed to perform computational electrophysiological simulations. CESE is useful for simulations of action potentials, individual ionic currents and changes in ionic concentrations. The application is freely available as an open-source project.

a. b.Figure 4. a) The Luo-Rudy cell activation model (Luo 1991), and b) action potential (mV)/time (ms)

obtained from the CESE application (CESE).

3

Page 4: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

A single cell activation sequence was constructed using the CESE simulation application and the Luo-Rudy [7] cardiac action potential model (see figure 4a). In this model the action potential ranges from -86mV (milli-Volts) at rest state to 50mV at fully depolarised state. The total duration for one complete cell depolarisation/re-polarisation cycle is 300ms (milli-seconds). The cell action potential/time profile was output from the CESE application and imported into the simulation application see figure 4b). This single cell activation profile formed the basis for the construction of an inter-cell (cell-to-cell) activation propagation wave.

4.2 Cellular AutomatonThe simulation of the inter-cell activation propagation is based on a cellular automaton. The excitation of cells propagates according to simple rules generated from cardiac electrophysiology. No differential equations are solved, so the computational requirement for one cardiac cycle is much lower and interactive near real-time performance is possible. Cellular automata are used in various fields as models of natural processes, e.g. in physics, chemistry, biology, economy and medicine (Delorme 1999). A typical cellular automaton can be divided in two components:

o A regular, discrete, finite network representing the universe.o At each node of the network there is a working finite automaton.

Figure 5. 26-neighbourhood of a 3D cellular automaton (Moore 1962) (yellow cells are the neighbours of blue cell).

Each cell-node corresponds with a finite set of other cells, which determines the neighbourhood of the cellular automaton. In the case of 3D cellular automata, classical neighbourhoods are the nearest 6 or 26 neighbours (Moore 1962) (see figure 5). The way two cells communicate is local, deterministic, uniform and synchronous. Therefore, a global evolution of the system is pre-determined, running the cellular automaton along discrete time steps.

Figure 6. An action potential propagation wave is generated by the cellular automaton.Colour coding: blue: re-polarised cells, red: fully de-polarised cells, cyan: Purkinje fibre network.

4

Page 5: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

The 3D cellular automaton is used to simulate the propagation of electrical excitation of each cardiac cell to its neighbours. The model consists of the anatomical tissue sample, the muscle fibre orientation dataset and the specialised cardiac conduction system tree (see figure 6). At anyone time during the simulation each cell-node is defined by its state, which is constantly updated at each millisecond of the simulated cycle. The value of the action potential for each cell is looked up from the pre-calculated profile (see figure 4b).

Figure 7. Action potential propagation in relation to heart anatomy (left) and fibre orientations (right).

The action potential is conducted from a cell to one of its neighbours if the cell has reached an action potential threshold (~30mV) and if the neighbour is in a fully re-polarised state (see figures 6, 7). The velocity of the conduction is normally 0.5m/s in the direction of the fibre and approximately 0.025m/s (50% less) in the transverse direction. The model is capable of generating action potential propagation waves through the myocardium tissue sample (with ~100K nodes) in near real-time on a CPU of 1.6GHz.

a. b.Figure 8. a) Arrhythmic propagation wave. b) A region of dead cells seen in black.

The model is also capable of generating arrhythmic propagation waves (see figure 8a). Arrhythmic waves can be generated by interactively modifying the heartbeat rate and the refraction period of the cell cycle (the duration of the plateau in the action potential profile). Dead cells can be simulated by adding the “dead cell” state in the simulation of the cellular automaton. In figure 8b, a region of dead cells is being by-passed by the propagation wave. As a result the propagation evolves into an arrhythmia.

5 Mechanical Tissue Deformation ModelA cellular mechanical deformation model was developed. The model is based on the Hill-Maxwell muscle simulation model (see figure 9a) (Fung). A simplified version of the model consists of an active contractile element and a passive elastic element connected in parallel (see figure 9b). The non-linear and anisotropic nature of cardiac tissue is addressed by incorporating the fibre orientation in each cell-node.

5

Page 6: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

a. b.

Figure 9. a) The Hill-Maxwell muscle model (Fung) and b) a simplified version of the model.

The contractile element of each cell is activated when the respective action potential reaches the activation threshold. The passive element represents the mechanical elasticity of the muscle tissue and is modelled using the elasticity constitutive law. To perform the mechanical simulation the following dynamics equation is solved:

[1] M(d2D/dt2) + C(dD/dt) + KU = F

where D is the displacement vector, M is the mass matrix, C is the damping matrix, K is the linear elastic stiffness matrix and F is the total external stress, including the stress tensor from the contraction. Equation [1] is integrated in time and space within the sample of the tissue cell-nodes domain. The mechanical contraction can be directly compared with measures from medical images making a validation possible. This model was developed taking into account interactivity and real-time considerations as priorities. The model was based on an earlier version published by the author (Hurmusiadis 2005).

6 Electro-mechanical Coupling ModelThe coupling model relates the action potential to an actively developed contractile tension (see figure 10a). The contractile mechanical behaviour of each cell-node is coupled to electrical activation by the action potential profile of the same cell.

a. b.

Figure 10. a) Electrical (blue) and mechanical (grey) activity in a cardiac muscle cell (Ruch 1982).b) Superimposed normalised action potential (red) and contraction (green) over time.

In the developed model, the contractile element of a cell is activated when the action potential of the cell exceeds an activation threshold (~40mV). The development of the cell contraction takes place over time, following a pre-calculated profile. As a result, cell contraction peaks approximately 200ms after the action potential peak (see figure 10b).

7 Patient Data Input

6

Page 7: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

a. b.

Figure 11. a) Timed cardiac MRI sequence (Leeds General Infirmary). b) Cardiac MRI superimposed to the 3D heart model.

Cardiac MRI data (see figure 11a) have been superimposed onto the 3D model of the beating heart, in order to visualise the spatial and temporal correlation (see figure 11b). Other cardiac imaging data that may be imported in the application in the future are echocardiography image sequences and electrophysiology maps.

8 Results and Future WorkAn experimental research application was developed. This application has served as a proof of concept for the real-time and interaction issues and as a test-bed for the simulation models. The application consists of two main modules: visualisation and simulation. The purpose of the visualisation module is to import and visualise existing and pre-calculated data, such as the simplified 3D heartbeat model, the CESE action potential/time and the contraction/time profiles. This module can show the beating heart in full views, pre-defined internal close-up views, cross-sections and a camera-on-path pre-recorded sequence (see figure 12). The simulation module accommodates the electro-mechanical simulation models. The electro-mechanical function is demonstrated with the conduction tree, the ventricle tissue sample and the fibre orientation set.

Figure 12. External, internal and cross-section views of the beating heart.

The application provides interactive control of a standard free camera in 3D space (i.e. camera tumble, track, drag, tilt and zoom) and control over certain cardiac parameters, such as the heartbeat rate and the length of the refraction period in cells. The application was developed using the OpenGL and GLUT open source computer graphics libraries. The visualisation modules were written in C and the simulation modules in C++ programming languages.The simulation of the insertion of flexible tools and the simulation of the ablation procedure will be addressed during the development phase which is currently under way. The catheter insertion model involves real-time collision detection between soft and hard tissue. Further development will also include the use of haptic user interface for handling catheter insertion. This project is partly funded by a R&D Grant from the London Development Agency - UK.

7

Page 8: Virtual Heart: Cardiac Simulation for Surgical Training ... · Virtual Heart: Cardiac Simulation for Surgical Training & ... o For the electrical action potential propagation, ...

ReferencesCardiac MRI Unit, Leeds General Infirmary, Leeds, UK. www.leedscmr.org.

CESE, Cell Electrophysiology Simulation Environment. (http://cese.sourceforge.net).

Delorme, M. (1999): An Introduction to Cellular Automata. In: Cellular Automata. Ch. 1, pp. 5-49. Dordrecht: Kluwer.

Fung, Y.C. Biomechanics: Mechanical Properties of Living Tissues. 2nd ed. Springer-Verlag New York Inc.

Hodgkin, A.L. and Huxley, A.F. (1952): A quantitative description of membrane current and its application to conduction and excitation in nerve. In: Journal of Physiology. Vol. 177, pp. 500-544.

Hurmusiadis, V., Briscoe, C. (2005): Functional Heart Model for Medical Education. In: Func-tional Imaging and Modelling of the Heart FIMH 2005, Barcelona, Spain, June.

Jafri, M.S., Rice, J.J. and Winslow, R. L. (1998): Cardiac Ca+ Dynamics: The Roles of Ryanod-ine Receptor Adapation and Sarcoplasmic Reticulum Load. In: Biophysical Journal. Vol. 74, pp. 1149-1168, Mar.

Klabunde, R.E. (2004): Cardiovascular Physiology Concepts. Lippincott Williams & Wilkins.

Luo, C.H. and Rudy, Y. (1991): A Model of the Ventricular Cardiac Action Potential. Depolarization, Repolarization, and Their Interaction. In: Circulation Research 1991. 68: 1501-1526.

Moore, E. F. (1962): "Machine models of self-reproduction”. In: Proceedings of Symposia in Applied Mathematics. Vol. 14, p. 17-33. The American Mathematical Society.

Ruch, T.C. and Patton, H.D., eds. (1982): Physiology and Biophysics. W. B. Saunders, 20th edi-tion.

Sermesant, M. (2003): An Electromechanical Model of the Heart for Image Analysis and Simu-lation. PhD Thesis. INRIA Sophia Antipolis.

The Visible Human Project. National Library of Medicine, Bethesda, Maryland USA (www.n-lm.nih.gov).

8