Using Hybrid Parallelism to improve memory use in Uintah|
Q. Meng, M. Berzins, J. Schmidt. In Proceedings of the TeraGrid 2011 Conference, Salt Lake City, Utah, ACM, July, 2011.
The Uintah Software framework was developed to provide an environment for solving fluid-structure interaction problems on structured adaptive grids on large-scale, long-running, data-intensive problems. Uintah uses a combination of fluid-flow solvers and particle-based methods for solids together with a novel asynchronous task-based approach with fully automated load balancing. Uintah's memory use associated with ghost cells and global meta-data has become a barrier to scalability beyond O(100K) cores. A hybrid memory approach that addresses this issue is described and evaluated. The new approach based on a combination of Pthreads and MPI is shown to greatly reduce memory usage as predicted by a simple theoretical model, with comparable CPU performance.
Keywords: Uintah, C-SAFE, parallel computing
Establishing Multiscale Models for Simulating Whole Limb Estimates of Electric Fields for Osseointegrated Implants|
B.M. Isaacson, J.G. Stinstra, R.D. Bloebaum, COL P.F. Pasquina, R.S. MacLeod. In IEEE Transactions on Biomedical Engineering, Vol. 58, No. 10, pp. 2991--2994. 2011.
PubMed ID: 21712151
PubMed Central ID: PMC3179554
Although the survival rates of warfighters in recent conflicts are among the highest in military history, those who have sustained proximal limb amputations may present additional rehabilitation challenges. In some of these cases, traditional prosthetic limbs may not provide adequate function for service members returning to an active lifestyle. Osseointegration has emerged as an acknowledged treatment for those with limited residual limb length and those with skin issues associated with a socket together. Using this technology, direct skeletal attachment occurs between a transcutaneous osseointegrated implant (TOI) and the host bone, thereby eliminating the need for a socket. While reports from the first 100 patients with a TOI have been promising, some rehabilitation regimens require 12-18 months of restricted weight bearing to prevent overloading at the bone-implant interface. Electrically induced osseointegration has been proposed as an option for expediting periprosthetic fixation and preliminary studies have demonstrated the feasibility of adapting the TOI into a functional cathode. To assure safe and effective electric fields that are conducive for osseoinduction and osseointegration, we have developed multiscale modeling approaches to simulate the expected electric metrics at the bone--implant interface. We have used computed tomography scans and volume segmentation tools to create anatomically accurate models that clearly distinguish tissue parameters and serve as the basis for finite element analysis. This translational computational biological process has supported biomedical electrode design, implant placement, and experiments to date have demonstrated the clinical feasibility of electrically induced osseointegration.
IMPICE Method for Compressible Flow Problems in Uintah|
L.T. Tran, M. Berzins. In International Journal For Numerical Methods In Fluids, Note: Published online 20 July, 2011.
Scalable parallel regridding algorithms for block-structured adaptive mesh renement|
J. Luitjens, M. Berzins. In Concurrency And Computation: Practice And Experience, Vol. 23, No. 13, John Wiley & Sons, Ltd., pp. 1522--1537. 2011.
ZAPP – A management framework for distributed visualization systems|
G. Tamm, A. Schiewe, J. Krüger. In Proceedings of CGVCVIP 2011 : IADIS International Conference on Computer Graphics, Visualization, Computer Vision And Image Processing, pp. (accepted). 2011.
Real-time magnetic resonance imaging-guided radiofrequency atrial ablation and visualization of lesion formation at 3 Tesla|
G.R. Vergara, S. Vijayakumar, E.G. Kholmovski, J.J. Blauer, M.A. Guttman, C. Gloschat, G. Payne, K. Vij, N.W. Akoum, M. Daccarett, C.J. McGann, R.S. Macleod, N.F. Marrouche. In Heart Rhythm, Vol. 8, No. 2, pp. 295--303. 2011.
PubMed ID: 21034854
Association of left atrial fibrosis detected by delayed-enhancement magnetic resonance imaging and the risk of stroke in patients with atrial fibrillation|
M. Daccarett, T.J. Badger, N. Akoum, N.S. Burgon, C. Mahnkopf, G.R. Vergara, E.G. Kholmovski, C.J. McGann, D.L. Parker, J. Brachmann, R.S. Macleod, N.F. Marrouche. In Journal of the American College of Cardiology, Vol. 57, No. 7, pp. 831--838. 2011.
PubMed ID: 21310320
MRI of the left atrium: predicting clinical outcomes in patients with atrial fibrillation|
M. Daccarett, C.J. McGann, N.W. Akoum, R.S. MacLeod, N.F. Marrouche. In Expert Review of Cardiovascular Therapy, Vol. 9, No. 1, pp. 105--111. 2011.
PubMed ID: 21166532
Finite Element Based Discretization and Regularization Strategies for 3D Inverse Electrocardiography|
D. Wang, R.M. Kirby, C.R. Johnson. In IEEE Transactions for Biomedical Engineering, Vol. 58, No. 6, pp. 1827--1838. 2011.
PubMed ID: 21382763
PubMed Central ID: PMC3109267
We consider the inverse electrocardiographic problem of computing epicardial potentials from a body-surface potential map. We study how to improve numerical approximation of the inverse problem when the finite-element method is used. Being ill-posed, the inverse problem requires different discretization strategies from its corresponding forward problem. We propose refinement guidelines that specifically address the ill-posedness of the problem. The resulting guidelines necessitate the use of hybrid finite elements composed of tetrahedra and prism elements. Also, in order to maintain consistent numerical quality when the inverse problem is discretized into different scales, we propose a new family of regularizers using the variational principle underlying finite-element methods. These variational-formed regularizers serve as an alternative to the traditional Tikhonov regularizers, but preserves the L2 norm and thereby achieves consistent regularization in multiscale simulations. The variational formulation also enables a simple construction of the discrete gradient operator over irregular meshes, which is difficult to define in traditional discretization schemes. We validated our hybrid element technique and the variational regularizers by simulations on a realistic 3-D torso/heart model with empirical heart data. Results show that discretization based on our proposed strategies mitigates the ill-conditioning and improves the inverse solution, and that the variational formulation may benefit a broader range of potential-based bioelectric problems.
A Diffusion Approach to Network Localization|
Y. Keller, Y. Gur. In IEEE Transactions on Signal Processing, Vol. 59, No. 6, pp. 2642--2654. 2011.
Full-Resolution Interactive CPU Volume Rendering with Coherent BVH Traversal|
A. Knoll, S. Thelen, I. Wald, C.D. Hansen, H. Hagen, M.E. Papka. In Proceedings of IEEE Pacific Visualization 2011, pp. 3--10. 2011.
From h to p Efficiently: Strategy Selection for Operator Evaluation on Hexahedral and Tetrahedral Elements|
C.D. Cantwell, S.J. Sherwin, R.M. Kirby, P.H.J. Kelly. In Computers and Fluids, Vol. 43, No. 1, pp. 23--28. 2011.
Using Adjoint Error Estimation Techniques for Elastohydrodynamic Lubrication Line Contact Problems|
D.E. Hart, M. Berzins, C.E. Goodyer, P.K. Jimack. In International Journal for Numerical Methods in Fluids, Vol. 67, Note: Published online 29 October, pp. 1559--1570. 2011.
Finite element modeling of subcutaneous implantable defibrillator electrodes in an adult torso|
M. Jolley, J. Stinstra, J. Tate, S. Pieper, R.S. Macleod, L. Chu, P. Wang, J.K. Triedman. In Heart Rhythm, Vol. 7, No. 5, pp. 692--698. May, 2010.
PubMed ID: 20230927
PubMed Central ID: PMC3103844
We used image-based finite element models (FEM) to predict the myocardial electric field generated during defibrillation shocks (pseudo-DFT) in a wide variety of reported and innovative subcutaneous electrode positions to determine factors affecting optimal lead positions for subcutaneous implantable cardioverter-defibrillators (S-ICD).
An image-based FEM of an adult man was used to predict pseudo-DFTs across a wide range of technically feasible S-ICD electrode placements. Generator location, lead location, length, geometry and orientation, and spatial relation of electrodes to ventricular mass were systematically varied. Best electrode configurations were determined, and spatial factors contributing to low pseudo-DFTs were identified using regression and general linear models.
A total of 122 single-electrode/array configurations and 28 dual-electrode configurations were simulated. Pseudo-DFTs for single-electrode orientations ranged from 0.60 to 16.0 (mean 2.65 +/- 2.48) times that predicted for the base case, an anterior-posterior configuration recently tested clinically. A total of 32 of 150 tested configurations (21%) had pseudo-DFT ratios /=1, indicating the possibility of multiple novel, efficient, and clinically relevant orientations. Favorable alignment of lead-generator vector with ventricular myocardium and increased lead length were the most important factors correlated with pseudo-DFT, accounting for 70% of the predicted variation (R(2) = 0.70, each factor P < .05) in a combined general linear modl in which parameter estimates were calculated for each factor.
Further exploration of novel and efficient electrode configurations may be of value in the development of the S-ICD technologies and implant procedure. FEM modeling suggests that the choice of configurations that maximize shock vector alignment with the center of myocardial mass and use of longer leads is more likely to result in lower DFT.
A New Family of Variational-Form-Based Regularizers for Reconstructing Epicardial Potentials from Body-Surface Mapping|
D.F. Wang, R.M. Kirby, R.S. MacLeod, C.R. Johnson. In Computing in Cardiology, 2010, pp. 93--96. 2010.
h-p Efficiently: Implementing Finite and Spectral/hp Element Methods to Achieve Optimal Performance for Low- and High-Order Discretisations|
P.E.J. Vos, S.J. Sherwin, R.M. Kirby. In Journal of Computational Physics, Vol. 229, No. 13, pp. 5161--5181. 2010.
Quantifying Variability in Radiation Dose Due to Respiratory-Induced Tumor Motion|
S.E. Geneser, J.D. Hinkle, R.M. Kirby, Brian Wang, B. Salter, S. Joshi. In Medical Image Analysis, Vol. 15, No. 4, pp. 640--649. 2010.
Towards the Development on an h-p-Refinement Strategy Based Upon Error Estimate Sensitivity|
P.K. Jimack, R.M. Kirby. In Computers and Fluids, Vol. 46, No. 1, pp. 277--281. 2010.
The use of (a posteriori) error estimates is a fundamental tool in the application of adaptive numerical methods across a range of fluid flow problems. Such estimates are incomplete however, in that they do not necessarily indicate where to refine in order to achieve the most impact on the error, nor what type of refinement (for example h-refinement or p-refinement) will be best. This paper extends preliminary work of the authors (Comm Comp Phys, 2010;7:631–8), which uses adjoint-based sensitivity estimates in order to address these questions, to include application with p-refinement to arbitrary order and the use of practical a posteriori estimates. Results are presented which demonstrate that the proposed approach can guide both the h-refinement and the p-refinement processes, to yield improvements in the adaptive strategy compared to the use of more orthodox criteria.
Quantificiation of Errors Introduced in the Numerical Approximation and Implementation of Smoothness-Increasing Accuracy Conserving (SIAC) Filtering of Discontinuous Galerkin (DG) Fields|
H. Mirzaee, J.K. Ryan, R.M. Kirby. In Journal of Scientific Computing, Vol. 45, pp. 447-470. 2010.
Resolution Strategies for the Finite-Element-Based Solution of the ECG Inverse Problem|
D.F. Wang, R.M. Kirby, C.R. Johnson. In IEEE Transactions on Biomedical Engineering, Vol. 57, No. 2, pp. 220--237. February, 2010.