Journal of Multimedia Information System

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Occlusion-based Direct Volume Rendering for Computed Tomography Image

  • Received : 2018.01.31
  • Accepted : 2018.02.19
  • Published : 2018.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

Direct volume rendering (DVR) is an important 3D visualization method for medical images as it depicts the full volumetric data. However, because DVR renders the whole volume, regions of interests (ROIs) such as a tumor that are embedded within the volume maybe occluded from view. Thus, conventional 2D cross-sectional views are still widely used, while the advantages of the DVR are often neglected. In this study, we propose a new visualization algorithm where we augment the 2D slice of interest (SOI) from an image volume with volumetric information derived from the DVR of the same volume. Our occlusion-based DVR augmentation for SOI (ODAS) uses the occlusion information derived from the voxels in front of the SOI to calculate a depth parameter that controls the amount of DVR visibility which is used to provide 3D spatial cues while not impairing the visibility of the SOI. We outline the capabilities of our ODAS and through a variety of computer tomography (CT) medical image examples, compare it to a conventional fusion of the SOI and the clipped DVR.

Keywords

E1MTCD_2018_v5n1_35_f0001.png 이미지

Fig. 1. Conventional direct volume rendering (DVR) of a patient study with a lung carcinoma in the left upper lobe of the lung. A TFdesigned to reveal the lung carcinoma is applied. (a) shows a quadrant view of a multi-planar reformatting (MPR) together with a DVR(bottom-right); (b) shows a DVR fused with a slice of interest (SOI) set to the same coronal view as in the MPR; (c) shows our proposedocclusion-based DVR augmentation for SOI (ODAS) which augments the 3D spatial cues from the DVR while preserving the visibilityof the SOI.

E1MTCD_2018_v5n1_35_f0002.png 이미지

Fig. 2. An overview of the processes involved in ODAS algorithm using a chest CT volume as an example.

E1MTCD_2018_v5n1_35_f0003.png 이미지

Fig. 3. A depiction of the movement of the random view camera,V, to the center of the coronal view, V’, where all structures of theSOI is visible.

E1MTCD_2018_v5n1_35_f0004.png 이미지

Fig. 4. Occlusion-driven dynamic opacity weight curve.

E1MTCD_2018_v5n1_35_f0005.png 이미지

Fig. 5. GPU computation of the occlusion depth map and itsresulting histogram.

E1MTCD_2018_v5n1_35_f0006.png 이미지

Fig. 6. Comparative results between ODAS and DVR techniques. (a) shows a selected SOI, in the coronal view, of a CT image volumedepicting vascular structures and their related organ structures. (b) is the rendering of ODAS with automatically derived depth D = 47,and (c) is the DVR counterpart with volume clipping set to the same D. (d) and (e) are variations of the DVR set to clipping depth of ¡¾20from (c).

E1MTCD_2018_v5n1_35_f0007.png 이미지

Fig. 7. An example of the ability of ODAS to preserve the level ofvisibilities for structures that are close to the SOI when comparedto volume clipping using the same D in MPR (axial and sagittalviews, respectively of left and middle columns) as well as anarbitrary view (right column). Note the different D calculationsbased on the view-point and arrows indicating the missing vesselsthat are visible with the ODAS.

E1MTCD_2018_v5n1_35_f0008.png 이미지

Fig. 8. Results from using different percentile values on theocclusion depth histogram.

E1MTCD_2018_v5n1_35_f0009.png 이미지

Fig. 9. Slice-by-slice volume navigation with ODAS in sagittalview.

E1MTCD_2018_v5n1_35_f0010.png 이미지

Fig. 10. Applications of TF to the ODAS with 1D TF in (b) and2D TF in (c). In both of these renderings, the TFs were designedto highlight the lung nodule structure.

E1MTCD_2018_v5n1_35_f0011.png 이미지

Fig. 11. Averaged computation time for individual processes inour ODAS algorithm.

References

  1. H. Kim, J. Song, J. Chon, E. Goh, "Common crus aplasia: diagnosis by 3D volume rendering imaging using 3DFT-CISS sequence," Clin Radiol, vol. 59, no. 9, pp 830-4, 2004. https://doi.org/10.1016/j.crad.2004.01.021
  2. A. Krueger, C. Kubisch, G. Straub, B. Preim, B, "Sinus endoscopy--application of advanced GPU volume rendering for virtual endoscopy," IEEE T. Vis. Comput. Gr., vol. 14, no. 6, pp 1491-8, 2008. https://doi.org/10.1109/TVCG.2008.161
  3. J. Georgii, M. Eder, L. Kovacs, A. Schneider, M. Dobritz, R. Westermann, "Advanced volume rendering for surgical training environments," in Proceedings of the 21st CARS, Chicago, 2007.
  4. B. Preim, D. Bartz, "Visualization in medicine theory, algorithms, and application," Morgan Kaufmann Series in Computer Graphics, 2007.
  5. H. Pfister, "The transfer function bake-off," IEEE T. Vis. Comput. Gr., vol. 21, no.3, pp 16-22, 2001. https://doi.org/10.1109/38.920623
  6. J. Kniss, G. Kindlmann, C. Hansen, "Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets," in Proceedings of IEEE Visualization, San Diego, 2001.
  7. C.D. Correa, K. Ma, "The occlusion spectrum for volume classification and visualization," IEEE T. Vis. Comput. Gr., vol. 15, no. 6, pp 1465-72, 2009 https://doi.org/10.1109/TVCG.2009.189
  8. J. Kim, W. Cai, S. Eberl, D. Feng, "Real-time volume rendering visualization of dual-modality PET/CT images with interactive fuzzy thresholding segmentation," IEEE T. Info. Tech. Biomed., vol. 11, no. 2, pp 161-9, 2007. https://doi.org/10.1109/TITB.2006.875669
  9. C.D. Correa, K. Ma, "Visibility histograms and visibility-driven transfer functions," IEEE T. Vis. Comput. Gr., vol. 17, no. 2, pp 192-204, 2011. https://doi.org/10.1109/TVCG.2010.35
  10. Y. Jung, J. Kim, S. Eberl, M. Fulham, D. Feng, "Visibility-driven PET-CT visualisation with region of interest (ROI) segmentation," VISUAL COMPUT., vol. 29, no. 6-8, pp 805-15, 2013. https://doi.org/10.1007/s00371-013-0833-1
  11. J. Wallis, T. Miller, C. Lerner, E. Kleerup, "Three-dimensional display in nuclear medicine," IEEE Trans Med Imaging, vol. 8, no. 4, pp 297-303, 1989. https://doi.org/10.1109/42.41482
  12. W. Heidrich, M. Mccool, J. Stevens, "Interactive Maximum Projection Volume Rendering," in Proceedings of IEEE Visualization, Atlanta, 1995.
  13. Y. Sato, N. Shiraga, S. Nakajima, S., Tamura, R. Kikinis, "Local maximum intensity projection (LMIP): a new rendering method for vascular visualization," J Comput Assist Tomogr., vol. 22, no. 6, 1998.
  14. S. Bruckner, M.E. Groller, "Instant Volume Visualization using Maximum Intensity Difference Accumulation," COMPUT GRAPH FORUM., vol. 28, no. 3, pp 775-782, 2009. https://doi.org/10.1111/j.1467-8659.2009.01474.x
  15. S. Marchesin, J.M. Dischler, C. Mongenet, "Per-pixel opacity modulation for feature enhancement in volume rendering," IEEE T. Vis. Comput. Gr., vol. 16, no. 4, pp 57-70, 2010. https://doi.org/10.1109/TVCG.2009.60
  16. B. Tang, Z. Zhou, H. Lin, "Depth-based Feature Enhancement for Volume Visualization," in Proceedings of CAD/Graphics, Jinan, 2011.
  17. J. Horiguchi, M. Ishifuro, H. Fukuda, Y. Akiyama, K. Ito, "Multiplanar reformat and volume rendering of a multidetector CT scan for path planning a fluoroscopic procedure on Gasserian ganglion block-a preliminary report." Eur J Radiol., vol. 53, no. 2, pp 189-91, 2005. https://doi.org/10.1016/j.ejrad.2004.04.009
  18. PT. Johnson, K.M. Horton, E.K. Fishman, "Nonvascular mesenteric disease: utility of multidetector CT with 3D volume rendering," Radiographics., vol. 29, no. 3, pp 721-40, 2009. https://doi.org/10.1148/rg.293085113
  19. P. Kohlmann, S. Bruckner, A. Kanitsar, M.E. Groller, "Contextual picking of volumetric structures," in Proceedings of IEE Pacific Visualization Symposium., Beijing, 2009.
  20. A. Weibel, F.M. Frans, D. Foerster, H.C. Hege, "WYSIWYP: What You See Is What You Pick," IEEE T. Vis. Comput. Gr., vol. 18, no. 12, pp 2236-44, 2012. https://doi.org/10.1109/TVCG.2012.292
  21. I. Viola, A. Kanitsar, M. Eduard, "Importance-driven feature enhancement in volume visualization," IEEE T. Vis. Comput. Gr., vol. 11, no. 4, pp 408-18, 2005. https://doi.org/10.1109/TVCG.2005.62
  22. M. Burns, M. Haidacher, W. Wein, I. Viola, M.E. Groller, "Feature Emphasis and Contextual Cutaways for Multimodal Medical Visualization," in Proceedings of Eurographics, Prague, 2007.
  23. R.H. Hyndman, Y. Fan, "Sample quantiles in statistical packages," The American Statistician., vol. 50, no. 4, pp 361-5, 1996.
  24. J. Stefanie, B. Rens, H. Jennifer, "Probabilistic Linguistics," MIT Press, 2003
  25. Voreen: Volume Rendering Engine, https://www.uni-muenster.de/Voreen/, 2018.
  26. T. Scheuermann, J. Hensley, "Efficient histogram generation using scattering on GPUs," in Proceedings of Interactive 3D graphics and games, Seattle, 2007
  27. Osirix, http://www.osirix-viewer.com/datasets/, 2018
  28. LIDC, http://imaging.cancer.gov/, 2018.