ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Skin Condition Estimation Using Mobile Handheld Camera

  • Bae, Ji-Sang (School of Electrical Engineering, Korea University) ;
  • Jeon, Jae-Ho (School of Electrical Engineering, Korea University) ;
  • Lee, Jae-Young (School of Electrical Engineering, Korea University) ;
  • Kim, Jong-Ok (School of Electrical Engineering, Korea University)
  • Received : 2015.10.29
  • Accepted : 2016.05.10
  • Published : 2016.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

The fairly recent standard of equipping mobile devices with advanced imaging sensors has opened the possibility of conveniently diagnosing skin conditions, anywhere, anytime. For this application, we attempted to estimate skin conditions from a skin image taken by a mobile handheld camera. To estimate the skin conditions, we specifically identified three skin features (pigmentation, pores, and roughness) that can be measured quantitatively from a skin image. The experimental data indicate that the existing thresholding methods are inappropriate for extracting the pigmentation and pore skin features. Thus, we propose a new line-fitting based thresholding method for skin feature detection. We thoroughly evaluated our proposed skin condition estimation method using our skin image database. The experimental results show that our proposed thresholding method can better determine the threshold leading to the most visually plausible detection, when compared to existing methods. We also confirmed that skin conditions can be feasibly estimated using a common mobile handheld camera (for example, a smartphone).

Keywords

References

  1. D. Lee and S.G. Lee, "Vision-Based Finger Action Recognition by Angle Detection and Contour Analysis," ETRI J., vol. 33, no. 3, June 2011, pp. 415-422. https://doi.org/10.4218/etrij.11.0110.0313
  2. Y.G. Kim et al., "Feature Detection and Simplification of 3D Face Data with Facial Expressions," ETRI J., vol. 34, no. 5, Oct. 2012, pp. 791-794. https://doi.org/10.4218/etrij.12.0212.0112
  3. J.J. De Dios, "Skin Color and Feature-Based Segmentation for Face Localization," Opt. Eng., vol. 46, no. 3, 2007, pp. 1-6.
  4. F. Gasparini and R. Schettini, "Skin Segmentation Using Multiple Thresholding," Proc. SPIE: Internet Imag. VII, vol. 6061, Jan. 2006, pp. 1-8.
  5. S.R. Ke et al., "Human Action Recognition Based on 3D Human Modeling and Cyclic HMMs," ETRI J., vol. 36, no. 4, Aug. 2014, pp. 662-672. https://doi.org/10.4218/etrij.14.0113.0647
  6. R.W. LeAnder et al., "Automatic Differentiation of Melanoma and Clark Nevus Skin Lesions," Proc. SPIE, vol. 6514, Mar. 2007, p. 65142V.
  7. P. Ghassemi et al., "Combination of Stokes Polarized Light Image, Roughness Metrics and Morphological Features for the Detection of Melanoma," Int. Soc. Opt. Photon., vol. 8207, Feb. 2012.
  8. Z. Ma et al., "A Review of Algorithms for Medical Segmentation and Their Applications to the Female Pelvic Cavity," Comput. Methods Biomechanics Biomed. Eng., vol. 13, no. 2, Apr. 2010, pp. 235-246. https://doi.org/10.1080/10255840903131878
  9. Z. Ma and J. Tavares, "A Novel Approach to Segment Skin Lesions in Dermoscopic Images Based on a Deformable Model," IEEE J. Biomed. Health Inform., vol. 20, no. 2, Mar. 2015, pp. 615-623. https://doi.org/10.1109/JBHI.2015.2390032
  10. M. Filho, Z. Ma, and J. Tavares, "A Review of the Quantification and Classification of Pigmented Skin Lesions: from Dedicated to Hand-Held Devices," J. Med. Syst., vol. 39, no. 11, 2015, pp. 1-12. https://doi.org/10.1007/s10916-014-0182-2
  11. H. Zhou, J.M. Rehg, and M. Chen, "Exemplar-Based Segmentation of Pigmented Skin Lesions from Dermoscopy Images," Int. Symp. Biomed. Imag., Rotterdam, Netherland, Apr. 14-17, 2010, pp. 225-228.
  12. T. Mendonca et al., "Comparison of Segmentation Methods for Automatic Diagnosis of Dermoscopy Images," Auun. Int. Conf. IEEE Eng. Med. Biol. Soc., Lyon, France, Aug. 22-26, 2007, pp. 6572-6575.
  13. Q. Wen, D. Ming, and J. Chen, "A Novel Fusion Approach for Segmentating Dermoscopy Image Based on Region Consistency," Int. Conf. Computat. Problem-solving, Jiuhai, China, Oct. 26-28, 2013, pp. 267-270.
  14. P.G. Cavalcanti, Y. Yari, and J. Scharcanski, "Pigmented Skin Lesion Segmentation on Macroscopic Images," Int. Conf. Image Vis. Comput. New Zealand, Queenstown, New Zealand, Nov. 8-9, 2010, pp. 1-7.
  15. P. Gallagher, "Smartphones Get Even Smarter Cameras [Future Visions]," IEEE Consum. Electron. Mag., vol. 1, no. 1, Jan. 2012, pp. 25-30. https://doi.org/10.1109/MCE.2011.2172076
  16. U. Lipowezhy and S. Cahen, "Automatic Freckles Detection and Retouching," IEEE Convention Electr. Electron. Eng. Israel, Eilat, Israel, Mar. 3-5, 2008, pp. 142-146.
  17. N. Otsu, "A Threshold Selection Method from Gray-Level Histogram," IEEE Trans. Syst. Man Cyvernetics, vol. 9, no. 1, Jan. 1979, pp. 62-66. https://doi.org/10.1109/TSMC.1979.4310076
  18. M. Zhao and Y. Zhao, "Skin Color Segmentation Based on Improved 2D Otsu and YCgCr," Int. Conf. Electr. Eng., Wuhan, China, June 25-27, 2010, pp. 1954-1957.
  19. J.N. Kapur, P.K. Sajoo, and A.K.C. Wong, "A New Method for Gray-Level Picture Thresholding Using the Entropy of the Histogram," Comput. Vis., Graph. Image process., vol. 29, no. 3, Mar. 1985, pp. 273-285. https://doi.org/10.1016/0734-189X(85)90125-2
  20. R. Lisano and A.K.C. Wong, "A Study into Entropy-Based Thresholding for Image Edge Detection," Proc. Vis. Interface, Quebec, Canada, May 16-19, 1995, pp. 38-44.
  21. N. Ramesh, J.H. Yoo, and I.K. Sethi, "Thresholding Based on Histogram Approximation," IEE Proc.-Vis., Image, Signal Process., vol. 142, no. 5, Oct. 1995, pp. 271-279. https://doi.org/10.1049/ip-vis:19952007
  22. D.M. Tsai, "A Fast Thresholding Selection Procedure for Multimodal and Unimodal Histograms," Pattern Recogn. Lett., vol. 16, no. 6, June 1995, pp. 653-666. https://doi.org/10.1016/0167-8655(95)80011-H
  23. H.C. Do, J.Y. You, and S.I. Chen, "Skin Color Detection through Estimation and Conversion of Illuminant Color under Various Illuminations," IEEE Trans. Consum. Electron., vol. 53, no. 3, Aug. 2007, pp. 1103-1108. https://doi.org/10.1109/TCE.2007.4341592
  24. X.N. Zhang et al., "Skin Color Enhancement Based on Favorite Skin Color in HSV Color Space," IEEE Trans. Consum. Electron., vol. 56, no. 3, Aug. 2010, pp. 1789-1793. https://doi.org/10.1109/TCE.2010.5606327
  25. A. Renyi, "On Measure of Entropy and Information," Proc. Berkeley Symp. Math. Stat. Probability, vol. 1, 1961, pp. 547-561.

Cited by

  1. Effective Pigmentation Detection using Component Image R of RGB Color Model vol.20, pp.2, 2016, https://doi.org/10.9728/dcs.2019.20.2.307
  2. Acne Detection Methods and Performance Analysis using Component Images of Various Color Spaces vol.22, pp.9, 2016, https://doi.org/10.9728/dcs.2021.22.9.1529