한국콘텐츠학회논문지 (The Journal of the Korea Contents Association)

  • 제14권12호
  • /
  • Pages.545-554
  • /
  • 2014
  • /
  • 1598-4877(pISSN)
  • /
  • 2508-6723(eISSN)
한국콘텐츠학회 (The Korea Contents Association)
권호 표지
DOI QR코드

DOI QR Code

깊이 영상 기반 적응적 체인 코드를 이용한 한자 학습 시스템

Depth Image based Chinese Learning Machine System Using Adjusted Chain Code

  • 투고 : 2014.09.26
  • 심사 : 2014.12.08
  • 발행 : 2014.12.28
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 깊이 카메라를 이용한 실시간 사용자 한자 학습 시스템을 제안한다. 사용자 학습 방법으로는 사용자가 화면에서 손을 움직여 한자를 입력하고, 입력 제스처와 미리 저장된 템플릿을 매칭하여 사용자가 한자를 올바르게 썼는지 판단한다. 이를 위해 본 논문에서는 손가락 검출 및 검증을 통한 손 영역 검출 및 추적 방법과 스트로크의 연속성을 분석하기 위해 적응적 체인 코드를 제안한다. 손가락 검출로는 깊이 값을 이용하여 손 영역을 검출 후, 손가락의 축을 생성, 손가락의 두께를 이용하여 검증한다. 손 영역 추적으로 생성된 스트로크는 추적된 점들과 순서 그리고 길이 정보가 포함되어 있다. 이들을 이용하여 사용자가 올바른 입력을 했는지 확인하기 위해 적응적 체인 코드 방법을 제안한다. 이 방법은 매칭 속도와 스트로크 안에서 잘못 입력된 부분을 찾는데 매우 효율적이다. 실험 결과에서는 본 논문에서 제안한 시스템이 실시간으로 동작하며 학습 과정과 오류 검출에 매우 효과적임을 보여준다.

In this paper, we propose online Chinese character learning machine with a depth camera, where a system presents a Chinese character on a screen and a user is supposed to draw the presented Chinese character by his or her hand gesture. We develop the hand tracking method and suggest the adjusted chain code to represent constituent strokes of a Chinese character. For hand tracking, a fingertip is detected and verified. The adjusted chain code is designed to contain the information on order and relative length of each constituent stroke as well as the information on the directional variation of sample points. Such information is very efficient for a real-time match process and checking incorrectly drawn parts of a stroke.

키워드

참고문헌

  1. Robert J. Elliott, Lakhdar Aggoun, and John B. Moore, Hidden Markov Models, Springer, 1995.
  2. M. Muller, "Dynamic time warping," Information retrieval for music and motion, pp.69-84, 2007.
  3. T. Starner and Alex Pentland, "Real-time american sign language recognition from video using hidden markov models," Motion-Based Recognition, Springer Netherlands, pp.227-243, 1997.
  4. A. Corradini, "Dynamic time warping for off-line recognition of a small gesture vocabulary," Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 2001, Proceedings. IEEE ICCV Workshop on. IEEE, 2001.
  5. G. A. Ten Holt, M. J. T. Reinders, and E. A. Hendriks, "Multi-dimensional dynamic time warping for gesture recognition," Thirteenth annual conference of the Advanced School for Computing and Imaging, Vol.119, 2007.
  6. J. O. Wobbrock, A. D. Wilson, and Y. Li, "Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes," Proceedings of the 20th annual ACM symposium on User interface software and technology, ACM, 2007.
  7. L. Anthony and J. O. Wobbrock, "$N-Protractor: A fast and accurate multistroke recognizer," Proceedings of Graphics Interface (GI '12), Toronto, Ontario, Toronto, Ontario: Canadian Information Processing Society, pp.117-120, 2012.
  8. Vatavu, Radu-Daniel, Lisa Anthony, and Jacob O. Wobbrock, "Gestures as point clouds: a $ P recognizer for user interface prototypes," Proceedings of the 14th ACM international conference on Multimodal interaction, ACM, 2012.
  9. Y. Li, Protractor: A fast and accurate gesture recognizer, Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '10). Atlanta, Georgia (April 10-15, 2010), New York: ACM Press, pp.2169-2172, 2010.
  10. L. Anthony and J. O. Wobbrock, A lightweight multistroke recognizer for user interface prototypes, Proceedings of Graphics Interface (GI '10), Ottawa, Ontario (May 31-June 2, 2010), Toronto, Ontario: Canadian Information Processing Society, pp.245-252, 2010.
  11. Mitra, Sushmita and Tinku Acharya, "Gesture recognition: A survey," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on 37.3, pp.311-324, 2007. https://doi.org/10.1109/TSMCC.2007.893280
  12. Y. Wu and T. S. Huang, "Vision-based gesture recognition: A review," Gesture-based communication in human-computer interaction, Springer Berlin Heidelberg, pp.103-115, 1999.
  13. H. K. Lee and J. H. Kim, "An HMM-based threshold model approach for gesture recognition," Pattern Analysis and Machine Intelligence, IEEE Transactions on 21.10. pp.961-973, 1999. https://doi.org/10.1109/34.799904