A Ubiquitous Vision System based on the Identified Contract Net Protocol

Identified Contract Net 프로토콜 기반의 유비쿼터스 시각시스템

  • 김치호 (연세대학교 전기전자공학과) ;
  • 유범재 (한국과학기술연구원 지능로봇연구센터) ;
  • 김학배 (연세대학교 전기전자공학과)
  • Published : 2005.10.01

Abstract

In this paper, a new protocol-based approach was proposed for development of a ubiquitous vision system. It is possible to apply the approach by regarding the ubiquitous vision system as a multiagent system. Thus, each vision sensor can be regarded as an agent (vision agent). Each vision agent independently performs exact segmentation for a target by color and motion information, visual tracking for multiple targets in real-time, and location estimation by a simple perspective transform. Matching problem for the identity of a target during handover between vision agents is solved by the Identified Contract Net (ICN) protocol implemented for the protocol-based approach. The protocol-based approach by the ICN protocol is independent of the number of vision agents and moreover the approach doesn't need calibration and overlapped region between vision agents. Therefore, the ICN protocol raises speed, scalability, and modularity of the system. The protocol-based approach was successfully applied for our ubiquitous vision system and operated well through several experiments.

Keywords

References

  1. Cheng,H.D., Jiang,X.H., Sun,Y., and Wang,J., 'Color Image Segmentation: Advances and Prospects' , Pattern Recognition, vol. 34., pp. 2259-2281, 2001 https://doi.org/10.1016/S0031-3203(00)00149-7
  2. Cai.J. and Gosntasby.A, 'Detecting Human Faces in Color Images', Image and Vision Computing, vol. 18, pp. 63-75, 1999 https://doi.org/10.1016/S0262-8856(99)00006-2
  3. Greenspan,H., Goldberger,J., and Eshet,I., 'Mixture Model for Face-color Modeling and Segmentation', Pattern Recognition Letters, vol. 22, pp. 1525-1536, 200l https://doi.org/10.1016/S0167-8655(01)00086-1
  4. Dai,Y. and Nakano,Y., 'Face-texture Model Based on SGLD and its Applications in Face Detection in a Color Scene', Pattern Recognition, vol. 29, no. 6, pp. 1007-1017, 1996 https://doi.org/10.1016/0031-3203(95)00139-5
  5. Du,Y. and Crisman.J., 'A Color Projection for Fast Generic Target Tracking', Proc. of IEEE/RSJ Int'I Conf. on Intelligent Robots and Systems, pp. 360-365, 1995 https://doi.org/10.1109/IROS.1995.525821
  6. Fieguth,P. and Terzopoulos,D., 'Color-based Tracking of Heads and Other Mobile Objects at Video Frame Rates', Proc. of IEEE Int'l Conf. on Computer Vision and Pattern Recognition, pp. 21-27, 1997 https://doi.org/10.1109/CVPR.1997.609292
  7. Yang,J. and Waibel,A., 'A Real-time Face Tracker', Proc. of IEEE Workshop on Application of Computer Vision, pp. 142-147, 1996 https://doi.org/10.1109/ACV.1996.572043
  8. Yang,J., Lu,W., and Waibel,A., 'Skin-color Modeling and Adaptation', Proc. of Asian Conf. on Computer Vision, vol. 2, pp. 687-694, 1998
  9. Fu,Z., Yang,J., Hu,W., and Tan,T., 'Mixture Clustering using Multidimensional Histograms for Skin Detection', Proc. of the 17th Int'l Conf. on Pattern Recognition, vol. 4, pp. 549-552, Aug. 23-26, 2004 https://doi.org/10.1109/ICPR.2004.1333831
  10. Caetano,T.S., Olabarriaga,S.D., and Barone,D.A.C., 'Do Mixture Models in Chromaticity Space Improve Skin Detection?', Pattern Recognition, vol. 36, pp. 3019-3021, 2003 https://doi.org/10.1016/S0031-3203(03)00116-X
  11. K. Sobottka and I. Pitas, 'Extraction of Facial Regions and Features using Color and Shape Information', IEEE Proc. Pattern Recognition, vol. III, pp.C421-C425, 1996 https://doi.org/10.1109/ICPR.1996.546982
  12. Sobottka,K. and Pitas.I., 'Segmentation and Tracking of Faces in Color Images', Proc. of the 2nd Int'l Conf. on Automatic Face and Gesture Recognition, pp. 236-241, 1996 https://doi.org/10.1109/AFGR.1996.557270
  13. Feyrer.S. and Zell.A, 'Detection, Tracking, and Pursuit of Humans with an Autonomous Mobile Robot', Proc. of IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, pp. 864-869, 1999 https://doi.org/10.1109/IROS.1999.812788
  14. Tomaz,F., Candeias,T., and Shahbaskia.H., 'Fast and Accurate Skin Segmentation in Color Images', Proc. of 1st Canadian Conf. on Computer and Robot Vision, 2004 https://doi.org/10.1109/CCCRV.2004.1301442
  15. R.-L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, 'Face detection in color images', IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 696-706, 2002 https://doi.org/10.1109/34.1000242
  16. Abdel-Mottaleb,M. and Elgammal,A., 'Face Detection in Complex Environments from Color Images', Proc. of IEEE Int'l Conf. on Image Processing, vol. 3, pp. 622-626, Kobe, Japan, 1999 https://doi.org/10.1109/ICIP.1999.817190
  17. Chen,Q., WU,H., and Yachida,M., 'Face Detection by Fuzzy Pattern Matching', Proc, of 5th Int'l Conf. on Computer Vision, pp. 591-596, Cambridge, Massachusetts, USA, 1995 https://doi.org/10.1109/ICCV.1995.466885
  18. Kawato,S. and Ohya.J., 'Real-time Detection of Nodding and Head-shaking by Directly Detecting and Tracking the between Eyes', Proc. of 4th IEEE Int'l Conf. on Automatic Face and Gesture Recognition, pp. 40-45, Grenoble, 2000 https://doi.org/10.1109/AFGR.2000.840610
  19. Shin,M.C., Chang,K.I., and Tsap,L.V., 'Does Colorspace Transformation Make Any Difference on Skin Detection?', Proc. of 6th IEEE Workshop on Application of Computer Vision, pp. 275-279, 2002 https://doi.org/10.1109/ACV.2002.1182194
  20. Jayararn.S., Schmugge.S., Shin,M.C., and Tsap.L.V., 'Effect of Colorspace Transformation, the Illuminance Component, and Color Modeling on Skin Detection', Proc. of IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2004 https://doi.org/10.1109/CVPR.2004.1315248
  21. Bergasa,L.M., Mazo,M., Gardel,A., Sotelo,M.A., and Boquete,L., 'Unsupervised and Adaptive Gaussian Skin-color Model,' Image and Vision Computing, vol. 18, pp. 987-1003, 2000 https://doi.org/10.1016/S0262-8856(00)00042-1
  22. Cho,K., Jang.J., and Hong,K., 'Adaptive Skin-color Filter', Pattern Recognition, vol. 34, pp, 1067-1073, 2001 https://doi.org/10.1016/S0031-3203(00)00034-0
  23. Soriano,M., Martinkauppi,B., Huovinen,S., and Laaksonen,M, 'Adaptive Skin color Modeling using the Skin Locus for Selecting Training Pixels', Pattern Recognition, vol. 36, pp. 681-690, 2003 https://doi.org/10.1016/S0031-3203(02)00089-4
  24. Martinkauppi,B., Soriano,M., and Pietikainen,M., 'Detection of Skin Color under Changing Illumination: a Comparative Study', Proc. of 12th Int'l Conf. on Image Analysis and Processing, Sep. 17-19, pp. 652-657, 2003 https://doi.org/10.1109/ICIAP.2003.1234124
  25. Jones,M.J. and Rehg,I.M., 'Statistical Color Models with Application to Skin Detection', Int'l Journal of Computer Vision, vol. 46, no. 1, pp. 81-96, 2002 https://doi.org/10.1023/A:1013200319198
  26. Storring,M., Andersen,H.J., and Granum,E., 'Physics-based Modeling of Human Skin Colour under Mixed Illuminants', Journal of Robotics and Autonomous Systems, vol. 35, pp. 131-142, 2001 https://doi.org/10.1016/S0921-8890(01)00122-1
  27. Martinez,A.M. and Benavente,R.. The AR Face Database. CVC Technical Report #24, June 1998