ETRI Journal

  • 제32권5호
  • /
  • Pages.750-760
  • /
  • 2010
  • /
  • 1225-6463(pISSN)
  • /
  • 2233-7326(eISSN)
한국전자통신연구원 (Electronics and Telecommunications Research Institute)
권호 표지
DOI QR코드

DOI QR Code

Clausius Normalized Field-Based Stereo Matching for Uncalibrated Image Sequences

  • Koh, Eun-Jin (Software Research Laboratory, ETRI, University of Science and Technology) ;
  • Lee, Jae-Yeon (IT Convergence Technology Research Laboratory, ETRI) ;
  • Park, Jun-Seok (Software Research Laboratory, ETRI)
  • 투고 : 2010.03.15
  • 심사 : 2010.08.02
  • 발행 : 2010.10.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

We propose a homology between thermodynamic systems and images for the treatment of time-varying imagery. A physical system colder than its surroundings absorbs heat from the surroundings. Furthermore, the absorbed heat increases the entropy of the system, which is closely related to its disorder as given by the definition of Clausius and Boltzmann. Because pixels of an image are viewed as a state of lattice-like molecules in a thermodynamic system, the task of reckoning the entropy variations of pixels is similar to estimating their degrees of disorder. We apply this homology to the uncalibrated stereo matching problem. The absence of calibrations alleviates user efforts to install stereo cameras and enables users to freely modify the composition of the cameras. The proposed method is also robust to differences in brightness, white balancing, and even focusing between stereo image pairs. These peculiarities enable users to estimate the depths of interesting objects in practical applications without much effort in order to set and maintain a stereo vision setup. Users can consequently utilize two webcams as a stereo camera.

키워드

참고문헌

  1. S.J. Krotosky and M.M. Trivedi, "Person Surveillance Using Visual and Infrared Imagery," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 8, Aug. 2008, pp. 1096-1105. https://doi.org/10.1109/TCSVT.2008.928217
  2. R. Anchini et al., "A Comparison Between Stereo-Vision Techniques for the Reconstruction of 3-D Coordinates of Objects," IEEE Trans. Instrum. Meas., vol. 55, no. 5, Oct. 2006, pp. 1459-1466. https://doi.org/10.1109/TIM.2006.881034
  3. Y. Matsumoto and A. Zelinsky, "An Algorithm for Real-Time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement," Autom. Face Gesture Recognition, 2000. pp. 499- 504.
  4. J.I. Park et al., "Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV," ETRI J., vol. 26, no. 6, Dec. 2004, pp. 597-604. https://doi.org/10.4218/etrij.04.0603.0024
  5. A. Smolic and P. Kauff, "Interactive 3-D Video Representation and Coding Technologies," IEEE Proc., vol. 93, no. 1, 2005, pp. 98-110. https://doi.org/10.1109/JPROC.2004.839608
  6. C.D. Castillo and D.W. Jacobs, "Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose," IEEE Trans. PAMI, vol. 31, no. 12, Dec. 2009, pp. 2298- 2304. https://doi.org/10.1109/TPAMI.2009.123
  7. Y.V. Venkatesh, S.K. Raja, and A.J. Kumar, "On the Application of a Modified Self-Organizing Neural Network to Estimate Stereo Disparity," IEEE Trans. Image Process., vol. 16, no. 11, 2007, pp. 2822-2829. https://doi.org/10.1109/TIP.2007.906772
  8. L.H. Liu and P. Bhattacharya, "Uncalibrated Stereo Matching Using DWT," ICPR, 2000, pp. 114-118.
  9. J. Zhow, Y. Xu, and X. Yang, "Quaternion Wavelet Phase based Stereo Matching for Uncalibrated Images," Patt. Recog. Lett., vol. 28, no. 12, Mar. 2007, pp. 1509-1522. https://doi.org/10.1016/j.patrec.2007.03.009
  10. W. Li, C.H. Leung, and Y.S. Hung, "Matching of Uncalibrated Stereo Images by Elastic Deformation," Int. J. Imaging Syst. Technol., vol. 14, no. 5, Mar. 2005, pp. 198-205.
  11. S.D. Cochran and G. Medioni, "3-D Surface Description from Binocular Stereo," IEEE Trans. PAMI, vol. 14, no. 10, 1992, pp. 981-994. https://doi.org/10.1109/34.159902
  12. P. Premaratne and F. Safaei, "Feature Based Stereo Correspondence Using Moment Invariant," Proc. IEEE Int. Conf. Inf. Automation for Sustainability, 2008, pp.104-108.
  13. D. Scharstein and C. Pal, "Learning Conditional Random Fields for Stereo," CVPR, 2007, pp. 1-8.
  14. R. Gherardi et al., "Optimal Parameter Estimation for MRF Stereo Matching," ICIAP, LNCS 3617, 2005, pp. 818-825.
  15. L. Zhang and S.M. Seitz, "Parameter Estimation for MRF Stereo," CVPR, vol. 2, 2005, pp. 288-295.
  16. J. Sun, H.Y. Shum, and N.N. Zheng, "Stereo Matching Using Belief Propagation," ECCV, LNCS 2351, 2002, pp. 510-524.
  17. S. Geman and D. Geman, "Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images," IEEE Trans. PAMI, vol. 6, no. 6, 1984, pp. 721-741.
  18. J. Lafferty, A. McCallum, and F. Pereira, "Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data," ICML, 2001, pp. 282-289.
  19. S Kirkpatrick, C.D. Gelatt, Jr., M.P. Vecchi, "Optimization by Simulated Annealing," Science, vol. 220, no. 4598, 1983, pp. 671-680. https://doi.org/10.1126/science.220.4598.671
  20. S. Della Pietra, V. Della Pietra, and J. Lafferty, "Inducing Features of Random Fields," IEEE Trans. PAMI, vol. 19, no. 4, 1997, pp. 380-393. https://doi.org/10.1109/34.588021
  21. L. Boltzmann, Lectures on Gas Theory, trans. S.G. Brush, New York: Perfamon Press, 1995. Available: http://openlibrary.org /books/OL1115209M/Lectures_on_gas_theory
  22. J. Daintith, Oxford Dictionary of Physics, Oxford University Press, 2005.
  23. P. Pierre, A to Z of Thermodynamics, Oxford University Press, 1998.
  24. J. Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm." Available: http://robots.stanford.edu/cs223b04/algo_tracking.pdf.
  25. J. Migdal and W.E.L. Grimson, "Background Subtraction using Markov Thresholds," WACV/MOTION, 2005, pp. 58-65.
  26. Alan C. Bovik, Handbook of Image and Video Processing, Academic Press, 2000.
  27. H. Chang, Inventing Temperature: Measurement and Scientific Progress, Oxford University Press, 2004.
  28. Herbert B. Callen, Thermodynamics and an Introduction to Thermostatistics, 2nd ed., New York: John Wiley & Sons, ISBN 0-471-86256-8, 1985.
  29. C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Technical Report CMU-CS-91-132, 1991.
  30. Middlebury Stereo Vision Page. Available: http://vision.middlebury.edu/stereo
  31. Barrel Distortion. Available: http://ptgrey.com/products/stereo.asp
  32. Bumblebee2 Camera. Available: http://en.wikipedia.org/wiki/Distortion_(optics)

피인용 문헌

  1. High-Quality Stereo Depth Map Generation Using Infrared Pattern Projection vol.35, pp.6, 2013, https://doi.org/10.4218/etrij.13.2013.0052
  2. Clausius Normalized Field-Based Shape-Independent Motion Segmentation vol.ed97, pp.5, 2010, https://doi.org/10.1587/transinf.e97.d.1254