Browse > Article
http://dx.doi.org/10.4218/etrij.10.1510.0067

Clausius Normalized Field-Based Stereo Matching for Uncalibrated Image Sequences  

Koh, Eun-Jin (Software Research Laboratory, ETRI, University of Science and Technology)
Lee, Jae-Yeon (IT Convergence Technology Research Laboratory, ETRI)
Park, Jun-Seok (Software Research Laboratory, ETRI)
Publication Information
ETRI Journal / v.32, no.5, 2010 , pp. 750-760 More about this Journal
Abstract
We propose a homology between thermodynamic systems and images for the treatment of time-varying imagery. A physical system colder than its surroundings absorbs heat from the surroundings. Furthermore, the absorbed heat increases the entropy of the system, which is closely related to its disorder as given by the definition of Clausius and Boltzmann. Because pixels of an image are viewed as a state of lattice-like molecules in a thermodynamic system, the task of reckoning the entropy variations of pixels is similar to estimating their degrees of disorder. We apply this homology to the uncalibrated stereo matching problem. The absence of calibrations alleviates user efforts to install stereo cameras and enables users to freely modify the composition of the cameras. The proposed method is also robust to differences in brightness, white balancing, and even focusing between stereo image pairs. These peculiarities enable users to estimate the depths of interesting objects in practical applications without much effort in order to set and maintain a stereo vision setup. Users can consequently utilize two webcams as a stereo camera.
Keywords
Computer vision; uncalibrated stereo matching time-varying imagery; HCI;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
Times Cited By Web Of Science : 0  (Related Records In Web of Science)
Times Cited By SCOPUS : 2
연도 인용수 순위
1 S Kirkpatrick, C.D. Gelatt, Jr., M.P. Vecchi, "Optimization by Simulated Annealing," Science, vol. 220, no. 4598, 1983, pp. 671-680.   DOI   ScienceOn
2 S. Della Pietra, V. Della Pietra, and J. Lafferty, "Inducing Features of Random Fields," IEEE Trans. PAMI, vol. 19, no. 4, 1997, pp. 380-393.   DOI   ScienceOn
3 L. Boltzmann, Lectures on Gas Theory, trans. S.G. Brush, New York: Perfamon Press, 1995. Available: http://openlibrary.org /books/OL1115209M/Lectures_on_gas_theory
4 J. Daintith, Oxford Dictionary of Physics, Oxford University Press, 2005.
5 P. Pierre, A to Z of Thermodynamics, Oxford University Press, 1998.
6 J. Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm." Available: http://robots.stanford.edu/cs223b04/algo_tracking.pdf.
7 J. Migdal and W.E.L. Grimson, "Background Subtraction using Markov Thresholds," WACV/MOTION, 2005, pp. 58-65.
8 Alan C. Bovik, Handbook of Image and Video Processing, Academic Press, 2000.
9 H. Chang, Inventing Temperature: Measurement and Scientific Progress, Oxford University Press, 2004.
10 Herbert B. Callen, Thermodynamics and an Introduction to Thermostatistics, 2nd ed., New York: John Wiley & Sons, ISBN 0-471-86256-8, 1985.
11 C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Technical Report CMU-CS-91-132, 1991.
12 Middlebury Stereo Vision Page. Available: http://vision.middlebury.edu/stereo
13 Barrel Distortion. Available: http://ptgrey.com/products/stereo.asp
14 Bumblebee2 Camera. Available: http://en.wikipedia.org/wiki/Distortion_(optics)
15 Y.V. Venkatesh, S.K. Raja, and A.J. Kumar, "On the Application of a Modified Self-Organizing Neural Network to Estimate Stereo Disparity," IEEE Trans. Image Process., vol. 16, no. 11, 2007, pp. 2822-2829.   DOI
16 L.H. Liu and P. Bhattacharya, "Uncalibrated Stereo Matching Using DWT," ICPR, 2000, pp. 114-118.
17 J. Zhow, Y. Xu, and X. Yang, "Quaternion Wavelet Phase based Stereo Matching for Uncalibrated Images," Patt. Recog. Lett., vol. 28, no. 12, Mar. 2007, pp. 1509-1522.   DOI   ScienceOn
18 P. Premaratne and F. Safaei, "Feature Based Stereo Correspondence Using Moment Invariant," Proc. IEEE Int. Conf. Inf. Automation for Sustainability, 2008, pp.104-108.
19 W. Li, C.H. Leung, and Y.S. Hung, "Matching of Uncalibrated Stereo Images by Elastic Deformation," Int. J. Imaging Syst. Technol., vol. 14, no. 5, Mar. 2005, pp. 198-205.
20 S.D. Cochran and G. Medioni, "3-D Surface Description from Binocular Stereo," IEEE Trans. PAMI, vol. 14, no. 10, 1992, pp. 981-994.   DOI   ScienceOn
21 D. Scharstein and C. Pal, "Learning Conditional Random Fields for Stereo," CVPR, 2007, pp. 1-8.
22 R. Gherardi et al., "Optimal Parameter Estimation for MRF Stereo Matching," ICIAP, LNCS 3617, 2005, pp. 818-825.
23 L. Zhang and S.M. Seitz, "Parameter Estimation for MRF Stereo," CVPR, vol. 2, 2005, pp. 288-295.
24 J. Sun, H.Y. Shum, and N.N. Zheng, "Stereo Matching Using Belief Propagation," ECCV, LNCS 2351, 2002, pp. 510-524.
25 S. Geman and D. Geman, "Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images," IEEE Trans. PAMI, vol. 6, no. 6, 1984, pp. 721-741.
26 J. Lafferty, A. McCallum, and F. Pereira, "Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data," ICML, 2001, pp. 282-289.
27 J.I. Park et al., "Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV," ETRI J., vol. 26, no. 6, Dec. 2004, pp. 597-604.   과학기술학회마을   DOI   ScienceOn
28 S.J. Krotosky and M.M. Trivedi, "Person Surveillance Using Visual and Infrared Imagery," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 8, Aug. 2008, pp. 1096-1105.   DOI
29 R. Anchini et al., "A Comparison Between Stereo-Vision Techniques for the Reconstruction of 3-D Coordinates of Objects," IEEE Trans. Instrum. Meas., vol. 55, no. 5, Oct. 2006, pp. 1459-1466.   DOI   ScienceOn
30 Y. Matsumoto and A. Zelinsky, "An Algorithm for Real-Time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement," Autom. Face Gesture Recognition, 2000. pp. 499- 504.
31 A. Smolic and P. Kauff, "Interactive 3-D Video Representation and Coding Technologies," IEEE Proc., vol. 93, no. 1, 2005, pp. 98-110.   DOI
32 C.D. Castillo and D.W. Jacobs, "Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose," IEEE Trans. PAMI, vol. 31, no. 12, Dec. 2009, pp. 2298- 2304.   DOI