KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Spatial Multilevel Optical Flow Architecture-based Dynamic Motion Estimation in Vehicular Traffic Scenarios

  • Fuentes, Alvaro (Department of Electronics Engineering, Chonbuk National University) ;
  • Yoon, Sook (Department of Computer Engineering, Mokpo National University) ;
  • Park, Dong Sun (Department of Electronics Engineering, Chonbuk National University)
  • Received : 2017.07.27
  • Accepted : 2018.06.25
  • Published : 2018.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Pedestrian detection is a challenging area in the intelligent vehicles domain. During the last years, many works have been proposed to efficiently detect motion in images. However, the problem becomes more complex when it comes to detecting moving areas while the vehicle is also moving. This paper presents a variational optical flow-based method for motion estimation in vehicular traffic scenarios. We introduce a framework for detecting motion areas with small and large displacements by computing optical flow using a multilevel architecture. The flow field is estimated at the shortest level and then successively computed until the largest level. We include a filtering parameter and a warping process using bicubic interpolation to combine the intermediate flow fields computed at each level during optimization to gain better performance. Furthermore, we find that by including a penalization function, our system is able to effectively reduce the presence of outliers and deal with all expected circumstances in real scenes. Experimental results are performed on various image sequences from Daimler Pedestrian Dataset that includes urban traffic scenarios. Our evaluation demonstrates that despite the complexity of the evaluated scenes, the motion areas with both moving and static camera can be effectively identified.

Keywords

References

  1. M. Enzweiler, and D. Gavrila, "Monocular Pedestrian Detection: Survey and Experiments," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 31, no. 12, pp. 2179-2195, Dec., 2009. https://doi.org/10.1109/TPAMI.2008.260
  2. D. Zamalieva, and A. Yilmaz, "Background subtraction for moving camera. A geometric approach," Computer Vision and Image Understanding, vol. 127, pp. 73-85, Oct., 2014. https://doi.org/10.1016/j.cviu.2014.06.007
  3. C. Keller, M. Enzweiler, M. Rohrbach, D. Fernandez Llorca, C. Schnorr, and D. Gavrila, "The Benefits of Dense Stereo for Pedestrian Detection," IEEE Transactions on Intelligent Transportation Systems, vol. 12, no. 4, Dec., 2011.
  4. A. Talukder, and L. Matthies, "Real-time detection of moving objects from moving vehicles using dense stereo and optical flow," in Proc. of the IEEE Int. Conf. on Intelligent Robots and Systems, vol. 4, pp. 3718-3725, Oct., 2004.
  5. J. Nascimento, and J. Marques, "Performance evaluation of object detection algorithms for video surveillance," IEEE Transactions on Multimedia, vol. 8, no. 4, pp. 761-774, Jul., 2006. https://doi.org/10.1109/TMM.2006.876287
  6. P. Viola, and M. Jones, "Robust real-time face detection," International Journal of Computer Vision, vol 57, no. 2, pp. 137-154, May, 2004. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  7. D. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, Nov., 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  8. N. Dalal, and B. Trigs, "Histograms of Oriented Gradients for Human Detection," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, Jul., 2005.
  9. P. Viola, M. Jones, and D. Snow, "Detecting Pedestrians using patterns of motion and appearance," International Journal of Computer Vision, vol 63, no. 2, pp. 153-161, Jul., 2005. https://doi.org/10.1007/s11263-005-6644-8
  10. C. Wojek, and B. Schiele, "A performance evaluation of single and multi-feature people detection," DAGM Symposium for Pattern Recognition, pp. 82-91, 2008.
  11. S. Walk, N. Majer, K. Schindler, and B. Schiele, "New features and insights for pedestrian detection," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, Aug., 2010.
  12. P. Dollar, C. Wojek, B. Schiele, and P. Perona, "Pedestrian Detection: An Evaluation of the State of the Art," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol 34, no. 4, pp.734-761, Aug., 2011.
  13. S. Munder, and D. Gavrila, "An Experimental Study on Pedestrian Classification," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp.1863-1868, Sept., 2006. https://doi.org/10.1109/TPAMI.2006.217
  14. D. Geronimo, A. Lopez. A. Sappa, and T. Graf, "Survey of Pedestrian Detection for Advanced Driver Assistance Systems," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 7, pp. 1239-1258, May, 2009. https://doi.org/10.1109/TPAMI.2009.122
  15. B. Horn, and B. Schunk, "Determining Optical Flow," Artificial Intelligence, vol. 17, no.1-3, pp. 185-203, Aug., 1981. https://doi.org/10.1016/0004-3702(81)90024-2
  16. M. Shah, "Fundamentals of Computer Vision," Computer Sciences Department, University of Central Florida, 1997.
  17. B. Lucas, and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," in Proc. of the International Joint Conference on Artificial Intelligence, vol. 2, pp. 674-679, Aug., 1981.
  18. A. Garcia-Dopico, J. Pedraza, M. Nieto, A. Perez, and S. Rodriguez, "Locating moving objects in car-driving sequences," EURASIP Journal on Image and Video Processing, Dec., 2014.
  19. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "High accuracy optical flow estimation based on a theory for warping," in Proc. of the European Conference on Computer Vision, vol. 3024, pp. 25-36, 2004.
  20. S. Tamgade, and V. Bora, "Motion Estimation of Video Image by Pyramidal Implementation of Lukas-Kanade Optical Flow," in Proc. of the International Conference on Emerging Trends in Engineering and Technology (ICETET), Dec., 2009.
  21. A. Doshi, and A. Bors, "Smoothing of optical flow using robustified diffusion kernels," Image and Vision Computing, vol. 28, no. 12, pp. 1575-1589, Dec., 2010. https://doi.org/10.1016/j.imavis.2010.04.001
  22. H. Liu, T. Hong, M. Herman, T. Camus, and R. Chellappa, "Accuracy vs. Efficiency Trade-offs in Optical Flow Algorithms," Computer Vision and Image Understanding, vol. 72, no. 3, pp. 271-286, Dec. 1998. https://doi.org/10.1006/cviu.1998.0675
  23. J. Sanchez, E. Meinhardt-Llopis, and G. Facciolo, "TV-L1 Optical Flow Estimation," Image Processing On Line (IPOL), vol. 3, pp. 137-150, Sept., 2013. https://doi.org/10.5201/ipol.2013.26
  24. S. Zhang, C. Bauckhage, D. Klein, and A. Cremers, "Moving Pedestrian Detection Based on Motion Segmentation," in Proc. of IEEE Workshop on Robovision, 2013.
  25. A. Bruhn, J. Weickert, and C. Schnorr, "Lukas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods," International Journal of Computer Vision, vol. 6, no. 3, pp. 211-231, Feb., 2005.
  26. T. Brox, C. Bregler, and J. Malik, "Large Displacement Optical Flow," in Proc. of the IEEE International Conference on Computer Vision and Pattern Recognition, Jun., 2009.
  27. E. Meinhardt-Llopis, J. Sanchez, and D. Kondermann, "Horn-Schunck Optical Flow with a Multi-Scale Strategy," Image Processing On Line (IPOL), pp. 151-172, Jul., 2013.
  28. T. Brox, A. Bruhn, N. Pappenber, and J. Weickert, "High Accuracy Optical Flow Estimation Based on the Theory of Warping," in Proc. of the European Conference on Computer Vision, vol. 4, pp. 25-36, 2004.
  29. F. Steinbrucker, T. Pock, and D. Cremers, "Large Displacement Optical Flow Computation without Warping," in Proc. of the International Conference on Computer Vision, 2009.
  30. L. Xu, J. Jia, and Y. Matsushita, "Motion Detail Preserving Optical Flow Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 9, Sept., 2012.
  31. P. Weinzaepfel, J. Revaud, Z. Harchaoui, and C. Schmid, "DeepFlow: Large Displacement Optical Flow with Deep Matching," in Proc. of the ICCV - IEEE Conference on Computer Vision, pp. 1385-1392, Dec., 2013.
  32. R. Kennedy, and C. Taylor, "Optical Flow with Geometric Occlusion Estimation and Fusion of Multiple Frames," in Proc. of the International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, vol. 8932, pp. 364-377, Jan., 2015.
  33. J. Revaud, P. Weinzaepfel, Z. Harchaoui, and C. Schmid, "EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow," 2015.
  34. M. Black, and P. Anandan, "A Framework for the Robust Estimation of Optical Flow," in Proc. of the ICCV - IEEE Conference on Computer Vision, pp. 231-236, May, 1993.
  35. T. Muller, J. Rannacher, C. Rabe, and U. Franke, "Feature- and Depth-Supported Modified Total Variation Optical Flow for 3D Motion Field Estimation in real scenes," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, Aug., 2011.
  36. D. Sun, S. Roth, and M. Black, "A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them," International Journal of Computer Vision, vol. 106, no. 2, pp. 115-137, Jan., 2014. https://doi.org/10.1007/s11263-013-0644-x
  37. R. Szeliski, "Computer Vision. Algorithms and Applications," Springer, 2011.
  38. A. Fuentes, "Efficient Motion Field Estimation in Dynamic Environments based on Warping Multilevel Optical Flow," Chonbuk National University, Master Thesis, 2016.
  39. M. Black, and P. Anandan, "The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields," Computer Vision and Image Understanding, vol 63, no. 1, pp. 75-104, Jan., 1996. https://doi.org/10.1006/cviu.1996.0006
  40. S. Baker, D. Scharstein, J.P. Lewis, S. Roth, M. Black, and R. Szeliski, "A Database and Evaluation Methodology for Optical Flow," International Journal on Computer Vision, vol. 92, no. 1, pp. 1-31, Mar., 2011. https://doi.org/10.1007/s11263-010-0390-2