KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

A new framework for Person Re-identification: Integrated level feature pattern (ILEP)

  • Manimaran, V. (Department of Information Technology, National Engineering College) ;
  • Srinivasagan, K.G. (Department of Information Technology, National Engineering College) ;
  • Gokul, S. (Language Science and Technology, SaarlandUniversity) ;
  • Jacob, I.Jeena (Department of Computer Science and Engineering, Gitam University) ;
  • Baburenagarajan, S. (Department of Computer Science and Engineering, PET Engineering College)
  • Received : 2021.07.20
  • Accepted : 2021.09.23
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The system for re-identifying persons is used to find and verify the persons crossing through different spots using various cameras. Much research has been done to re-identify the person by utilising features with deep-learned or hand-crafted information. Deep learning techniques segregate and analyse the features of their layers in various forms, and the output is complex feature vectors. This paper proposes a distinctive framework called Integrated Level Feature Pattern (ILFP) framework, which integrates local and global features. A new deep learning architecture named modified XceptionNet (m-XceptionNet) is also proposed in this work, which extracts the global features effectively with lesser complexity. The proposed framework gives better performance in Rank1 metric for Market1501 (96.15%), CUHK03 (82.29%) and the newly created NEC01 (96.66%) datasets than the existing works. The mean Average Precision (mAP) calculated using the proposed framework gives 92%, 85% and 98%, respectively, for the same datasets.

Keywords

References

  1. A. Plantinga, "Things and persons," The Review of Metaphysics, vol.14, no.3, pp. 493-519, 1961.
  2. N. B. Cocchiarella, "Sortals, natural kinds and re-identification," Logique et analyse, vol. 20, pp. 439-474, 1977.
  3. A. O. Rorty, "The transformations of persons," Philosophy, vol. 48, no. 185, pp. 261-275, 1973. https://doi.org/10.1017/S0031819100042753
  4. S. Gong, M. Cristani, S. Yan, and C. C. Loy, Person reidentification, Springer, 2014.
  5. F. Mamalet and C. Garcia, "Simplifying ConvNets for Fast Learning," in Proc. of International Conference on Artificial Neural Networks, Springer, pp. 58-65, 2012.
  6. J. Berclaz, F. Fleuret, and P. Fua, "Multi-camera tracking and atypical motion detection with behavioral maps," in Proc. of 10th European Conference on Computer Vision, pp. 112-125, 2008.
  7. X. Wang, K. Tieu, and W. Grimson, "Correspondencefree multi-camera activity analysis and scene modelling," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2008.
  8. X. Wang, K. T. Ma, G.-W. Ng, and W. E. L. Grimson, "Trajectory analysis and semantic region modeling using a nonparametric bayesian model," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2008.
  9. W. Ge and R. T. Collins, "Marked point processes for crowd counting," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2009.
  10. A. Chan and N. Vasconcelos, "Bayesian poisson regression for crowd counting," in Proc. of IEEE 12th International Conference on Computer Vision, pp. 545-551, 2009.
  11. D. Gray and H. Tao, "Viewpoint invariant pedestrian recognition with an ensemble of localised features," in Proc. of 10th European Conference on Computer Vision, pp. 262-275, 2008.
  12. M. Farenzena, L. Bazzani, A. Perina, V. Murino, and M. Cristani, "Person reidentification by symmetry-driven accumulation of local features," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010.
  13. S. Liao, Y. Hu, X. Zhu, and S. Z. Li, "Person reidentification by local maximal occurrence representation and metric learning," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2015.
  14. R. Zhao, W. Ouyang, and X. Wang, "Learning mid-level filters for person reidentification," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2014.
  15. I. Kviatkovsky, A. Adam, and E. Rivlin, "Color invariants for person reidentification," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, pp. 1622-1634, July 2013. https://doi.org/10.1109/TPAMI.2012.246
  16. L. Ma, X. Yang, and D. Tao, "Person reidentification overcamera networks using multi-task distance metric learning," IEEE Transactions on Image Processing, vol.23, pp.3656-3670, August 2014. https://doi.org/10.1109/TIP.2014.2331755
  17. Z. Li, S. Chang, F. Liang, T. S. Huang, L. Cao, and J. R. Smith, "Learning locally-adaptive decision functions for person verification," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2013.
  18. W.-S. Zheng, S. Gong, and T. Xiang, "Reidentification by relative distance comparison," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 3, pp. 653-668, 2013. https://doi.org/10.1109/TPAMI.2012.138
  19. M. Koestinger, M. Hirzer, P. Wohlhart, P. M. Roth, and H. Bischof, "Large scale metric learning from equivalence constraints," in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2012.
  20. R. Zhao, W. Ouyang, and X. Wang, "Person reidentification by salience matching," in Proc. of 2013 IEEE International Conference on Computer Vision, 2013..
  21. G. Lisanti, I. Masi, A. Bagdanov, and A. D. Bimbo, "Person reidentification by iterative re-weighted sparse ranking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, pp. 1629-1642, August 2015. https://doi.org/10.1109/TPAMI.2014.2369055
  22. S. Khamis, C. Kuo, V. Singh, V. Shet, and L. Davis, "Joint learning for attribute-consistent person reidentification," in Proc. of European Conference on Computer Vision workshop, pp 134-146, 2014.
  23. F. Xiong, M. Gou, O. Camps, and M. Sznaier, "Person reidentification using kernel-based metric learning methods," in Proc. of European Conference on Computer Vision workshop, pp 1-16, 2014.
  24. Z. Zhang, Y. Chen, and V. Saligram, "A novel visual word co-occurrence model for person reidentification," in Proc. of European Conference on Computer Vision workshop, pp 122-133, 2014.
  25. Rui, Y, Huang, T and Chang, S, "Image Retrieval: Current Techniques, Promising Directions and Open Issues," Journal of Visual Communication and Image Representation, vol. 10, pp.39-62, March1999. https://doi.org/10.1006/jvci.1999.0413
  26. Michael J. Swain and Dana H. Ballard, "Colour indexing," International Journal on Computer Vision, vol. 7, pp. 11-32, Novemeber1991. https://doi.org/10.1007/BF00130487
  27. Gevers, T and Stokman, H, "Classifying colour edges in video into shadow-geometry, highlight, or material transitions," IEEE Transactions on Multimedia, vol. 5, no. 2, pp. 237-243, July 2003. https://doi.org/10.1109/TMM.2003.811620
  28. Guan, H and Wada, S, "Flexible colour texture retrieval method using multiresolution mosaic for image classification," in Proc.of 6th International Conference on Signal Processing, vol. 1, pp. 612-615, 2002.
  29. Shi, Dong-cheng, Xu, Lan, Han, Ling-yan, "Image retrieval using both color and texture features," The Journal of China Universities of Posts and Telecommunications, vol. 14, Supplement 1, pp 94-99, October 2007..
  30. Ouyang, A and Tan, Y, "A novel multi-scale spatial-colour descriptor for content-based image retrieval," in Proc.of 7th International Conference on Control, Automation, Robotics and Vision, vol. 3, pp. 1204-1209, 2002.
  31. Yu, H, Li, M, Zhang, H and Feng, J, "Colour texture moments for content-based image retrieval," in Proc.of International Conference on Image Processing, Rochester, New York, USA, vol. 3, pp. 929-932, 2002.
  32. Vadivel, A, SuralShamik and Majumdar, AK, "An integrated colour and intensity co-occurrence matrix," Pattern Recognition Letters, vol. 28, no.8, pp. 974-983, January 2007. https://doi.org/10.1016/j.patrec.2007.01.004
  33. Belongie, S, Malik, J and Puzicha, J, "Shape matching and object recognition using shape contexts," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no.4, pp.509-522, April 2002. https://doi.org/10.1109/34.993558
  34. Scott, GJ, MathewKlaric, M, Davis, CH and Che-Ren, S, "Entropy-Balanced Bitmap Tree for Shape-Based Object Retrieval From Large-Scale Satellite Imagery Databases," IEEE Transactions on Geoscience and Remote Sensing, vol.49, no.5, pp.1603-1616, May 2011. https://doi.org/10.1109/TGRS.2010.2088404
  35. Shechtman, E and Irani, M, "Space-time behavior-based correlation," in Proc. of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005.
  36. Manjunath, BS and Ma, WY, "Texture Features for browsing and Retrieval of Image Data," IEEE Transactions on Pattern Analysis Machine Intelligence, vol.18, no.8, pp.837-842, August 1996. https://doi.org/10.1109/34.531803
  37. Noureddine, A, "Computational Perceptual Features for Texture representation and Retrieval," IEEE Transactions on Image Processing, vol.20, no.1, pp.236-246, January 2011. https://doi.org/10.1109/TIP.2010.2060345
  38. Ojala, T, Pietikainen, M and Harwood, D, "A comparative study of texture measures with classification based on feature distributions," Pattern Recognition, vol. 29, no. 1, pp. 51-59, January1996. https://doi.org/10.1016/0031-3203(95)00067-4
  39. Heikkila, M, Pietikainen, M and Schmid, C, "Description of interest regions with local binary patterns," Pattern Recognition, vol. 42, no. 3, pp. 425-436, March 2009. https://doi.org/10.1016/j.patcog.2008.08.014
  40. N. Martinel, C. Micheloni, and G. Feresti, "Saliency weighted features for person re-identification," in Proc. of ECCV Workshop on Visual Surveillance and Re-identification, pp .191-208, 2014.
  41. W. Li, R. Zhao, T. Xiao, andX. Wang, "Deepreid: Deep filter pairing neural network for person reidentification," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 152-159, 2014.
  42. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," Communications of the ACM, vol. 60, no. 6, pp. 84-90, 2017. https://doi.org/10.1145/3065386
  43. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic egmentation," in Proc of IEEE Conference on Computer Vision and Pattern Recognition, pp. 580-587, 2014.
  44. F. Radenovi'c, G. Tolias, and O. Chum, "CNN image retrieval learns from bow: Unsupervised fine-tuning with hard examples," in Proc. of European Conference on Computer Vision, pp.3-20, 2016.
  45. F. Schroff, D. Kalenichenko, and J. Philbin, "Facenet: A unified embedding for face recognition and clustering," in Proc.of IEEE Conference on Computer Vision and Pattern Recognition, pp. 815-823, 2015.
  46. E. Ahmed, M. Jones, and T. K. Marks, "An improved deep learning architecture for person reidentification," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3908-3916, 2015.
  47. L. Wu, C. Shen, and A. v. d. Hengel, "Personnet: Person reidentification with deep convolutional neural networks," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, arXiv:1601.07255, 2016.
  48. R. R. Varior, B. Shuai, J. Lu, D. Xu, and G. Wang, "A siamese long short-term memory architecture for human reidentification," in Proc. of European Conference on Computer Vision, 2016.
  49. T. D'Orazio and G. Cicirelli, "People reidentification and tracking from multiple cameras: a review," in Proc. of19th IEEE International Conference on Image Processing, pp. 1601-1604, 2012.
  50. A. Bedagkar-Gala and S. K. Shah, "A survey of approaches and trends in person reidentification," Image and Vision Computing, vol. 32, no. 4, pp. 270-286, 2014. https://doi.org/10.1016/j.imavis.2014.02.001
  51. R. Satta, "Appearance descriptors for person reidentification: a comprehensive review," arXiv preprint, arXiv:1307.5748, July, 2013.
  52. X. Wang, "Intelligent multi-camera video surveillance: A review," Pattern recognition letters, vol. 34, no. 1, pp. 3-19, January2013. https://doi.org/10.1016/j.patrec.2012.07.005
  53. Navneet Dalal and Bill Triggs, "Histograms of Oriented Gradients for Human Detection," in Proc. of IEEE computer society conference on Computer Vision and Pattern Recognition, vol.1, pp. 886-893, 2005.
  54. Y. LeCun, L. Jackel, L. Bottou, C. Cortes, J. S. Denker, H. Drucker, I. Guyon, U. Muller, E. Sackinger, P. Simard, et al., "Learning algorithms for classification: A comparison on handwritten digit recognition," Neural networks: the statistical mechanics perspective, pp. 261-276, 1995.
  55. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," arXiv preprint, arXiv:1409.1556, September 2014.
  56. S. Ioffe and C. Szegedy, "Batch normalisation: Accelerating deep network training by reducing internal covariate shift," in Proc. of32nd International Conference on Machine Learning, pp. 448-456, 2015.
  57. C. Szegedy, V. Vanhoucke, S.Ioffe, J. Shlens, and Z. Wojna, "Rethinking the inception architecture for computer vision," arXiv preprint arXiv:1512.00567, 2015.
  58. C. Szegedy, S. Ioffe, and V. Vanhoucke, "Inception-v4, inception-resnet and the impact of residual connections on learning," arXiv preprint arXiv:1602.07261, 2016.