Browse > Article
http://dx.doi.org/10.3837/tiis.2019.04.014

Vehicle Detection in Aerial Images Based on Hyper Feature Map in Deep Convolutional Network  

Shen, Jiaquan (College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence)
Liu, Ningzhong (College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence)
Sun, Han (College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence)
Tao, Xiaoli (College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence)
Li, Qiangyi (College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.13, no.4, 2019 , pp. 1989-2011 More about this Journal
Abstract
Vehicle detection based on aerial images is an interesting and challenging research topic. Most of the traditional vehicle detection methods are based on the sliding window search algorithm, but these methods are not sufficient for the extraction of object features, and accompanied with heavy computational costs. Recent studies have shown that convolutional neural network algorithm has made a significant progress in computer vision, especially Faster R-CNN. However, this algorithm mainly detects objects in natural scenes, it is not suitable for detecting small object in aerial view. In this paper, an accurate and effective vehicle detection algorithm based on Faster R-CNN is proposed. Our method fuse a hyperactive feature map network with Eltwise model and Concat model, which is more conducive to the extraction of small object features. Moreover, setting suitable anchor boxes based on the size of the object is used in our model, which also effectively improves the performance of the detection. We evaluate the detection performance of our method on the Munich dataset and our collected dataset, with improvements in accuracy and effectivity compared with other methods. Our model achieves 82.2% in recall rate and 90.2% accuracy rate on Munich dataset, which has increased by 2.5 and 1.3 percentage points respectively over the state-of-the-art methods.
Keywords
Car detection; deep convolutional network; hyper feature map; small object detection; feature fusion;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Hsu-Yung Cheng, Chih-Chia Weng and Yi-Ying Chen, "Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks," IEEE Transactions on Image Processing, vol. 21, no. 4, pp. 2152-2159, April, 2012.   DOI
2 Wen Shao, Wen Yang, Gang Liu, Jie Liu, "Car detection from high-resolution aerial imagery using multiple features," in Proc. of 2012 IEEE International Geoscience and Remote Sensing Symposium, November, pp. 4379-4382, 2012.
3 Ziyi Chen, Cheng Wang, Chenglu Wen, Xiuhua Teng, Yiping Chen, Haiyan Guan and Huan Luo, "Vehicle detection in high-resolution aerial images via sparse representation and superpixels," IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 1, pp. 103-116, January, 2015.   DOI
4 Aniruddha Kembhavi, David Harwood and Larry S. Davis, "Vehicle detection using partial least squares," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 6, pp. 1250-1265, June, 2011.   DOI
5 Ross B Girshick, Jeff Donahue, Trevor Darrell and Jitendra Malik, "Region-Based Convolutional Networks for Accurate Object Detection and Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 1, pp. 142-158, May, 2016.   DOI
6 Ross Girshick, "Fast R-CNN," in Proc. of 2015 IEEE International Conference on Computer Vision (ICCV), pp. 1440-1448, 2015.
7 Shaoqing Ren, Kaiming He, Ross B Girshick and Jian Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137-1149, June, 2017.   DOI
8 Joseph Redmon, Santosh Kumar Divvala, Ross B Girshick and Ali Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," in Proc. of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779-788, 2016.
9 Yi Meng, Baolong Guo and Chunman Yan, "Improved image alignment algorithm based on projective invariant for aerial video stabilization," KSII Transactions on Internet & Information Systems, vol. 8, no. 9, pp. 3177-3195, September, 2014.   DOI
10 Liu Kang and Gellert Mattyus, "Fast Multiclass Vehicle Detection on Aerial Images," IEEE Geoscience and Remote Sensing Letters, vol. 12, no. 9, pp. 1938-1942, September, 2015.   DOI
11 Zhong Jiandan, Tao Lei and Guangle Yao, "Robust Vehicle Detection in Aerial Images Based on Cascaded Convolutional Neural Networks," Sensors, vol. 17, no. 12, pp. 2720-2737, November, 2017.   DOI
12 Nassim Ammour, Haikel Salem Alhichri, Yakoub Bazi, Bilel Benjdira, Naif Alajlan and Mansour Zuair, "Deep learning approach for car detection in UAV imagery," Remote Sensing, vol. 9, no. 4, pp. 1-15, March, 2017.
13 Zhipeng Deng, Hao Sun, Shilin Zhou, Juanping Zhao and Huanxin Zou, "Toward Fast and Accurate Vehicle Detection in Aerial Images Using Coupled Region-Based Convolutional Neural Networks," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 10, no 8. pp. 3652-3664, August, 2017.   DOI
14 Tianyu Tang, Shilin Zhou, Zhipeng Deng, Huanxin Zou and Lin Lei, "Vehicle detection in aerial images based on region convolutional neural networks and hard negative example mining," Sensors, vol. 17, no. 2, pp. 336-352, February, 2017.   DOI
15 Yakoub Bazi and Farid Melgani, "Convolutional SVM Networks for Object Detection in UAV Imagery," IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 6, pp. 3107-3118, June, 2018.   DOI
16 Mesay Belete Bejiga, Abdallah Zeggada, Abdelhamid Nouffidj and Farid Melgani, "A convolutional neural network approach for assisting avalanche search and rescue operations with UAV imagery," Remote Sensing, vol. 9, no. 2, pp. 100-121, January, 2017.   DOI
17 Faisal Riaz, Sohail Jabbar, Muhammad Sajid, Mudassar Ahmad, Kashif Naseer and Nouman Ali, "A collision avoidance scheme for autonomous vehicles inspired by human social norms," Computers & Electrical Engineering, vol. 69, pp.690-704, 2018.   DOI
18 Lars Wilko Sommer, Tobias Schuchert and Jurgen Beyerer, "Deep learning based multi-category object detection in aerial images," in Proc. of SPIE, vol. 10202, 2017.
19 Igor Sevo and Aleksej Avramovic, "Convolutional Neural Network Based Automatic Object Detection on Aerial Images," IEEE Geoscience and Remote Sensing Letters, vol. 13, no. 5, pp. 740-744, May, 2016.   DOI
20 Gong Cheng, Peicheng Zhou, Junwei Han, "Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images," IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 12, pp. 7405-7415, December, 2016.   DOI
21 Matthew D Zeiler and Rob Fergus, "Visualizing and understanding convolutional networks," in Proc. of European conference on computer vision, pp. 818-833, 2014.
22 Karen Simonyan and Andrew Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," in Proc. of International conference on learning representations, 2015.
23 D.N. Chandrappa, G. Akshay and M. Ravishankar, "Face Detection Using a Boosted Cascade of Features Using OpenCV," in Proc. of Wireless Networks and Computational Intelligence , ICIP 2012, pp. 399-404, 2012.
24 Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott E Reed, Chengyang Fu and Alexander C Berg, "SSD: Single shot multibox detector," in Proc. of European conference on computer vision, pp. 21-37, 2016.
25 Guimei Cao, Xuemei Xie, Wenzhe Yang, Quan Liao, Guangming Shi and Jinjian Wu, "Feature-Fused SSD: Fast Detection for Small Objects," in Proc. of SPIE 10615, Ninth International Conference on Graphic and Image Processing (ICGIP 2017), 2018.
26 Paul Viola, John C. Platt and Cha Zhang, "Multiple instance boosting for object detection," NIPS'05 Proceedings of the 18th International Conference on Neural Information Processing Systems, pp. 1417-1424, December, 2005.
27 Timo Ojala, Matti Pietikainen and Topi Maenpaa, "Gray-scale and rotation invariant texture classification with local binary patterns," in Proc. of IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 404-420, 2000.
28 David G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, November, 2004.   DOI
29 Navneet Dalal and Bill Triggs, "Histograms of oriented gradients for human detection," in Proc. of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), pp. 886-893, 2005.
30 Pedro F Felzenszwalb, Ross B Girshick, David A Mcallester and Deva Ramanan, "Object Detection with Discriminative Trained Part Based Models," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1627-1645, September, 2010.   DOI
31 Gong Cheng and Junwei Han, "A survey on object detection in optical remote sensing images," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 117, pp. 11-28, July, 2016.   DOI
32 Yanjun Liu, Na Liu, Hong Huo, Tao Fang, "Vehicle detection in high resolution satellite images with joint-layer deep convolutional neural networks," in Proc. of International conference on mechatronics and machine vision in practice, pp. 1-6, November, 2016.
33 Juanjuan Zhu, Wei Sun, Baolong Guo and Cheng Li, "Surf points based Moving Target Detection and Long-term Tracking in Aerial Videos," Ksii Transactions on Internet & Information Systems, vol. 10, no. 11, pp. 5624-5638, November, 2016.   DOI
34 Thomas Moranduzzo and Farid Melgani, "Detecting cars in UAV images with a catalog-based approach," IEEE Transactions on Geoscience & Remote Sensing, vol. 52, no. 10. pp. 6356-6367, January, 2014.   DOI
35 Thomas Moranduzzo and Farid Melgani, "Automatic car counting method for unmanned aerial vehicle images," IEEE Transactions on Geoscience & Remote Sensing, vol. 52, no. 3, pp. 1635-1647, May, 2014.   DOI
36 Yongzheng Xu, Guizhen Yu and Xinkai Wu, "An Enhanced Viola-Jones Vehicle Detection Method from Unmanned Aerial Vehicles Imagery," IEEE Transactions on Intelligent Transportation Systems, vol. 18, no. 7, pp. 1-12, July, 2017.   DOI
37 PDA Kraaijenbrink, JM Shea, F Pellicciotti, SMD Jong and WW Immerzeel, "Object-based analysis of unmanned aerial vehicle imagery to map and characterise surface features on a debris-covered glacier," Remote Sensing of Environment, vol, 186, no. 1, pp. 581-595, December, 2016.   DOI
38 Hailing Zhou, Hui Kong, Lei Wei, Douglas Creighton, Saeid Nahavandi, "Efficient Road Detection and Tracking for Unmanned Aerial Vehicle," IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 1, pp. 297-309, February, 2015.   DOI
39 Joseph Redmon and Ali Farhadi, "YOLO9000: Better , Faster , Stronger," in Proc. of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6517-6525, 2017.
40 Amir Ghodrati, Ali Diba, Marco Pedersoli, Tinne Tuytelaars and Luc Van Gool, "Deepproposal: Hunting objects by cascading deep convolutional layers," in Proc. of international conference on computer vision, pp. 2578-2586, December, 2015.
41 K. Liu and G. Mattyus, "DLR 3k Munich Vehicle Aerial Image Dataset," Available online: http://pba-freesoftware.eoc.dlr.de/3K_VehicleDetection_dataset.zip, 2015.
42 https://pan.baidu.com/s/1mz-phfgwG3VdF0OASAI14g.
43 Chia-Feng Juang and Guo-Cyuan Chen, "Fuzzy Classifiers Learned Through SVMs with Application to Specific Object Detection and Shape Extraction Using an RGB-D Camera," Computational Intelligence for Pattern Recognition, vol. 777, pp. 253-274, 2018.   DOI
44 Bushra Zafar, Rehan Ashraf, Nouman Ali, Mudassar Ahmed, Sohail Jabbar, Savvas A Chatzichristofis, "Image classification by addition of spatial information based on histograms of orthogonal vectors," Plos One, vol. 13, no. 6, June, 2018.
45 Nouman Ali, Khalid Bashir Bajwa, Robert Sablatnig and Zahid Mehmood, "Image retrieval by addition of spatial information based on histograms of triangular regions," Computers & Electrical Engineering, vol. 54, pp. 539-550, August, 2016.   DOI
46 Nouman Ali, Khalid Bashir Bajwa, Robert Sablatnig, Savvas A Chatzichristofis, Zeshan Iqbal, Muhammad Rashid, Hafiz Adnan Habib, "A Novel Image Retrieval Based on Visual Words Integration of SIFT and SURF," Plos One, vol. 11, no. 6, June, 2016.
47 Yanxiang Chen, Gang Tao, Hongmei Ren, Xinyu Lin and Luming Zhang, "Accurate seat belt detection in road surveillance images based on CNN and SVM," Neurocomputing, vol. 274, pp. 80-87, January, 2018.   DOI
48 Xiangbo Shu, Jinhui Tang, Guojun Qi, Yan Song, Zechao Li, Liyan Zhang, "Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition," in Proc. of Computer vision and pattern recognition, pp. 2176-2183, 2017.
49 Yongzheng Xu, Guizhen Yu, Yunpeng Wang, Xinkai Wu and Yalong Ma, "Car detection from low-altitude UAV imagery with the faster R-CNN," Journal of Advanced Transportation, vol. 2017, pp. 1-10, August, 2017.
50 Xiangbo Shu, Guojun Qi, Jinhui Tang and Jingdong Wang, "Weakly-Shared Deep Transfer Networks for Heterogeneous-Domain Knowledge Propagation," in Proc. of the 23rd ACM international conference on Multimedia, pp. 35-44, 2015.