Browse > Article
http://dx.doi.org/10.7780/kjrs.2017.33.2.10

Rectification of Smartphone Image Based on Reference Images for Facility Monitoring  

Kim, Hwiyoung (Department of Geoinformatics, University of Seoul)
Choi, Kyoungah (Department of Geoinformatics, University of Seoul)
Lee, Impyeong (Department of Geoinformatics, University of Seoul)
Yoon, Hyuk-Jin (ICT-Railroad Convergence Research Team, Korea Railroad Research Institute)
Publication Information
Korean Journal of Remote Sensing / v.33, no.2, 2017 , pp. 231-242 More about this Journal
Abstract
Monitoring of facilities such as roads, dams and bridges is important for their long-term sustainable usage. It has usually suffered with safety and cost problems, which makes more frequent monitoring difficult. As an efficient and economicalsolution to these problems, one may consider the use of smartphone to capture the status of the facilities. To derive quantitative analysis results with the smartphone images for facility monitoring, one should first rectify the images in a way as automatic and economical as possible. In thisstudy, we propose such a rectification method, which rectifiessmartphone images acquired from arbitrary locations based on reference images.In the proposed method, we determine the camera extrinsic parameters of each smartphone images using the reference imagesrather than ground control points, and project the image to the target surface of the facility based on the determined camera parameters. The method were applied to test data acquired from a small dam toward water-area facility monitoring. The experimental results showed that the camera extrinsic parameters were determined with the accuracy of 5 cm and $0.28^{\circ}$ in the position and attitude. The accuracy of the distance measured from the rectified image was evaluated to 10 cm. With the rectified images, one can accurately determine the location and length of the target objects required for facility monitoring.
Keywords
Smartphone image; Reference image; Georeferencing; Rectification; Facility monitoring;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Atzori, L., T. Dessi, and V. Popescu 2012. Indoor navigation system using image and sensor data processing on a smartphone, Proc. of 2012 13th International Conference on IEEE Optimization of Electrical and Electronic Equipment, Romania, May 24-26, pp. 1158-1163.
2 Choi, K. and I. Lee, 2016. Accuracy Verification on the Facility Monitoring through a Low-altitude Unmanned Aerial Survey, Proc. of 2016 Korean Conference of Hazard Mitigation, Seoul, Korea, Feb. 19, pp. 140.
3 Dworakowski, Z., P. Kohut, A. Gallina, K. Holak, and T. Uhl, 2016. Vision-based algorithms for damage detection and localization in structural health monitoring, Structural Control and Health Monitoring, 23(1): 35-50.   DOI
4 Feng, D. and M.Q. Feng, 2015. Vision-based multipoint displacement measurement for structural health monitoring, Structural Control and Health Monitoring, 23(5): 876-890.   DOI
5 Fukuda, Y., M.Q. Feng, Y. Narita, S.I. Kaneko, and T. Tanaka, 2013. Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm, IEEE Sensors Journal, 13(12): 4725-4732.   DOI
6 Kim, H.G., H.S. Yun, and J.M. Cho, 2015. Analysis of 3D Accuracy According to Determination of Calibration Initial Value in Close-Range Digital Photogrammetry Using VLBI Antenna and Mobile Phone Camera. Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 33(1): 31-43 (in Korean with English abstract).   DOI
7 Google, 2016. Mobile Apps in APAC: 2016 Report, Google. https://apac.thinkwithgoogle.com/intl/en/articles/mobile-apps-in-apac-2016-report.html
8 Han, S., J. Park, and W. Lee, 2016. On-Site vs. Laboratorial Implementation of Camera Self-Calibration for UAV Photogrammetry, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 34(4): 349-356.   DOI
9 Kim, H., K. Choi, I. Lee, and E. Jeon, 2013. A pilot study toward image based determination of smartphone's position and attitude by fast sequential bundle adjustment, Proc. of International Symposium on Mobile Mapping Technology 2013, Tainan, Taiwan, May 1-3.
10 Malesa, M. and M. Kujawinska, 2013. Deformation measurements by digital image correlation with automatic merging of data distributed in time, Applied Optics, 52(19): 4681-4692.   DOI
11 McGlone, C., 2004. Manual of Photogrammetry, 5th Edition, ASPRS, Bethesda, Maryland, USA, pp. 847-870.
12 Metni, N. and Hamel, T., 2007. A UAV for bridge inspection: Visual servoing control law with orientation limits, Automation in Construction, 17(1): 3-10.   DOI
13 Morgenthal, G. and N. Hallermann,, 2014. Quality Assessment of Unmanned Aerial Vehicle (UAV) Based Visual Inspection of Structures, Advances in Structural Engineering, 17(3): 289-302.   DOI
14 Ye, X.W., C.Z. Dong, and T. Liu, 2016. Image-based structural dynamic displacement measurement using different multi-object tracking algorithms, Smart Structures and Systems, 17(6): 935-956.   DOI
15 Nikolic, J., M. Burri, J. Rehder, S. Leutenegger, C. Huerzeler, and R. Siegwart, 2013. A UAV system for inspection of industrial facilities, Proc. Of 2013 IEEE Aerospace Conference, Big Sky, MT, USA, Mar. 2-9, pp. 1-8.
16 Sladek, J., K. Ostrowska, P. Kohut, K. Holak, A. Gaska, and T. Uhl, 2013. Development of a vision based deflection measurement system and its accuracy assessment, Measurement, 46(3): 1237-1249.   DOI
17 Sui, W. and K. Wang, 2015. An accurate indoor localization approach using cellphone camera. Proc. of 2015 11th International Conference on Natural Computation, Zhangjiajie, China, Aug. 15-17, pp. 949-953.
18 Werner, M., M. Kessel, and C. Marouane, 2011. Indoor positioning using smartphone camera, Proc. of 2011 International Conference on IEEE Indoor Positioning and Indoor Navigation, Portugal, Sep. 21-23, pp. 1-6.
19 Xue, H., L. Ma, and X. Tan, 2016. A fast visual map building method using video stream for visualbased indoor localization, Proc. of 2016 International Wireless Communications and Mobile Computing Conference, Paphos, Cyprus, Sep. 5-9, pp. 650-654.