Browse > Article
http://dx.doi.org/10.9717/kmms.2021.24.12.1641

Frame Rearrangement Method by Time Information Remarked on Recovered Image  

Kim, Yong Jin (Digital Analysis Division, National Forensic Service (NFS))
Lee, Jung Hwan (Digital Analysis Division, National Forensic Service (NFS))
Byun, Jun Seok (Digital Analysis Division, National Forensic Service (NFS))
Park, Nam In (Digital Analysis Division, National Forensic Service (NFS))
Publication Information
Journal of Korea Multimedia Society / v.24, no.12, 2021 , pp. 1641-1652 More about this Journal
Abstract
To analyze the crime scene, the role of digital evidence such as CCTV and black box is very important. Such digital evidence is often damaged due to device defects or intentional deletion. In this case, the deleted video can be restored by well-known techniques like the frame-based recovery method. Especially, the data such as the video can be generally fragmented and saved in the case of the memory used almost fully. If the fragmented video were recovered in units of images, the sequence of the recovered images may not be continuous. In this paper, we proposed a new video restoration method to match the sequence of recovered images. First, the images are recovered through a frame-based recovery technique. Then, after analyzing the time information marked on the images, the time information was extracted and recognized via optical character recognition (OCR). Finally, the recovered images are rearranged based on the time information obtained by OCR. For performance evaluation, we evaluate the recovery rate of our proposed video restoration method. As a result, it was shown that the recovery rate for the fragmented video was recovered from a minimum of about 47% to a maximum of 98%.
Keywords
Video Restoration; Time Information; Rearranging Frames; Rearranged; Optical Character Recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 B. Shi, X. Bai, and C. Yao, "An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its pplication to Scene Text Recognition," arXiv preprint, arXiv:1507.05717, 2015.
2 EasyOCR, https://github.com/JaidedAI/EasyOCR (accessed March 2021).
3 Tesseract OCR, https://github.com/tesseractocr/tesseract (accessed March 2021).
4 G.H. Na, K.S. Shim, J.S. Byun, E.S. Kim, and J. Lee, "Recovery Corrupted Video Files using Time Information," Journal of Korea Multimedia Society, Vol. 18, No. 12, pp. 1492-1500, 2015.   DOI
5 L.M. Mathew, R. Suma, and J.J. Kizhakkethottam, "A Survey on Different Video Restoration Techniques," 2015 International Conference on Soft-Computing and Networks Security (ICSNS) , pp. 1-3, 2015.
6 Q. Yao and C. Gu, "Research and Implementation of Data Recovery Technology Based on WINDOWS FAT," 2010 International Conference on Machine Vision and Human-machine Interface, pp. 549-552, 2010.
7 S.W. Eo, W.Y. Jo, S.J. Lee, and T.S. Shon, "A Phase of Deleted File Recovery for Digital Forensics Research in Tizen," The 5th International Conference on IT Convergence and Security (ICITCS) , pp. 1-3, 2015.
8 D.G. Park, S.J. Park, J.H. Lee, S.Y. No, and S.Y. Shin, "A File Carving Algorithm for Digital Forensics," International Conference on Computational Science and Its Applications (ICCSA), pp. 615-626, 2009.
9 G.H. Na, K.S. Shim, K.W. Moon, S.G. Kong, E.S. Kim, and J. Lee, "Frame-Based Recovery of Corrupted Video Files using Video Codec Specifications," IEEE Transactions on Image Processing, Vol. 23, No. 2, pp. 517-526, 2014.   DOI
10 T. Wiegand, G.J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, No. 7, pp. 560-576, 2003.   DOI
11 Optical character recognition, https://en.wikipedia.org/wiki/Optical_character_recognition (accessed March 2021).
12 G.J. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) Standard," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 22, No. 12, pp. 1649-1668, 2012.   DOI