Browse > Article
http://dx.doi.org/10.5909/JBE.2018.23.2.197

Timeline Synchronization of Multiple Videos Based on Waveform  

Kim, Shin (Department of Computer Science Engineering, Konkuk University)
Yoon, Kyoungro (Department of Computer Science Engineering, Konkuk University)
Publication Information
Journal of Broadcast Engineering / v.23, no.2, 2018 , pp. 197-205 More about this Journal
Abstract
Panoramic image is one of the technologies that are commonly used today. However, technical difficulties still exist in panoramic video production. Without a special camera such as a 360-degree camera, making panoramic video becomes more difficult. In order to make a panoramic video, it is necessary to synchronize the timeline of multiple videos shot at multiple locations. However, the timeline synchronization method using the internal clock of the camera may cause an error due to the difference of the internal hardware. In order to solve this problem, timeline synchronization between multiple videos using visual information or auditory information has been studied. However, there is a problem in accuracy and processing time when using video information, and there is a problem in that, when using audio information, there is no synchronization when there is sensitivity to noise or there is no melody. Therefore, in this paper, we propose a timeline synchronization method between multiple video using audio waveform. It shows higher synchronization accuracy and temporal efficiency than the video information based time synchronization method.
Keywords
Multiple Video Synchronization; Temporal Synchronization; Panoramic Video; Timeline Synchronization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Shrestha Prarthana, et al. "Synchronization of multiple camera videos using audio-visual features." IEEE Transactions on Multimedia 12.1, pp. 79-92, 2010.   DOI
2 Herbert Bay, Tinne Tuytelaars, and Luc Van Gool. "Surf: Speeded up robust features." Computer vision-ECCV 2006, pp 404-417. 2006.
3 Jaap Haitsma, and Ton Kalker. "A highly robust audio fingerprinting system." Ismir. Vol. 2002.
4 Shrestha Prarthana, et al. "Synchronization of multiple video recordings based on still camera flashes." Proceedings of the 14th ACM international conference on Multimedia. ACM, 2006.
5 Lei, Cheng, and Yee-Hong Yang. "Tri-focal tensor-based multiple video synchronization with subframe optimization." IEEE Transactions on Image Processing 15.9 , pp. 2473-2480, 2006.   DOI
6 M. Ko and K. Yoon. "Timeline synchronization of video clips based on image matching.", Conference on Korean Society of Broadcast Engineers, pp.144-145, November, 2016
7 S. Kim and K. Yoon. "Optimization technique for timeline synchronization of video clips." Conference on Korean Society of Broadcast Engineers, pp.109-110, June, 2017.
8 Shrstha Prarthana, Mauro Barbieri, and Hans Weda. "Synchronization of multi-camera video recordings based on audio." Proceedings of the 15th ACM international conference on Multimedia. ACM, 2007.