• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.05a
• /
• pp.358-361
• /
• 2021

In order to improve the accuracy of small target detection more effectively, this paper proposes an improved single shot detector (SSD) target detection and recognition method based on cspdarknet53, which introduces lightweight ECA attention mechanism and Feature Pyramid Network (FPN). First, the original SSD backbone network is replaced with cspdarknet53 to enhance the learning ability of the network. Then, a lightweight ECA attention mechanism is added to the basic convolution block to optimize the network. Finally, FPN is used to gradually fuse the multi-scale feature maps used for detection in the SSD from the deep to the shallow layers of the network to improve the positioning accuracy and classification accuracy of the network. Experiments show that the proposed target detection algorithm has better detection accuracy, and it improves the detection accuracy especially for small targets.

• Journal of Korea Multimedia Society
• /
• v.21 no.8
• /
• pp.829-836
• /
• 2018

This study attempts to detect a shot boundary in films(or dramas) based on the length of a sequence. As films or dramas use scene change effects a lot, the issues regarding the effects are more diverse than those used in surveillance cameras, sports videos, medical care and security. Visual techniques used in films are focused on the human sense of aesthetic therefore, it is difficult to solve the errors in shot boundary detection with the method employed in surveillance cameras. In order to define the errors arisen from the scene change effects between the images and resolve those issues, the mixed algorithm based upon color histogram, edge histogram, and optical flow was implemented. The shot boundary data from this study will be used when analysing the configuration of meaningful shots in sequences in the future.

• Journal of KIISE:Computing Practices and Letters
• /
• v.7 no.6
• /
• pp.582-592
• /
• 2001

Video indexing plays an important role in the applications such as digital video libraries or web VOD which archive large volume of digital videos. Video indexing is usually based on video segmentation. In this paper, we propose a software tool called V2Web Studio which can generate video clips utilizing shot boundary detection algorithm. With the V2Web Studio, the process of clip generation consists of the following four steps: 1) Automatic detection of shot boundaries by parsing the video, 2) Elimination of errors by manually verifying the results of the detection, 3) Building a modeling structure of logical hierarchy using the verified shots, and 4) Generating multiple video clips corresponding to each logically modeled segment. The aforementioned steps are performed by shot detector, shot verifier, video modeler and clip generator in the V2Web Studio respectively.

• Journal of Internet Computing and Services
• /
• v.5 no.6
• /
• pp.59-66
• /
• 2004

In this paper, we propose a transmission rate prediction method of video data. The proposed method checks shot transition characteristics after dividing MPEG video data into a GoP unit and then uses Kalman filter. It used algorithm to detect shot transition information by high speed in compressed domain in order to check a correct shot transition of video data and classified into a abrupt shot transition type and a gradual shot transition type. Information to have been classifying is used as factors of Kalman filter and predicts a transmission rate of video data. Also, the proposed method decreased processing time with detecting shot transition and predicting a transmission rate of video data in compressed domain. It predicted a transmission rate with 96.2- 97.6% in the experiment that used three kinds of 911 1frames of different video data.

• Journal of the Korea Society of Computer and Information
• /
• v.20 no.7
• /
• pp.9-16
• /
• 2015

This paper proposes the parallel design of a shot change detection algorithm using frame segmentation and moving blocks. In the proposed approach, the high parallel processing components, such as frame histogram calculation, block histogram calculation, Otsu threshold setting function, frame moving operation, and block histogram comparison, are designed in parallel for NVIDIA GPU. In order to minimize memory access delay time and guarantee fast computation, the output of a GPU kernel becomes the input data of another kernel in a pipeline way using the shared memory of GPU. In addition, the optimal sizes of CUDA processing blocks and threads are estimated through the prior experiments. In the experimental test of the proposed shot change detection algorithm, the detection rate of the GPU based parallel algorithm is the same as that of the CPU based algorithm, but the average of processing time speeds up about 6~8 times.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2000.08a
• /
• pp.249-252
• /
• 2000

본 논문에서는 MPEG으로 압축된 영상에 대해서 급격한 장면 변화에 의한 shot 경계(cut)와 점진적 장면 변화에 의한 shot 경계(dissolve)를 검출하여 비디오 shot을 분할하는 기법을 제안한다. 기존의 방법으로 잘 검출하지 못하였던 점진적 장면 변화에 의한 shot의 경계를 검출하기 위한 기법을 제안한다. 먼저 압축영역의 기법 중 DCT DC 값을 비교하는 방법을 이용하여 cut에 의한 shot 경계를 검출한다 그리고 움직임 벡터(MV)의 비를 비교하는 방법을 사용하여 dissolve에 의한 shot 경계의 후보지들을 얻어내고, 선택된 후보지들 중 n번째와 n＋2번째 후보지 영상으로 dissolve 영상을 만들어 n＋1번째 후보지의 영상과 유사도를 비교하여 dissolve를 검출한다. 이와 같이 압축영역에서 cut에 의한 shot 경계와 dissolve에 의한 shot 경계의 후보지를 검출해 내고, 검출된 shot 경계 후보지들에서 dissolve에 의한 shot 경계를 검출하는 방법을 함으로서 MPEG 비디오 영상의 복원량을 최소화하여 수행 속도를 높이면서도 cut과 dissolve 두 가지 모두를 효과적으로 검출할 수 있었다.

• Proceedings of the IEEK Conference
• /
• 2000.11d
• /
• pp.159-162
• /
• 2000

In this paper, we propose an efficient method to detect shot changes in compressed MPEG video data by using reference features among video frames. The reference features among video frames imply the similarities among adjacent frames by prediction coded type of each frame. A shot change is detected if the similarity degrees of a frame and its adjacent frames are low. And the shot change detection algorithm is improved by using Fuzzy c-means (FCM) clustering algorithm. The FCM clustering algorithm uses the shot change probabilities evaluated in the mask matching of reference ratios and difference measure values based on frame reference ratios.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2000.10a
• /
• pp.751-754
• /
• 2000

In this paper, we propose an efficient method to detect abrupt shot changes in compressed MPEG video data by using reference ratios among video frames. The reference ratios among video frames imply the degree of similarities among adjacent frames by prediction coded type of each frames. A shot change is detected if the similarity degrees of a frame and its adjacent frames are low. This paper proposes an efficient shot change detection algorithm by using Fuzzy c-means(FCM) clustering algorithm. The FCM clustering uses the shot change probabilities evaluated in the mask matching of reference ratios and difference measure values based on frame reference ratios.

• Journal of KIISE:Software and Applications
• /
• v.36 no.2
• /
• pp.169-177
• /
• 2009

In this paper, we propose a new shot boundary detection method which is optimized for news video story parsing. This new news shot boundary detection method was designed to satisfy all the following requirements: 1) minimizing the incorrect data in data set for anchor shot detection by improving the recall ratio 2) detecting abrupt cuts and gradual transitions with one single algorithm so as to divide news video into shots with one scan of data set; 3) classifying shots into static or dynamic, therefore, reducing the search space for the subsequent stage of anchor shot detection. The proposed method, based on singular value decomposition with incremental clustering and mercer kernel, has additional desirable features. Applying singular value decomposition, the noise or trivial variations in the video sequence are removed. Therefore, the separability is improved. Mercer kernel improves the possibility of detection of shots which is not separable in input space by mapping data to high dimensional feature space. The experimental results illustrated the superiority of the proposed method with respect to recall criteria and search space reduction for anchor shot detection.

• Journal of Korea Multimedia Society
• /
• v.12 no.3
• /
• pp.354-361
• /
• 2009

Shot change detection is the main technique in the video segmentation which requirs real-time processing and automatical processing in hardware. Until now, there were few research reports about real-time shot change detection for applying to hardware terminals with low performance such as PMPs(Portable Media Player) and cellular phones. In this paper, we propose shot change detection technique using adaptive threshold setting method on variable reference block. Our proposed algorithm determines shot change detection by comparing the feature value of current frame and a mean of a feature value on variable reference blocks. The proposed method can be used independently from the feature value of frame, can adaptively set thresholds using a mean of a feature value on variable reference blocks. We obtained better detection ratio than the conventional methods maximally by precision 0.146, recall 0.083, F1 0.089 in the experiment with the same test sequences. We verified real-time operation of shot change detection by implementing our algorithm on the PMP from some company of H. Therefore, our proposing algorithm will be helpful in searching video data on portable media players such as PMPs and cellular phones.