• Journal of Integrative Natural Science
• /
• v.9 no.2
• /
• pp.155-160
• /
• 2016

Applying image processing techniques to education, the face of the learner is photographed, and expression and movement are detected from video, and the system which estimates degree of concentration of the learner is developed. For one learner, the measuring system is designed in terms of estimating a degree of concentration from direction of line of learner's sight and condition of the eye. In case of multiple learners, it must need to measure each concentration level of all learners in the classroom. But it is inefficient because one camera per each learner is required. In this paper, position in the face region is estimated from video which photographs the learner in the class by the difference between frames within the motion direction. And the system which detects the face direction by the face part detection by template matching is proposed. From the result of the difference between frames in the first image of the video, frontal face detection by Viola-Jones method is performed. Also the direction of the motion which arose in the face region is estimated with the migration length and the face region is tracked. Then the face parts are detected to tracking. Finally, the direction of the face is estimated from the result of face tracking and face parts detection.

• Proceedings of the KOSOMBE Conference
• /
• v.1997 no.05
• /
• pp.313-315
• /
• 1997

We developed a new analysis technique for the assessment of irregular vibratory movement of vocal folds. Successive frames of pre-recorded video images from videostroboscopy were transferred to computer memory and a vibratory tract of one selected point was described as a waveform by displaying the same lines of all frames along the y-direction. By applying this technique, irregular vibratory patterns of multiple regions, such as asynchronized registration of glottal cycles, could be easily visualized. It would be possible to monitor and analyze the pathologic changes of vocal fold movement by means of this newly developed system.

• Proceedings of the Korea Concrete Institute Conference
• /
• 2008.11a
• /
• pp.221-224
• /
• 2008

A secant stiffness linear analysis method was developed for moment redistribution of moment-resisting frames. In the proposed method, rotational spring models are used for plastic hinges of the members whose flexural moments are needed to be redistributed. At the plastic hinges, secant stiffness is used to address the effect of the flexural stiffness reduced by inelastic deformation. Linear analysis is repeated with adjusted secant stiffness until the flexural equilibrium is satisfied in the structure and members. By using the secant stiffness analysis, the effect of the inelastic deformation on the moment redistribution can be considered. Further, the safety of plastic hinges can be evaluated by comparing the inelastic rotation resulting from the secant stiffness analysis with the rotational capacity of the plastic hinges. For verification, the proposed method was applied to a continuous beam tested in previous study. A application example for a multiple story moment-resisting frame was presented.

• Journal of Communications and Networks
• /
• v.13 no.2
• /
• pp.132-141
• /
• 2011

IEEE 802.15.4 networks are a feasible platform candidate for connecting all health-care-related equipment dispersed across a hospital room to collect critical time-sensitive data about patient health state, such as the heart rate and blood pressure. To meet the quality of service requirements of health-care systems, this paper proposes a multi-priority queue system that differentiates between various types of frames. The effect of the proposed system on the average delay and throughput is explored herein. By employing different contention window parameters, as in IEEE 802.11e, this multi-queue system prioritizes frames on the basis of priority classes. Performance under both saturated and unsaturated traffic conditions was evaluated using a novel analytical model that comprehensively integrates two legacy models for 802.15.4 and 802.11e. To improve the accuracy, our model also accommodates the transmission retries and deferment algorithms that significantly affect the performance of IEEE 802.15.4. The multi-queue scheme is predicted to separate the average delay and throughput of two different classes by up to 48.4% and 46%, respectively, without wasting bandwidth. These outcomes imply that the multi-queue system should be employed in health-care systems for prompt allocation of synchronous channels and faster delivery of urgent information. The simulation results validate these model's predictions with a maximum deviation of 7.6%.

• Earthquakes and Structures
• /
• v.17 no.1
• /
• pp.63-73
• /
• 2019

This paper studies damage detection as an optimization problem. A new objective function based on changes in natural frequencies, and Natural Frequency Vector Assurance Criterion (NFVAC) was developed. Due to their easy and fast acquisition, natural frequencies were utilized to detect structural damages. Moreover, they are sensitive to stiffness reduction. The method presented here consists of two stages. Firstly, Finite Element Model (FEM) is updated. Secondly, damage severities and locations are determined. To minimize the proposed objective function, a new bio-inspired optimization algorithm called salp swarm was employed. Efficiency of the method presented here is validated by three experimental examples. The first example relates to three-story shear frame with two single damage cases in the first story. The second relates to a five-story shear frame with single and multiple damage cases in the first and third stories. The last one relates to a large-scale eight-story shear frame with minor damage case in the first and third stories. Moreover, the performance of Salp Swarm Algorithm (SSA) was compared with Particle Swarm Optimization (PSO). The results show that better accuracy is obtained using SSA than using PSO. The obtained results clearly indicate that the proposed method can be used to determine accurately and efficiently both damage location and severity in multi-story shear frames.

• International Journal of Computer Science & Network Security
• /
• v.22 no.9
• /
• pp.316-326
• /
• 2022

The prompt development in the field of video is the outbreak of online services which replaces the television media within a shorter period in gaining popularity. The online videos are encouraged more in use due to the captions displayed along with the scenes for better understandability. Not only entertainment media but other marketing companies and organizations are utilizing videos along with captions for their product promotions. The need for captions is enabled for its usage in many ways for hearing impaired and non-native people. Research is continued in an automatic display of the appropriate messages for the videos uploaded in shows, movies, educational videos, online classes, websites, etc. This paper focuses on two concerns namely the first part dealing with the machine learning method for preprocessing the videos into frames and resizing, the resized frames are classified into multiple actions after feature extraction. For the feature extraction statistical method, GLCM and Hu moments are used. The second part deals with the deep learning method where the CNN architecture is used to acquire the results. Finally both the results are compared to find the best accuracy where CNN proves to give top accuracy of 96.10% in classification.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.8 no.3
• /
• pp.1058-1070
• /
• 2014

There are two major ways to implement depth estimation, multiple image depth estimation and single image depth estimation, respectively. The former has a high hardware cost because it uses multiple cameras but it has a simple software algorithm. Conversely, the latter has a low hardware cost but the software algorithm is complex. One of the recent trends in this field is to make a system compact, or even portable, and to simplify the optical elements to be attached to the conventional camera. In this paper, we present an implementation of depth estimation with a single image using a graphics processing unit (GPU) in a desktop PC, and achieve real-time application via our evolutional algorithm and parallel processing technique, employing a compute shader. The methods greatly accelerate the compute-intensive implementation of depth estimation with a single view image from 0.003 frames per second (fps) (implemented in MATLAB) to 53 fps, which is almost twice the real-time standard of 30 fps. In the previous literature, to the best of our knowledge, no paper discusses the optimization of depth estimation using a single image, and the frame rate of our final result is better than that of previous studies using multiple images, whose frame rate is about 20fps.

• IE interfaces
• /
• v.25 no.2
• /
• pp.264-275
• /
• 2012

The process of semiconductor(IC Package) manufacturing usually includes lots of complex and sequential processes. Many kinds of equipments are installed with the mixed concept of serial and parallel manufacturing system. The business environments of the semiconductor industry have been changed frequently, because new technologies are developed continuously. It is the main reason of new investment plan and layout consideration. However, it is difficult to change the layout after installation, because the major equipments are expensive and difficult to move. Furthermore, it is usually a multiple-objective problem. Thus, new investment or layout change should be carefully considered when the production environments likewise product mix and production quantity are changed. This paper introduces a simulation case study of a Korean company that produces packaging substrates(especially lead frames) and requires multi-objective decision support. $QUEST^{(R)}$ is used for simulation modelling and AHP(Analytic Hierarchy Process) and DEA(Data Envelopment Analysis) are used for weighting of qualitative performance measures and solving multiple-objective layout problem, respectively.

• Journal of Korea Multimedia Society
• /
• v.22 no.2
• /
• pp.167-177
• /
• 2019

Even though so much progresses have been achieved in Multiple Object Tracking (MOT), most of reported MOT methods are not still satisfactory for commercial embedded products like Pan-Tilt-Zoom (PTZ) camera. In this paper, we propose a real-time multiple pedestrians tracking method for embedded environments. First, we design a new light weight convolutional neural network(CNN)-based pedestrian detector, which is constructed to detect even small size pedestrians, as well. For further saving of processing time, the designed detector is applied for every other frame, and Kalman filter is employed to predict pedestrians' positions in frames where the designed CNN-based detector is not applied. The pose orientation information is incorporated to enhance object association for tracking pedestrians without further computational cost. Through experiments on Nvidia's embedded computing board, Jetson TX2, it is verified that the designed pedestrian detector detects even small size pedestrians fast and well, compared to many state-of-the-art detectors, and that the proposed tracking method can track pedestrians in real-time and show accuracy performance comparably to performances of many state-of-the-art tracking methods, which do not target for operation in embedded systems.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.54 no.2
• /
• pp.123-129
• /
• 2017

This paper proposes a new nonnegative matrix factorization (NMF) based direction-of-arrival (DOA) estimation method for multiple sound sources using a dual microphone array. First of all, sound signals coming from the dual microphone array are segmented into consecutive analysis frames, and a steered-response power phase transform (SRP-PHAT) beamformer is applied to each frame so that stereo signals of each frame are represented in a time-direction domain. The time-direction outputs of SRP-PHAT are stored for a pre-defined number of frames, which is referred to as a time-direction block. Next, In order to estimate DOAs robust to noise, each time-direction block is normalized along the time by using a block subtraction technique. After that, an unsupervised NMF method is applied to the normalized time-direction block in order to cluster the directions of each sound source in a multiple sound source environments. In particular, the activation and basis matrices are used to estimate the number of sound sources and their DOAs, respectively. The DOA estimation performance of the proposed method is evaluated by measuring a mean absolute error (MAE) and the standard deviation of errors between the oracle and estimated DOAs under a three source condition, where the sources are located in [$-35{\circ}$, 5m], [$12{\circ}$, 4m], and [$38{\circ}$, 4.m] from the dual microphone array. It is shown from the experiment that the proposed method could relatively reduce MAE by 56.83%, compared to a conventional SRP-PHAT based DOA estimation method.