• Title/Summary/Keyword: Extractor

Search Result 366, Processing Time 0.029 seconds

Development of Emotion Recognition Model Using Audio-video Feature Extraction Multimodal Model (음성-영상 특징 추출 멀티모달 모델을 이용한 감정 인식 모델 개발)

  • Jong-Gu Kim;Jang-Woo Kwon
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.24 no.4
    • /
    • pp.221-228
    • /
    • 2023
  • Physical and mental changes caused by emotions can affect various behaviors, such as driving or learning behavior. Therefore, recognizing these emotions is a very important task because it can be used in various industries, such as recognizing and controlling dangerous emotions while driving. In this paper, we attempted to solve the emotion recognition task by implementing a multimodal model that recognizes emotions using both audio and video data from different domains. After extracting voice from video data using RAVDESS data, features of voice data are extracted through a model using 2D-CNN. In addition, the video data features are extracted using a slowfast feature extractor. And the information contained in the audio and video data, which have different domains, are combined into one feature that contains all the information. Afterwards, emotion recognition is performed using the combined features. Lastly, we evaluate the conventional methods that how to combine results from models and how to vote two model's results and a method of unifying the domain through feature extraction, then combining the features and performing classification using a classifier.

Characteristics of the electrospraying combustion using grooved nozzle (홈노즐을 이용한 정전분무 확산 연소 특성에 관한 연구)

  • Kim, Woo-Jin;Kim, Kyoung-Tae;Kim, Sang-Soo
    • Proceedings of the KSME Conference
    • /
    • 2007.05b
    • /
    • pp.2366-2371
    • /
    • 2007
  • Spray combustion characteristics of a conducting fuel electrospray have been studied for clean combustion technology. The multiplexing system which can retain the characteristics of the cone-jet mode is inevitable for the electrospray application. Charged micro droplets can be obtained in almost uniform size during operating the electrospray in the cone-jet mode. This experiment device set up the multiplexed grooved nozzle system with the extractor. Using the grooved nozzle, the stable cone-jet mode can be achieved at the each groove in the grooved mode. This electrospray system was applied to the diffusion combustion. It is the first step to discover the diffusion combustion characteristics of the electrospray. In case of the single grooved nozzle electrospray, the diffusion flames are occurred at each jet of grooved mode and they are quite stable. The exhaust gas analysis was indicated that there is the critical point which can make very stable diffusion combustion.

  • PDF

Object-Oriented Simulation-Based Expert System Using a Smalltalk Paradigm (Smalltalk 패러다임을 이용한 객체지향 시뮬레이션기반 전문가시스템)

  • 김선욱;양문희
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.24 no.66
    • /
    • pp.1-10
    • /
    • 2001
  • Simulation-Based Expert System(SIMBES) is a very effective tool to solve complex antral hard problems. The SIMBES model includes a simulator, a feature extractor, a machine learning system, a performance evaluator, and a Knowledge-Based Expert System(KBES). Since SIMBES depends on Problem domains, a schedule-based material requirements planning problem, which is NP-hard, was selected to exemplify the SIMBES model. To implement the SIMBES application in Smalltalk paradigm, a system class hierarchy was constructed. The hierarchy consists of five large classes such as Job Generator, Job Scheduler, Job Evaluator, Inference Engine, and Executive System. Several classes inside these classes were identified. Additionally, instance protocols about all classes have been described in terms of messages and pseudo methods. These protocols can be implemented easily by any other object-oriented languages. Furthermore, these results may be used as a skeletal system to develop a new SIMBES efficiently, especially when the application is related to other scheduling problems.

  • PDF

Extraction of Lane-Reined Information Based on an EDF and Hough Transform (EDF와 하프변환 기반의 차선관련 정보 검출)

  • Lee Joonwoong;Lee Kiyong
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.13 no.3
    • /
    • pp.48-57
    • /
    • 2005
  • This paper presents a novel algorithm in order to extract lane-related information based on machine vision techniques. The algorithm makes up for the weak points of the former method, the Edge Distribution Function(EDF)-based approach, by introducing a Lane Boundary Pixel Extractor (LBPE) and the well-known Hough Transform(HT). The LBPE that serves as a filter to extract pixels expected to be on lane boundaries enhances the robustness of machine vision, and provides its results to the HT implementation and EDF construction. The HT forms the accumulator arrays and extracts the lane-related parameters composed of orientation and distance. Furthermore, as the histogram of edge magnitude with respect to edge orientation angle, the EDF has peaks at the orientations corresponding to lane slopes on the perspective image domain. Therefore, by fusing the results from the EDF and the HT the proposed algorithm improves the confidence of the extracted lane-related information. The system shows successful results under various degrees of illumination.

A Study on the SPICE Model Parameter Extraction Method for the DC Model of the High Voltage MOSFET (High Voltage MOSFET의 DC 해석 용 SPICE 모델 파라미터 추출 방법에 관한 연구)

  • Lee, Un-Gu
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.60 no.12
    • /
    • pp.2281-2285
    • /
    • 2011
  • An algorithm for extracting SPICE MOS level 2 model parameters for the high voltage MOSFET DC model is proposed. The optimization method for analyzing the nonlinear data of the current-voltage curve using the Gauss-Newton algorithm is proposed and the pre-process step for calculating the threshold voltage and the mobility is proposed. The drain current obtained from the proposed method shows the maximum relative error of 5.6% compared with the drain current of 2-dimensional device simulation for the high voltage MOSFET.

Reducing Channel Capacity for Scalable Video Coding in a Distributed Network

  • Kim, Hyun-Pil;Lee, Suk-Han;Lee, Jung-Hee;Lee, Yong-Surk
    • ETRI Journal
    • /
    • v.32 no.6
    • /
    • pp.863-870
    • /
    • 2010
  • In recent years, the development of multimedia devices has meant that a wider multimedia streaming service can be supported, and there are now many ways in which TV channels can communicate with different terminals. Generally, scalable video streaming is known to provide more efficient channel capacity than simulcast video streaming. Simulcast video streaming requires a large network bandwidth for all resolutions, but scalable video streaming needs only one flow for all resolutions. In previous research, scalable video streaming has been compared with simulcast video streaming for network channel capacity, in two user simulation environments. The simulation results show that the channel capacity of SVC is 16% to 20% smaller than AVC, but scalable video streaming is not efficient because of the limit of the present network framework. In this paper, we propose a new network framework with an SVC extractor. The proposed network framework shows a channel capacity 50% (maximum) lower than that found in previous research studies.

An Embedded system for real time gas monitoring using an ART2 neural network

  • Cho, Jung-Hwan;Shim, Chang-Hyun;Lee, In-Soo;Lee, Duk-Dong;Jeon, Gi-Joon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.479-482
    • /
    • 2003
  • We propose a real time gas monitoring system for classifying various gases with different concentrations. Using thermal modulation of operating temperature of two sensors, we extract patterns of gases from the voltage across the load resistance. We adopt the relative resistance as a pre-processing method and an ART2 neural network as a pattern recognition method. The proposed method has been implemented in a real time embedded system with tin oxide gas sensors, TGS 2611, 2602 and an MSP430 ultra-low power microcontroller in the test chamber.

  • PDF

H2M e-learning System Based on Object Extractor Technology (동영상 객체추출 기술 기반의 H2M e-learning 시스템 제안)

  • Park Seung-Beom;Lee Sang-Jun;Song Ho-Yeong;Kim Byoung-Ki
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2006.05a
    • /
    • pp.771-774
    • /
    • 2006
  • 본 논문에서는 양방향 인터넷 방송을 위하여 연구되고 있는 고품질 동영상 콘텐츠의 객체 분할 기술을 이용하여 컴퓨터와 사용자간의 인터랙션을 개선하여 학습 몰입도를 높이고 고품질의 서비스를 제공하는 H2M(Human to Machine) e-learning 시스템을 제안한다. 본 시스템에서는 고품질 동영상 콘텐츠 및 기타 정보를 한눈에 볼 수 있으며 에듀테인먼트를 가미한 H2M e-learning시스템에 적합한 새로운 인터페이스를 제공하고자 한다.

  • PDF

Contemporary Organic Contamination Levels in Digested Sewage Sludge from Treatment Plants in Korea : (3) Organophosphorus Insecticides (우리나라 하수 및 폐수 처리 슬러지의 유기인계 살충제의 함량)

  • Hong Gi-Hoon;Lee Kang-Young;Chung Chang-Soo;Lee Hyun-Kyung
    • Journal of Environmental Science International
    • /
    • v.15 no.3
    • /
    • pp.229-236
    • /
    • 2006
  • Organophosphorus pesticides (OPPs) contents in the sewage sludge derived from the residential and industrial areas were determined in order to characterize contemporary organic contamination levels as a part of the ongoing development of the environmentally sound sewage sludge management strategy in Korea. OPPs were extracted from freeze-dried sludges in a ultrasonic extractor. The extracts were cleaned-up by florisil column and subsequently fed into gas chromatograph/nitrogen phosphorus detector (GC/NPD) for determining OPP contents. Diazinon, dimethoate, disulfoton, EPN, malathion, methyl parathion, parathion, phorate and sulfotep were present in the appreciable amount in the domestic sewage sludges. The sum of the 9 OPPs in the sewage sludge varied from 534.8 to 15552.1 ${\mu}g/kg$, dry wt..

Touch TT: Scene Text Extractor Using Touchscreen Interface

  • Jung, Je-Hyun;Lee, Seong-Hun;Cho, Min-Su;Kim, Jin-Hyung
    • ETRI Journal
    • /
    • v.33 no.1
    • /
    • pp.78-88
    • /
    • 2011
  • In this paper, we present the Touch Text exTractor (Touch TT), an interactive text segmentation tool for the extraction of scene text from camera-based images. Touch TT provides a natural interface for a user to simply indicate the location of text regions with a simple touchline. Touch TT then automatically estimates the text color and roughly locates the text regions. By inferring text characteristics from the estimated text color and text region, Touch TT can extract text components. Touch TT can also handle partially drawn lines which cover only a small section of text area. The proposed system achieves reasonable accuracy for text extraction from moderately difficult examples from the ICDAR 2003 database and our own database.