• Title/Summary/Keyword: interface detection

Search Result 540, Processing Time 0.031 seconds

Real Time Lip Reading System Implementation in Embedded Environment (임베디드 환경에서의 실시간 립리딩 시스템 구현)

  • Kim, Young-Un;Kang, Sun-Kyung;Jung, Sung-Tae
    • The KIPS Transactions:PartB
    • /
    • v.17B no.3
    • /
    • pp.227-232
    • /
    • 2010
  • This paper proposes the real time lip reading method in the embedded environment. The embedded environment has the limited sources to use compared to existing PC environment, so it is hard to drive the lip reading system with existing PC environment in the embedded environment in real time. To solve the problem, this paper suggests detection methods of lip region, feature extraction of lips, and awareness methods of phonetic words suitable to the embedded environment. First, it detects the face region by using face color information to find out the accurate lip region and then detects the exact lip region by finding the position of both eyes from the detected face region and using the geometric relations. To detect strong features of lighting variables by the changing surroundings, histogram matching, lip folding, and RASTA filter were applied, and the properties extracted by using the principal component analysis(PCA) were used for recognition. The result of the test has shown the processing speed between 1.15 and 2.35 sec. according to vocalizations in the embedded environment of CPU 806Mhz, RAM 128MB specifications and obtained 77% of recognition as 139 among 180 words were recognized.

Image Processing Based Virtual Reality Input Method using Gesture (영상처리 기반의 제스처를 이용한 가상현실 입력기)

  • Hong, Dong-Gyun;Cheon, Mi-Hyeon;Lee, Donghwa
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.24 no.5
    • /
    • pp.129-137
    • /
    • 2019
  • Ubiquitous computing technology is emerging as information technology advances. In line with this, a number of studies are being carried out to increase device miniaturization and user convenience. Some of the proposed devices are user-friendly and uncomfortable with hand-held operation. To address these inconveniences, this paper proposed a virtual button that could be used in watching television. When watching a video on television, a camera is installed at the top of the TV, using the fact that the user watches the video from the front, so that the camera takes a picture of the top of the head. Extract the background and hand area separately from the filmed image, extract the outline to the extracted hand area, and detect the tip point of the finger. Detection of the end point of the finger produces a virtual button interface at the top of the image being filmed in front, and the button activates when the end point of the detected finger becomes a pointer and is located inside the button.

Video Browsing Using An Efficient Scene Change Detection in Telematics (텔레매틱스에서 효율적인 장면전환 검출기법을 이용한 비디오 브라우징)

  • Shin Seong-Yoon;Pyo Seong-Bae
    • Journal of the Korea Society of Computer and Information
    • /
    • v.11 no.4 s.42
    • /
    • pp.147-154
    • /
    • 2006
  • Effective and efficient representation of color features of multiple video frames is an important vet challenging task for visual information management systems. This paper Proposes a Video Browsing Service(VBS) that provides both the video content retrieval and the video browsing by the real-time user interface on Web. For the scene segmentation and key frame extraction of video sequence, we proposes an efficient scene change detection method that combine the RGB color histogram with the X2 (Chi Square) histogram. Resulting key frames are linked by both physical and logical indexing. This system involves the video editing and retrieval function of a VCR's. Three elements that are the date, the need and the subject are used for video browsing. A Video Browsing Service is implemented with MySQL, PHP and JMF under Apache Web Server.

  • PDF

Object Detection and Optical Character Recognition for Mobile-based Air Writing (모바일 기반 Air Writing을 위한 객체 탐지 및 광학 문자 인식 방법)

  • Kim, Tae-Il;Ko, Young-Jin;Kim, Tae-Young
    • The Journal of Korean Institute of Next Generation Computing
    • /
    • v.15 no.5
    • /
    • pp.53-63
    • /
    • 2019
  • To provide a hand gesture interface through deep learning in mobile environments, research on the light-weighting of networks is essential for high recognition rates while at the same time preventing degradation of execution speed. This paper proposes a method of real-time recognition of written characters in the air using a finger on mobile devices through the light-weighting of deep-learning model. Based on the SSD (Single Shot Detector), which is an object detection model that utilizes MobileNet as a feature extractor, it detects index finger and generates a result text image by following fingertip path. Then, the image is sent to the server to recognize the characters based on the learned OCR model. To verify our method, 12 users tested 1,000 words using a GALAXY S10+ and recognized their finger with an average accuracy of 88.6%, indicating that recognized text was printed within 124 ms and could be used in real-time. Results of this research can be used to send simple text messages, memos, and air signatures using a finger in mobile environments.

Detection of different foreign bodies in the maxillofacial region with spiral computed tomography and cone-beam computed tomography: An in vitro study

  • Abolvardi, Masoud;Akhlaghian, Marzieh;Shishvan, Hadi Hamidi;Dastan, Farivar
    • Imaging Science in Dentistry
    • /
    • v.50 no.4
    • /
    • pp.291-298
    • /
    • 2020
  • Purpose: The detection and exact localization of penetrating foreign bodies are crucial for the appropriate management of patients with dentoalveolar trauma. This study compared the efficacy of cone-beam computed tomography (CBCT) and spiral computed tomography (CT) scans for the detection of different foreign bodies composed of 5 frequently encountered materials in 2 sizes. The effect of the location of the foreign bodies on their visibility was also analyzed. Materials and Methods: In this in vitro study, metal, tooth, stone, glass, and plastic particles measuring 1×1×1 mm and 2×2×2 mm were prepared. They were implanted in a sheep's head in the tongue muscle, nasal cavity, and at the interface of the mandibular cortex and soft tissue. CBCT and spiral CT scans were taken and the visibility of foreign bodies was scored by 4 skilled maxillofacial radiologists who were blinded to the location and number of foreign bodies. Results: CT and CBCT were equally accurate in visualizing metal, stone, and tooth particles of both sizes. However, CBCT was better for detecting glass particles in the periosteum. Although both imaging modalities visualized plastic particles poorly, CT was slightly better for detecting plastic particles, especially the smaller ones. Conclusion: Considering the lower patient radiation dose and cost, CBCT can be used with almost equal accuracy as CT for detecting foreign bodies of different compositions and sizes in multiple maxillofacial regions. However, CT performed better for detecting plastic particles.

Gated Conductivity Imaging using KHU Mark2 EIT System with Nano-web Fabric Electrode Interface (나노웹 섬유형 전극 인터페이스와 KHU Mark2 EIT 시스템을 이용한 생체신호 동기 도전율 영상법)

  • Kim, Tae-Eui;Kim, Hyun-Ji;Wi, Hun;Oh, Tong-In;Woo, Eung-Je
    • Journal of Biomedical Engineering Research
    • /
    • v.33 no.1
    • /
    • pp.39-46
    • /
    • 2012
  • Electrical impedance tomography(EIT) can produce functional images with conductivity distributions associated with physiological events such as cardiac and respiratory cycles. EIT has been proposed as a clinical imaging tool for the detection of stroke and breast cancer, pulmonary function monitoring, cardiac imaging and other clinical applications. However EIT still suffers from technical challenges such as the electrode interface, hardware limitations, lack of animal or human trials, and interpretation of conductivity variations in reconstructed images. We improved the KHU Mark2 EIT system by introducing an EIT electrode interface consisting of nano-web fabric electrodes and by adding a synchronized biosignal measurement system for gated conductivity imaging. ECG and respiration signals are collected to analyze the relationship between the changes in conductivity images and cardiac activity or respiration. The biosignal measurement system provides a trigger to the EIT system to commence imaging and the EIT system produces an output trigger. This EIT acquisition time trigger signal will also allow us to operate the EIT system synchronously with other clinical devices. This type of biosignal gated conductivity imaging enables capture of fast cardiac events and may also improve images and the signal-to-noise ratio (SNR) by using signal averaging methods at the same point in cardiac or respiration cycles. As an example we monitored the beat by beat cardiac-related change of conductivity in the EIT images obtained at a common state over multiple respiration cycles. We showed that the gated conductivity imaging method reveals cardiac perfusion changes in the heart region of the EIT images on a canine animal model. These changes appear to have the expected timing relationship to the ECG and ventilator settings that were used to control respiration. As EIT is radiation free and displays high timing resolution its ability to reveal perfusion changes may be of use in intensive care units for continuous monitoring of cardiopulmonary function.

Game Interface using Robust Skin Color Detection (조명 변화에 강건한 피부색 검출을 사용한 게 임 인터페이스)

  • 장상수;박혜선;김항준
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.10b
    • /
    • pp.736-738
    • /
    • 2004
  • 최근 사용자의 제스처를 이용한 게임 시스템에 대한 연구가 많은 관심을 받고 있다. 사용자의 얼굴 및 손의 움직임을 이용하여 게임을 제어하기 위해서는 복잡한 배경 및 조명에 강건한 얼굴 및 손 영역의 추출이 필수적이다. 본 논문에서는 조명 변화에 강건한 피부색 검출을 이용한 게임 인터페이스를 제안한다. 이를 위해 제안된 시스템은 다음의 두 단계로부터 얼굴 및 손 영역을 추출한다. 먼저, 피부색과 유사한 물건들을 제거하기 위해 배경 영상과 현재 영상의 차영상으로부터 전경물체를 추출한다. 그 다음, 조명에 의한 깜박임이나 잡음을 줄이기 위해서 SCT 알고리즘을 이용하여 전경물체 영역 안에서 피부색 영역만을 정확하게 검출한다. 추출된 얼굴 및 손의 움직임으로부터 얻어지는 제스처는 은닉마르코프 모델을 사용하여 인식된다. 복잡한 환경에서 실험한 결과, 제안된 시스템은 정확한 피부색 영역 검출을 제공하고 이를 통한 보다 정확한 인식률을 제공할 수 있다는 것이 증명되었다.

  • PDF

Information Modeling for BIM Based Design of Precast Concrete Platform (BIM 기반의 설계를 위한 프리캐스트 콘크리트 승강장의 정보모델링)

  • Jeong, Ji-Sook;Lee, Kwang-Myong;Park, Ki-Hyun;Park, Young-Shik
    • Journal of KIBIM
    • /
    • v.4 no.1
    • /
    • pp.1-7
    • /
    • 2014
  • The construction method using PC(Precast Concrete) has been widely used because the method can shorten the construction period and improve construction quality. In this paper, through the analysis of present design process for PC railway platform, design parameters on the geometry and properties were extracted and 3D information models for PC railway platform were constructed by the parametric modeling technique. Furthermore, the interface module was developed to link 3D models to the structural analysis/design sheet and database program using VBA(Visual Basic Application). This information model could be used in various areas including structural analysis and design, 2D drawing, quantity estimation and 4D simulation including clash detection.

Liquid Crystal Droplet Patterns to Monitor Catalase Activity at Femtomolar Levels

  • Yoon, Stephanie;Jang, Chang-Hyun
    • Bulletin of the Korean Chemical Society
    • /
    • v.35 no.9
    • /
    • pp.2704-2710
    • /
    • 2014
  • Catalase (CAT) decomposes hydrogen peroxide that is toxic to the body. In this study, simple and sensitive detector has been developed for observing catalase activity using liquid crystal droplet system. Microscale LC droplet patterns are formed by spreading aldehyde-doped nematic liquid crystal on pre-treated glass slides. When hydrogen peroxide is added, aldehyde is oxidized and amphiphiles are formed. Dodecanoates cause the pattern to transit from bright to dark as they self-assemble to form a carboxyalte monolayer at the interface. When a drop of pre-incubated CAT and hydrogen peroxide mixture is placed onto the pattern, bright fan-shape is observed. This planar optical appearance indicates that catalase has decomposed hydrogen peroxide. Compared to the detectors that have been previously developed, this system is more sensitive with detection limit of 1fM. This research suggests further studies to be on LC droplet patterning to develop highly sensitive and methodologically simple sensors for various chemicals.

Classification System of EEG Signals During Mental Tasks

  • Seo Hee Don;Kim Min Soo;Eoh Soo Hae;Huang Xiyue;Rajanna K.
    • Proceedings of the IEEK Conference
    • /
    • 2004.08c
    • /
    • pp.671-674
    • /
    • 2004
  • We propose accurate classification method of EEG signals during mental tasks. In the experimental task, the tasks of subjects show 3 major measurements; there are mathematical tasks, color decision tasks, and Chinese phrase tasks. The classifier implemented for this work is a feed-forward neural network that trained with the error back-propagation algorithm. The new BCI system is proposed by using neural network. In this system, tr e architecture of the neural network is composed of three layers with a feed-forward network, which implements the error back propagation-learning algorithm. By applying this algorithm to 4 subjects, we achieved $95{\%}$ classification rates. The results for BCI mathematical task experiments show performance better than those of the Chinese phrase tasks. The selection time of each task depends on the mental task of subjects. We expect that the proposed detection method can be a basic technology for brain-computer interface by combining with left/right hand movement or yes/no discrimination methods.

  • PDF