• Title/Summary/Keyword: Sign Image

Search Result 296, Processing Time 0.027 seconds

Sign Language Image Recognition System Using Artificial Neural Network

  • Kim, Hyung-Hoon;Cho, Jeong-Ran
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.2
    • /
    • pp.193-200
    • /
    • 2019
  • Hearing impaired people are living in a voice culture area, but due to the difficulty of communicating with normal people using sign language, many people experience discomfort in daily life and social life and various disadvantages unlike their desires. Therefore, in this paper, we study a sign language translation system for communication between a normal person and a hearing impaired person using sign language and implement a prototype system for this. Previous studies on sign language translation systems for communication between normal people and hearing impaired people using sign language are classified into two types using video image system and shape input device. However, existing sign language translation systems have some problems that they do not recognize various sign language expressions of sign language users and require special devices. In this paper, we use machine learning method of artificial neural network to recognize various sign language expressions of sign language users. By using generalized smart phone and various video equipment for sign language image recognition, we intend to improve the usability of sign language translation system.

Sign Image Database Collected at Jeonju Hanok Village (전주 한옥마을에서 수집한 간판영상 데이터베이스)

  • Oh, Il-Seok;Heo, Gi-Su
    • The Journal of the Korea Contents Association
    • /
    • v.6 no.11
    • /
    • pp.243-248
    • /
    • 2006
  • Recognition of sign has been studied to provide convenience tour information for foreigners and strangers through automatic recognition of sign. The sign image database is essential to training the classifier and to intuitive measurement of performance. In this paper, we described the sign image database collected at Jeonju Hanok Village. As to 45 each other sign image, corresponding 50 images are collected under several condition. This database could be important content to study for the field of pattern recognition.

  • PDF

Numeric Sign Language Interpreting Algorithm Based on Hand Image Processing (영상처리 기반 숫자 수화표현 인식 알고리즘)

  • Gwon, Kyungpil;Yoo, Joonhyuk
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.14 no.3
    • /
    • pp.133-142
    • /
    • 2019
  • The existing auxiliary communicating aids for the hearing-impaired have an inconvenience of using additional expensive sensing devices. This paper presents a hand image detection based algorithm to interpret the sign language of the hearing-impaired. The proposed sign language recognition system exploits the hand image only captured by the camera without using any additional gloves with extra sensors. Based on the hand image processing, the system can perfectly classify several numeric sign language representations. This work proposes a simple lightweight classification algorithm to identify the hand image of the hearing-impaired to communicate with others even further in an environment of complex background. Experimental results show that the proposed system can interpret the numeric sign language quite well with an accuracy of 95.6% on average.

A Study on the Semiotic Application about the Image Vestmental (의상 이미지의 응용 기호론적 연구(I)-엘자 스키아파렐리의 3가지 의상 이미지에 관하여-)

  • 최인순
    • Journal of the Korean Society of Costume
    • /
    • v.38
    • /
    • pp.101-122
    • /
    • 1998
  • The purpose of this study is to define the fundamentals of one symbolic concept, so calles vestment-sign, based on the logical relationship of sign system about the trichotomy by charles S. Peice's sign concept for the communication system of meaning in the non-linguistic image domain. To prove the argument of vestment-sign, I selected 3 type of vestment language by styliste, Elsa Schiaparel-li. The third image vestmental chosen here, titled“Larme-Illusion(1938)”,printed by Salvad-or Dali will produce one symbolic proposition as a logical result which is generated and developed through the interpretation of other images. First of all the text, which is manifested by Elsa Schiaparelli's first image vestmental, tit-led“Notation Musical(1937)”and is symbolized as one category in the representation of the form, is regarded symbolic and metaphorical from a standpoint that the title and the meaning is connected to the form. The second image vestment, titled“Ruches Noirs(1938)”represents externally splendid feminity man-ifested by the symbolic and metaphorical expression. And the purity of sensitivity aiming to humanity in the detail of the poetic feeling of naturalism makes us imagine the battle fild of furious sensitivity. Like as the result of the battle, the third image stimulated our eyesight with the“absence”of dressing function. The proposition of the text,《Death》which the third image delivers, constructs sign system to bring up a meaning with the disappearance of physical“signifier”. This establishment of the symbolic concept presents the etymological authority of symbol generation called“Design”.

  • PDF

Research on Methods to Increase Recognition Rate of Korean Sign Language using Deep Learning

  • So-Young Kwon;Yong-Hwan Lee
    • Journal of Platform Technology
    • /
    • v.12 no.1
    • /
    • pp.3-11
    • /
    • 2024
  • Deaf people who use sign language as their first language sometimes have difficulty communicating because they do not know spoken Korean. Deaf people are also members of society, so we must support to create a society where everyone can live together. In this paper, we present a method to increase the recognition rate of Korean sign language using a CNN model. When the original image was used as input to the CNN model, the accuracy was 0.96, and when the image corresponding to the skin area in the YCbCr color space was used as input, the accuracy was 0.72. It was confirmed that inserting the original image itself would lead to better results. In other studies, the accuracy of the combined Conv1d and LSTM model was 0.92, and the accuracy of the AlexNet model was 0.92. The CNN model proposed in this paper is 0.96 and is proven to be helpful in recognizing Korean sign language.

  • PDF

Recognition Model of Road Signs Using Image Segmentation Algorithm (세그멘테이션 알고리즘을 사용한 도로 Sign 인식 모델)

  • Huang, Ying;Song, Jeong-Young
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.2
    • /
    • pp.233-237
    • /
    • 2013
  • Image recognition is an important research area of pattern recognition. This paper studies that the image segmentation algorithm theory and its application in road signs recognition system. In this paper We studied a systematic study for road signs and we have made the recognition algorithm. This paper is divided in image segmentation part and image recognition part for the road signs recognition. The experimental results show that the road signs recognition model can make effective use in smart phone system, and the model can be used in many other fields.

Gradation Image Processing for Text Recognition in Road Signs Using Image Division and Merging

  • Chong, Kyusoo
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.13 no.2
    • /
    • pp.27-33
    • /
    • 2014
  • This paper proposes a gradation image processing method for the development of a Road Sign Recognition Platform (RReP), which aims to facilitate the rapid and accurate management and surveying of approximately 160,000 road signs installed along the highways, national roadways, and local roads in the cities, districts (gun), and provinces (do) of Korea. RReP is based on GPS(Global Positioning System), IMU(Inertial Measurement Unit), INS(Inertial Navigation System), DMI(Distance Measurement Instrument), and lasers, and uses an imagery information collection/classification module to allow the automatic recognition of signs, the collection of shapes, pole locations, and sign-type data, and the creation of road sign registers, by extracting basic data related to the shape and sign content, and automated database design. Image division and merging, which were applied in this study, produce superior results compared with local binarization method in terms of speed. At the results, larger texts area were found in images, the accuracy of text recognition was improved when images had been gradated. Multi-threshold values of natural scene images are used to improve the extraction rate of texts and figures based on pattern recognition.

Vision-Based Roadway Sign Recognition

  • Jiang, Gang-Yi;Park, Tae-Young;Hong, Suk-Kyo
    • Transactions on Control, Automation and Systems Engineering
    • /
    • v.2 no.1
    • /
    • pp.47-55
    • /
    • 2000
  • In this paper, a vision-based roadway detection algorithm for an automated vehicle control system, based on roadway sign information on roads, is proposed. First, in order to detect roadway signs, the color scene image is enhanced under hue-invariance. Fuzzy logic is employed to simplify the enhanced color image into a binary image and the binary image is morphologically filtered. Then, an effective algorithm of locating signs based on binary rank order transform (BROT) is utilized to extract signs from the image. This algorithm performs better than those previously presented. Finally, the inner shapes of roadway signs with curving roadway direction information are recognized by neural networks. Experimental results show that the new detection algorithm is simple and robust, and performs well on real sign detection. The results also show that the neural networks used can exactly recognize the inner shapes of signs even for very noisy shapes.

  • PDF

Automatic Recognition of Direction Information in Road Sign Image Using OpenCV (OpenCV를 이용한 도로표지 영상에서의 방향정보 자동인식)

  • Kim, Gihong;Chong, Kyusoo;Youn, Junhee
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.31 no.4
    • /
    • pp.293-300
    • /
    • 2013
  • Road signs are important infrastructures for safe and smooth traffic by providing useful information to drivers. It is necessary to establish road sign DB for managing road signs systematically. To provide such DB, manually detection and recognition from imagery can be done. However, it is time and cost consuming. In this study, we proposed algorithms for automatic recognition of direction information in road sign image. Also we developed algorithm code using OpenCV library, and applied it to road sign image. To automatically detect and recognize direction information, we developed program which is composed of various modules such as image enhancement, image binarization, arrow region extraction, interesting point extraction, and template image matching. As a result, we can confirm the possibility of automatic recognition of direction information in road sign image.

An Automatic Road Sign Recognizer for an Intelligent Transport System

  • Miah, Md. Sipon;Koo, Insoo
    • Journal of information and communication convergence engineering
    • /
    • v.10 no.4
    • /
    • pp.378-383
    • /
    • 2012
  • This paper presents the implementation of an automatic road sign recognizer for an intelligent transport system. In this system, lists of road signs are processed with actions such as line segmentation, single sign segmentation, and storing an artificial sign in the database. The process of taking the video stream and extracting the road sign and storing in the database is called the road sign recognition. This paper presents a study on recognizing traffic sign patterns using a segmentation technique for the efficiency and the speed of the system. The image is converted from one scale to another scale such as RGB to grayscale or grayscale to binary. The images are pre-processed with several image processing techniques, such as threshold techniques, Gaussian filters, Canny edge detection, and the contour technique.