• Journal of the Korea Computer Graphics Society
• /
• v.30 no.3
• /
• pp.109-123
• /
• 2024

Research into vision-based end-to-end autonomous driving systems utilizing deep learning and reinforcement learning has been steadily increasing. These systems typically encode continuous and high-dimensional vehicle states, such as location, velocity, orientation, and sensor data, into latent features, which are then decoded into a vehicular control policy. The complexity of urban driving environments necessitates the use of state representation learning through networks like Variational Autoencoders (VAEs) or Convolutional Neural Networks (CNNs). This paper analyzes the impact of different image state encoding methods on reinforcement learning performance in autonomous driving. Experiments were conducted in the CARLA simulator using RGB images and semantically segmented images captured by the vehicle's front camera. These images were encoded using VAE and Vision Transformer (ViT) networks. The study examines how these networks influence the agents' learning outcomes and experimentally demonstrates the role of each state representation technique in enhancing the learning efficiency and decision- making capabilities of autonomous driving systems.

• Journal of Korea Game Society
• /
• v.10 no.2
• /
• pp.49-56
• /
• 2010

In this paper, we propose a control method of virtual hand by the recognition of a user's hand in the virtual reality game environment. We display virtual hand on the game screen after getting the information of the user's hand movement and the direction thru input images by camera. We can utilize the movement of a user's hand as an input interface for virtual hand to select and move the object. As a hand recognition method based on the vision technology, the proposed method transforms input image from RGB color space to HSV color space, then segments the hand area using double threshold of H, S value and connected component analysis. Next, The center of gravity of the hand area can be calculated by 0 and 1 moment implementation of the segmented area. Since the center of gravity is positioned onto the center of the hand, the further apart pixels from the center of the gravity among the pixels in the segmented image can be recognized as fingertips. Finally, the axis of the hand is obtained as the vector of the center of gravity and the fingertips. In order to increase recognition stability and performance the method using a history buffer and a bounding box is also shown. The experiments on various input images show that our hand recognition method provides high level of accuracy and relatively fast stable results.

• Journal of Navigation and Port Research
• /
• v.39 no.4
• /
• pp.299-305
• /
• 2015

Modbus is a serial communications protocol, it has since become a practically standard communication protocol, and it is now a commonly available means of connecting industrial electronic devices. Therefore, it can be connected with all devices using Modbus protocol to the measurement and remote control on the ships, buildings, trains, airplanes and etc.. In this paper, we add the Modbus communication protocol to the existing lighting controller sensitivity to enable verification and remote control by external environmental factors, and also introduces a fuzzy inference system was configured by external environmental factors to control LED lighting. External environmental factors of temperature, humidity, illuminance value represented by the LED through a fuzzy control algorithm, the values accepted by the controller through the sensor. Modbus is using the RS485 Serial communication with other devices connected to the temperature, humidity, illumination and LED output status check is possible. In addition, the remote user is changed to enable it is possible to change the RGB values in the desired color change. Produced was confirmed that the LED controller output is based on the temperature, humidity and illumination.

• IE interfaces
• /
• v.19 no.3
• /
• pp.174-180
• /
• 2006

This paper deals with the robot system of recognizing human's expression from a detected human's face and then showing human's emotion. A face detection method is as follows. First, change RGB color space to CIElab color space. Second, extract skin candidate territory. Third, detect a face through facial geometrical interrelation by face filter. Then, the position of eyes, a nose and a mouth which are used as the preliminary data of expression, he uses eyebrows, eyes and a mouth. In this paper, the change of eyebrows and are sent to a robot through serial communication. Then the robot operates a motor that is installed and shows human's expression. Experimental results on 10 Persons show 78.15% accuracy.

• Journal of the Korean Graphic Arts Communication Society
• /
• v.21 no.2
• /
• pp.43-53
• /
• 2003

As information-communication network has been developed rapidly, internet users' circumstances also have been changed for the better, in result, more information can be applied than before. At this moment, there are many differences between real color and reappeared color on the CRT. When we observe a material object, our eyes perceive the multiplied form of light sources and nature spectral reflection. However, when the photographed signal is reappeared, illumination at that time of photographing and spectral reflection of a material object are converted into signal, and this converted RGB signal is observed on the CRT under another illumination. At this time, RGB signal is the reflected result of illumination at that time of photographing Therefore, this signal is influenced by the illumination at present, so it can be perceived another color. To accord the colro reflections of another color source, the study has been reported by S.C.Ahn$^{[1]}$, which study is about the color reapperarance system using neuron network. Furthermore, color reappearing method become independent of its circumstances has been reported by Y.Miyake$^{[2]}$. This method can make the same illuminations even if the observe circumstances are changed. To assume the light sources of observe circumstances, the study about color reappearing system using CCD sensor also have been studied by S.C.Ahn$^{[3]}$. In these studies, a population is fixed, first, on ab coordinates of CIE L${\ast}$a${\ast}$b${\ast}$. Then, color reappearing can be possible using every population and existing digital camera. However, the color is changed curvedly, not straightly, according to value's changes on the ab coordinates of CIE L${\ast}$a${\ast}$b. To solve these problems in this study, first of all, Labeling techniques are introduced. Next, basis color-it is based on Munsell color system-is divided into 10 color fields. And then, 4 special color- skin color, grass color, sky color, and gray-are added to the basis color. Finally, 14 color fields are fixed. After analyzing of the principle elements of new-defined-color fields' population, utility value and propriety value are going to be examined in 3-Band system from now on.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2010.05a
• /
• pp.463-466
• /
• 2010

In this paper, CCTV based fire surveillance system should aim to development. Advantages and Disadvantages analyzed of Existing sensor-based fire surveillance system and video-based fire surveillance system. To national support U-City, U-Home, U-Campus, etc, spread the ubiquitous environment appropriate to fire surveillance system model and a fire judgement technology. For this study, Microsoft LifeCam VX-1000 using through the capturing images and analyzed for apple and tomato, Finally we used H.264. The client uses the Linux OS with ARM9 S3C2440 board was manufactured, the client's role is passed to the server to processed capturing image. Client and the server is basically a 1:1 video communications. So to multiple receive to video multicast support will be a specification. Is fire surveillance system designed for multiple video communication. Video data from the RGB format to YUV format and transfer and fire detection for Y value. Y value is know movement data. The red color of the fire is determined to detect and calculate the value of Y at the fire continues to detect the movement of flame.

• Electronics and Telecommunications Trends
• /
• v.27 no.3
• /
• pp.62-72
• /
• 2012

IT 기술과 콘텐츠 기술이 융합된 가상현실 기술은 최근 산업, 의료, 엔터테인먼트, 교육, 문화 체험, 국방, 건축 등 적용이 널리 증가되고 있다. 본고에서는 실감형 가상현실 상호작용 기술의 동향과 활용 사례를 통하여, 핵심기술 요소와 시장 활용성 및 향후 응용 분야를 제시한다. 특히, Physical User Interface(PUI) 센서, depth 센서(혹은 RGB-D 센서) 등 3D 인터페이스를 통해 사용자의 위치 추적 및 사용자의 의도를 실시간으로 분석하고, 주변 환경에 대한 그래픽적인 표현 및 시각화에 의해 콘텐츠와 그래픽적인 표현 및 시각화에 의해 콘텐츠와 자연스럽게 상호작용하는 기법에 관한 동향을 중심으로 소개한다.

• Proceedings of the IEEK Conference
• /
• 2000.11d
• /
• pp.33-36
• /
• 2000

To create a more realistic soccer game derived from TV images, we are developing an image synthesis system that generates 3D image sequence from TV images. We propose the method for the team and the pose recognition of players in TV images. The representation includes camera calibration method, team recognition method and pose recognition method. To find the location of a player on the field, a field model is constructed and a player's field position is transformed by 4-feature points. To recognize the team information of players, we compute RGB mean values and standard deviations of a player in TV images. Finally, to recognize pose of a player, this system computes the velocity and the ratio of player(height/width). Experimental results are included to evaluate the performance of the team and the pose recognition.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.60 no.6
• /
• pp.1183-1189
• /
• 2011

In this study, we propose the unsupervised image segmentation algorithm to estimate dental plaque accumulations on digital imaging with methylene blue disclosed plaque. With this aim, RGB color plane is mapped into HSI coordinates and the circular histogram of Hue is reconstructed by applying Otsu's threshold level. The histogram distribution on Saturation features is also analyzed by maximizing the variance between a plaque candidate and non-plaque one. The dental plaque regions are resolved by applying the composite decision logics based on the threshold level of Hue and Saturation.

• Proceedings of the Korean Printing Society Conference
• /
• 2000.12a
• /
• pp.0.2-0
• /
• 2000

Most important step for the color matching in scanner is the color coordinate transformation from the scanner RGB space to device independent uniform color space. A variety of color calibration technologies have been developed for input device. Linear or nonlinear matrices have been conveniently applied to correct the color filter\`s mismatch with color matching function in scanners. The color matching accuracy is expected to be further improved when the nonlinear matrices are optimized into subdivided smaller color spaces than in single matrix of the entire color space. This article proposed the scanner calibration method using subspace division regression analysis and it were compared with conventional method.