• Smart Structures and Systems
• /
• 제24권6호
• /
• pp.745-757
• /
• 2019

Road surface deteriorations such as potholes have caused motorists heavy monetary damages every year. However, effective road condition monitoring has been a continuing challenge to road owners. Depth cameras have a small field of view and can be easily affected by vehicle bouncing. Traditional image processing methods based on algorithms such as segmentation cannot adapt to varying environmental and camera scenarios. In recent years, novel object detection methods based on deep learning algorithms have produced good results in detecting typical objects, such as faces, vehicles, structures and more, even in scenarios with changing object distances, camera angles, lighting conditions, etc. Therefore, in this study, a Deep Learning Pothole Detector (DLPD) based on the deep region-based convolutional neural network is proposed for autonomous detection of potholes from images. About 900 images with potholes and road surface conditions are collected and divided into training and testing data. Parameters of the network in the DLPD are calibrated based on sensitivity tests. Then, the calibrated DLPD is trained by the training data and applied to the 215 testing images to evaluate its performance. It is demonstrated that potholes can be automatically detected with high average precision over 93%. Potholes can be differentiated from manholes by training and applying a manhole-pothole classifier which is constructed using the convolutional neural network layers in DLPD. Repeated detection of the same potholes can be prevented through feature matching of the newly detected pothole with previously detected potholes within a small region.

• 한국통신학회논문지
• /
• 제41권8호
• /
• pp.843-850
• /
• 2016

This paper introduces a novel modulation scheme for vehicular communication in taking advantage of existing LED lights available on a car. Our proposed 2-Phase Shift Keying (2-PSK) is a spatial modulation approach in which a pair of LED light sources in a car (either rear LEDs or front LEDs) is used as a transmitter. A typical camera (i.e. low frame rate at no greater than 30fps) that either a global shutter camera or a rolling shutter camera can be used as a receiver. The modulation scheme is a part of our Image Sensor Communication proposal submitted to IEEE 802.15.7r1 (TG7r1) recently. Also, a neural network approach is applied to improve the performance of LEDs detection and decoding under the noisy situation. Later, some analysis and experiment results are presented to indicate the performance of our system

• 한국정보통신학회논문지
• /
• 제3권4호
• /
• pp.867-873
• /
• 1999

카메라 교정(Camera calibration)은 알고있는 월드 좌표계(world coordinate system)의 제어점(control points)들에 대하여 카메라의 내부/외부 인자(internal and external parameters)들을 계산하는 과정이다. 정확한 카메라 교정은 정밀한 측정을 위해서 반드시 요구된다. 본 논문에서, 우리는 3D 기하학이나 카메라 광학에 대한 특별한 지식을 요구하지 않는 신경망을 이용하여 간단하면서도 유연한 카메라 교정을 제안한다. 제안한 방법은 내부/외부 인자를 요구하지 않는 응용 분야에 매우 유용하다. 또한 제안한 카메라 교정은 물체가 이미지 평면과 거의 평행할 경우에 발생하는 악조건(ill-condition)문제를 해결할 수 있는 장점을 가졌다. 이러한 악조건은 시각 시스템을 이용하여 제품 검사를 할 경우에 흔히 발생한다. 좀더 정확한 교정을 위해 획득한 이미지는 렌즈의 방사형 왜곡에 따라 두 개의 지역으로 분할하여 교정된다. 그리고 Tsai의 알고리즘을 이용한 결과와 제안한 방법을 이용하여 교정한 결과를 실험을 통해 타당성을 증명한다.

• 전기전자학회논문지
• /
• 제21권3호
• /
• pp.268-271
• /
• 2017

본 논문에서는 1200만 화소의 고해상도 $360^{\circ}$ 전방위 IP 카메라의 개발을 제안한다. 제안하는 1200만 화소의 고해상도 $360^{\circ}$ 전방위 IP 카메라는 $360^{\circ}$ 전방위 시야각의 렌즈 부와 1200만 화소 고해상도 IP 카메라 부로 구성된다. $360^{\circ}$ 전방위 시야각의 렌즈 부는 등사영 렌즈 설계방식과 catadioptric 면 제작방식을 적용하여 어안 렌즈에서 필연적으로 발생되고 있는 주변부 왜곡현상이 없는 화상을 얻을 수 있도록 한다. 1200만 화소 고해상도 IP 카메라 부는 CMOS 센서 & ISP 부, DSP 부, I/O 부 등으로 구성하여 카메라에 들어온 영상을 디지털 영상으로 변환하여 영상 왜곡 보정, 영상 보정, 영상 압축 등의 기능 등을 수행한 후에, NVR(Network Video Recorder)에 전송한다. 제안된 1200만 화소의 고해상도 $360^{\circ}$ 전방위 IP 카메라의 성능을 평가하기 위하여 외부시험기관에서 실험한 결과, 1200만 화소의 영상효율, $360^{\circ}$ 전방위 렌즈 화각, 전자파 인증 규격 등이 목표값에 적합하게 측정됨이 확인되었다.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 2001년도 추계학술대회 학술발표 논문집
• /
• pp.263-266
• /
• 2001

It has been integrated into several navigation systems. This paper shows that system recognizes difficult indoor roads and open area without any specific mark such as painted guide line or tape. In this method, Robot navigates with visual sensors, which uses visual information to navigate itself along the road. An Artificial Neural Network System was used to decide where to move. It is designed with USB web camera as visual sensor.

• 한국정밀공학회:학술대회논문집
• /
• 한국정밀공학회 1995년도 추계학술대회 논문집
• /
• pp.341-343
• /
• 1995

In this paper, an algorithm is presented to recogniz the driving direction of a vehicle and obstacles in front of it based on highway road image. The algorithm employs a neural network with 27 sub sets obtained from the road image as its input. The outputs include the direction of the vehicle movement and presence or absence of obstacles. The road image, obtained by a video camera, was digitized and processed by a personal computer equipped with an image processing board.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2004년도 ICCAS
• /
• pp.2033-2036
• /
• 2004

A novel approach to estimate the real time moving trajectory of an object is proposed in this paper. The object position is obtained from the image data of a CCD camera, while a state estimator predicts the linear and angular velocities of the moving object. To overcome the uncertainties and noises residing in the input data, a Kalman filter and neural networks are utilized. Since the Kalman filter needs to approximate a non-linear system into a linear model to estimate the states, there always exist errors as well as uncertainties again. To resolve this problem, the neural networks are adopted in this approach, which have high adaptability with the memory of the input-output relationship. Kohonen Network(Self-Organized Map) is selected to learn the motion trajectory since it is spatially oriented. The superiority of the proposed algorithm is demonstrated through the real experiments.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• 제2권1호
• /
• pp.1-8
• /
• 2002

It has been integrated into several navigation systems. This paper shows that system recognizes difficult indoor roads without any specific marks such as painted guide line or tape. In this method the robot navigates with visual sensors, which uses visual information to navigate itself along the read. The Neural Network System was used to learn driving pattern and decide where to move. In this paper, I will present a vision-based process for AMR(Autonomous Mobile Robot) that is able to navigate on the indoor read with simple computation. We used a single USB-type web camera to construct smaller and cheaper navigation system instead of expensive CCD camera.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제10권7호
• /
• pp.3100-3116
• /
• 2016

With the rapid development of urban traffic system and fast increasing of vehicle numbers, the traditional centralized ways to generate the source-destination shortest path in terms of travel time(the optimal path) encounter several problems, such as high server pressure, low query efficiency, roads state without in-time updating. With the widespread use of smart cameras in the urban traffic and surveillance system, this paper maps the optimal path finding problem in the dynamic road network to the shortest routing problem in the smart camera networks. The proposed distributed optimal path generation algorithm employs the delay routing and caching mechanism. Real-time route update is also presented to adapt to the dynamic road network. The test result shows that this algorithm has advantages in both query time and query packet numbers.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2002년도 하계학술대회 논문집 D
• /
• pp.2780-2782
• /
• 2002

In this paper Valentine Braitenberg structure based sensory motor model for object tracking control system was proposed. Conventional model based control schemes are require highly non-linear mathematical models, which require long computational time to solve complex high order equations. Contrast to conventional models proposed system simply link signal data from camera directly to the inputs of neural network, and outputs of network are directly fed into input of motor driver of camera. With simple structure of sensory motor model, real time tracking control system for dynamic object was realized successfully, and the implementation of sensory motor model can overcome the limitation of model-based control schemes.