• 한국자동차공학회논문집
• /
• 제24권2호
• /
• pp.127-136
• /
• 2016

The camera based object detection systems should satisfy the recognition performance as well as real-time constraints. Particularly, in safety-critical systems such as Autonomous Emergency Braking (AEB), the real-time constraints significantly affects the system performance. Recently, multi-core processors and system-on-chip technologies are widely used to accelerate the object detection algorithm by distributing computational loads. However, due to the advanced hardware, the complexity of system architecture is increased even though additional hardwares improve the real-time performance. The increased complexity also cause difficulty in migration of existing algorithms and development of new algorithms. In this paper, to improve real-time performance and design complexity, a task scheduling strategy is proposed for visual object tracking systems. The real-time performance of the vision algorithm is increased by applying pipelining to task scheduling in a multi-core processor. Finally, the proposed task scheduling algorithm is applied to crosswalk detection and tracking system to prove the effectiveness of the proposed strategy.

• 정보처리학회논문지:컴퓨터 및 통신 시스템
• /
• 제12권12호
• /
• pp.363-370
• /
• 2023

도로와 주변의 상황을 정확히 인지하는 객체탐지 기술은 자율주행 분야에 핵심적인 기술이다. 자율주행 분야에 객체탐지 기술은 추론 서비스의 정확도와 함께 실시간성도 요구된다. 고성능 머신이 아닌 자원제약 기기에서 정확도와 함께 실시간성을 위한 객체탐지 기술을 적용하기 위해서는 태스크 오프로딩 기술을 활용해야 한다. 본 논문에서는 자원 제약적 기기에서 자율주행의 실시간 객체탐지를 위한 태스크 오프로딩 적용과 관련하여 태스크 오프로딩의 성능 비교, 입력 이미지 해상도에 따른 성능 비교, 카메라 객체 해상도에 따른 성능 비교 등의 실험을 수행하고 결과를 분석하였다. 본 실험에서 낮은 해상도의 이미지는 태스크 오프로딩 구조의 적용을 통하여 성능 개선을 도출할 수 있었고, 이는 자율주행의 실시간 기준을 충족하였다. 높은 해상도의 이미지는 성능 개선은 있었으나 통신 시간의 증가에 따른 이유로 자율 주행의 실시간 기준을 충족하지 못하였다. 이러한 실험을 통해 자율주행에서의 객체인식은 사용하는 객체인식 모델과 함께 입력 이미지, 통신 환경 등의 다양한 조건이 영향을 미친다는 것을 확인할 수 있었다.

• 로봇학회논문지
• /
• 제14권1호
• /
• pp.1-7
• /
• 2019

Recently, smart factories have attracted much attention as a result of the 4th Industrial Revolution. Existing factory automation technologies are generally designed for simple repetition without using vision sensors. Even small object assemblies are still dependent on manual work. To satisfy the needs for replacing the existing system with new technology such as bin picking and visual servoing, precision and real-time application should be core. Therefore in our work we focused on the core elements by using deep learning algorithm to detect and classify the target object for real-time and analyzing the object features. We chose YOLO CNN which is capable of real-time working and combining the two tasks as mentioned above though there are lots of good deep learning algorithms such as Mask R-CNN and Fast R-CNN. Then through the line and inside features extracted from target object, we can obtain final outline and estimate object posture.

• 제어로봇시스템학회논문지
• /
• 제21권8호
• /
• pp.766-772
• /
• 2015

This paper proposes an object detection method based on motion estimation using background subtraction in the fisheye images obtained through omni-directional camera mounted on the vehicle. Recently, most of the vehicles installed with rear camera as a standard option, as well as various camera systems for safety. However, differently from the conventional object detection using the image obtained from the camera, the embedded system installed in the vehicle is difficult to apply a complicated algorithm because of its inherent low processing performance. In general, the embedded system needs system-dependent algorithm because it has lower processing performance than the computer. In this paper, the location of object is estimated from the information of object's motion obtained by applying a background subtraction method which compares the previous frames with the current ones. The real-time detection performance of the proposed method for object detection is verified experimentally on embedded board by comparing the proposed algorithm with the object detection based on LKOF (Lucas-Kanade optical flow).

• 방송공학회논문지
• /
• 제25권2호
• /
• pp.192-199
• /
• 2020

최근 딥러닝 모델을 기반으로 한 객체 추적 알고리즘의 활용도가 증가하고 있다. 영상에서의 다중 객체의 추적을 위한 시스템은 대표적으로 객체 검출 알고리즘과 객체 추적 알고리즘의 연쇄된 형태로 구성되어있다. 하지만 여러 모듈로 구성된 연쇄 형태의 시스템은 고성능 컴퓨팅 환경을 요구하며 실제 어플리케이션으로의 적용에 제한사항으로 존재한다. 본 논문에서는 위와 같은 객체 검출-추적의 연쇄 형태의 시스템에서 객체 검출 모듈의 연산 관련 프로세스를 조정하여 저성능 컴퓨팅 환경에서도 실시간 동작을 가능하게 하는 방법을 제안한다.

• Journal of Information Processing Systems
• /
• 제19권4호
• /
• pp.439-449
• /
• 2023

This paper deals with a resource efficient artificial intelligence (AI) service architecture for multi-channel video streams. As an AI service, we consider the object detection model, which is the most representative for video applications. Since most object detection models are basically designed for a single channel video stream, the utilization of the additional resource for multi-channel video stream processing is inevitable. Therefore, we propose a resource efficient AI service framework, which can be associated with various AI service models. Our framework is designed based on the modular architecture, which consists of adaptive frame control (AFC) Manager, multiplexer (MUX), adaptive channel selector (ACS), and YOLO interface units. In order to run only a single YOLO process without regard to the number of channels, we propose a novel approach efficiently dealing with multi-channel input streams. Through the experiment, it is shown that the framework is capable of performing object detection service with minimum resource utilization even in the circumstance of multi-channel streams. In addition, each service can be guaranteed within a deadline.

• 대한임베디드공학회논문지
• /
• 제17권6호
• /
• pp.319-327
• /
• 2022

Transformers are the most famous deep learning models that has achieved great success in natural language processing and also showed good performance on computer vision. In this survey, we categorized transformer-based models for computer vision, particularly object detection tasks and perform comprehensive comparative experiments to understand the characteristics of each model. Next, we evaluated the models subdivided into standard transformer, with key point attention, and adding attention with coordinates by performance comparison in terms of object detection accuracy and real-time performance. For performance comparison, we used two metrics: frame per second (FPS) and mean average precision (mAP). Finally, we confirmed the trends and relationships related to the detection and real-time performance of objects in several transformer models using various experiments.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제14권5호
• /
• pp.2141-2155
• /
• 2020

In order to meet the requirements of background change, illumination variation, moving shadow interference and high accuracy in object detection of moving camera, and strive for real-time and high efficiency, this paper presents an object detection algorithm based on sparse approximation recursion and sparse coding migration in subspace. First, low-rank sparse decomposition is used to reduce the dimension of the data. Combining with dictionary sparse representation, the computational model is established by the recursive formula of sparse approximation with the video sequences taken as subspace sets. And the moving object is calculated by the background difference method, which effectively reduces the computational complexity and running time. According to the idea of sparse coding migration, the above operations are carried out in the down-sampling space to further reduce the requirements of computational complexity and memory storage, and this will be adapt to multi-scale target objects and overcome the impact of large anomaly areas. Finally, experiments are carried out on VDAO datasets containing 59 sets of videos. The experimental results show that the algorithm can detect moving object effectively in the moving camera with uniform speed, not only in terms of low computational complexity but also in terms of low storage requirements, so that our proposed algorithm is suitable for detection systems with high real-time requirements.

• 한국정보통신학회:학술대회논문집
• /
• 한국해양정보통신학회 2009년도 추계학술대회
• /
• pp.574-578
• /
• 2009

정지 영상이나 비디오 영상 시퀀스에서 배경 영상으로부터 움직이는 관심 물체를 구별하기 위한 실시간 물체 검출은 물체의 위치 추적과 인식에 있어 필수적인 단계이다. 물체 분할 후에 그림자 영역이 움직이는 물체 영역에 포함되어지기 때문에 그림자는 물체의 일부분 혹은 움직이는 물체로 오분류될 수 있다. 이러한 이유로 그림자 제거 알고리즘은 움직이는 물체 검출 및 추적 시스템의 결과에 중요한 역할을 한다. 이 문제점들을 해결하기 위해 본 논문에서는 움직이는 물체의 특징과 색상공간에서 그림자의 특징에 기반을 둔 정확한 물체 검출과 그림자 제거 알고리즘을 제안한다. 실험결과는 제안 알고리즘이 실험 영상에서 물체 검출과 그림자 제거에 대해 효과적인 것을 알 수가 있다.

• ETRI Journal
• /
• 제37권3호
• /
• pp.551-561
• /
• 2015

We propose a novel multiple-object tracking algorithm for real-time intelligent video surveillance. We adopt particle filtering as our tracking framework. Background modeling and subtraction are used to generate a region of interest. A two-step pedestrian detection is employed to reduce the computation time of the algorithm, and an iterative particle repropagation method is proposed to enhance its tracking accuracy. A matching score for greedy data association is proposed to assign the detection results of the two-step pedestrian detector to trackers. Various experimental results demonstrate that the proposed algorithm tracks multiple objects accurately and precisely in real time.