• Title/Summary/Keyword: Real Time Object Detection

Search Result 520, Processing Time 0.026 seconds

Real-Time Foreground and Facility Extraction with Deep Learning-based Object Detection Results under Static Camera-based Video Monitoring (고정 카메라 기반 비디오 모니터링 환경에서 딥러닝 객체 탐지기 결과를 활용한 실시간 전경 및 시설물 추출)

  • Lee, Nayeon;Son, Seungwook;Yu, Seunghyun;Chung, Yongwha;Park, Daihee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.11a
    • /
    • pp.711-714
    • /
    • 2021
  • 고정 카메라 환경에서 전경과 배경 간 픽셀값의 차를 이용하여 전경을 추출하기 위해서는 정확한 배경 영상이 필요하다. 또한, 프레임마다 변화하는 실제 배경과 맞추기 위해 배경 영상을 지속해서 갱신할 필요가 있다. 본 논문에서는 정확한 배경 영상을 생성하기 위해 실시간 처리가 가능한 딥러닝 기반 객체 탐지기의 결과를 입력받아 영상 처리에 활용함으로써 배경을 생성 및 지속적으로 갱신하고, 획득한 배경 정보를 이용해 전경을 추출하는 방법을 제안한다. 먼저, 고정 카메라에서 획득되는 비디오 데이터에 딥러닝 기반 객체 탐지기를 적용한 박스 단위 객체 탐지 결과를 지속적으로 입력받아 픽셀 단위의 배경 영상을 갱신하고 개선된 배경 영상을 도출한다. 이후, 획득한 배경 영상을 이용하여 더 정확한 전경 영상을 획득한다. 또한, 본 논문에서는 시설물에 가려진 객체를 더 정확히 탐지하기 위해서 전경 영상을 이용하여 시설물 영상을 추출하는 방법을 제안한다. 실제 돈사에 설치된 카메라로 부터 획득된 12시간 분량의 비디오를 이용하여 실험한 결과, 제안 방법을 이용한 전경과 시설물 추출이 효과적임을 확인하였다.

Virtual Design and Construction (VDC)-Aided System for Logistics Monitoring: Supply Chains in Liquefied Natural Gas (LNG) Plant Construction

  • Moon, Sungkon;Chi, Hung-Lin;Forlani, John;Wang, Xiangyu
    • International conference on construction engineering and project management
    • /
    • 2015.10a
    • /
    • pp.195-199
    • /
    • 2015
  • Many conventional management methods have emphasized the minimization of required resources along the supply chain. Accordingly, this paper presents a proposed method called the Virtual Design and Construction (VDC)-aided system. It is based on object-oriented resource control, in order to accomplish a feed-forward control monitoring supply chain logistics. The system is supported by two main parts: (1) IT-based Technologies; and (2) VDC Models. They enable the system to convey proactive information from the detection technology to its linked visualization. The paper includes a field study as the system's pre-test: the Scaffolding Works in a LNG Mega Project. The study demonstrates a system of real-time productivity monitoring by use of the RFIDbased Mobile Information Hub. The on-line 'productivity dashboard' provides an opportunity to display the continuing processes for each work-package. This research project offers the observed opportunities created by the developed system. Future work will entail research experiments aimed towards system validation.

  • PDF

A Robust Real-time Object Detection Method using Dominant Colors in Images (이미지의 주요 색상 정보들을 이용한 실시간 객체 검출 방법)

  • Park, Kyung-Wook;Koh, Jae-Han;Park, Jae-Han;Baeg, Seung-Ho;Baeg, Moon-Hong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2007.05a
    • /
    • pp.301-304
    • /
    • 2007
  • 자동으로 이미지 안에 존재하는 객체들을 인식하는 문제는 내용 기반 이미지 검색이나 로봇 비전과 같은 다양한 분야들에서 매우 중요한 문제이다. 이 문제를 해결하기 위하여 본 논문에서는 객체의 주요 색상 정보들을 이용하여 실시간으로 이미지 안의 객체들을 인식하는 알고리즘을 제안한다. 본 논문에서 제안하는 방법의 전체적인 구조는 다음과 같다. 처음에 MPEG-7 색상 정보 기술자들 중 하나인 주요 색상 정보 기술자를 이용하여 객체의 주요 색상 정보들을 추출한다. 이 때 이 정보는 가우시안 색상 모델링을 통하여 빛이나 그림자와 같은 외부 환경 조건에 좀 더 강인한 색상 정보로 변환된다. 다음으로 변환된 색상 정보들을 기반으로 주요 객체와 입력 이미지와의 픽셀 값차이를 계산하고, 임계값 이상의 값을 가지는 픽셀들을 제거한다. 마지막으로 입력 이미지에서 제거되지 않은 픽셀들을 기반으로 하나의 영역을 생성한다. 결론으로서, 본 논문에서는 제안된 방법에 대한 실험 평가들을 수행 및 분석하고 몇몇 한계점들에 대해서 알아본다. 또한 이 문제들을 해결하기 위한 앞으로의 연구 계획에 대해서 기술한다.

The Study of Barista Robots Utilizing Collaborative Robotics and AI Technology (협동로봇과 AI 기술을 활용한 바리스타 로봇 연구)

  • Do Hyeong Kwon;Tae Myeong Ha;Jae Seong Lee;Yun Sang Jeong;Yeong Geon Kim;Hyeon Gak Kim;Seung Jun Song;Dae Gil O;Geonu Lee;Jae Won Jeong;Seungwoon Park;Chul-Hee Lee
    • Journal of Drive and Control
    • /
    • v.21 no.3
    • /
    • pp.36-45
    • /
    • 2024
  • Collaborative robots, designed for direct interaction with humans have limited adaptability to environmental changes. This study addresses this limitation by implementing a barista robot system using AI technology. To overcome limitations of traditional collaborative robots, a model that applies a real-time object detection algorithm to a 6-degree-of-freedom robot arm to recognize and control the position of random cups is proposed. A coffee ordering application is developed, allowing users to place orders through the app, which the robot arm then automatically prepares. The system is connected to ROS via TCP/IP socket communication, performing various tasks through state transitions and gripper control. Experimental results confirmed that the barista robot could autonomously handle processes of ordering, preparing, and serving coffee.

A Study of Kalman Filter Adaptation for Protecting Aquaculture Farms (양식어장보호를 위한 칼만필터 적용에 관한 연구)

  • Nam, Taek-Kun;Jeong, Jung-Sik;Jong, Jae-Yong;Yang, Won-Jae;Ahn, Young-Sup
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • v.29 no.1
    • /
    • pp.273-277
    • /
    • 2005
  • In this paper, we study on adaptation of the kalman filter for FDS(fishery detection system) to protect and aquaculture farms. The FDS will detect a robbing vessel with real time and a variance of the position of fishing fields. The kalman filter for tracking system that can be detect and track the approaching object without mounting F-AIS(Fishery Automatic Identification System) is applied. Some simulation results for the acceleration object with white noise is showed and the possibility of adaptation for tracking system is discussed.

  • PDF

A Hardware Design of Feature Detector for Realtime Processing of SIFT(Scale Invariant Feature Transform) Algorithm in Embedded Systems (임베디드 환경에서 SIFT 알고리즘의 실시간 처리를 위한 특징점 검출기의 하드웨어 구현)

  • Park, Chan-Il;Lee, Su-Hyun;Jeong, Yong-Jin
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.46 no.3
    • /
    • pp.86-95
    • /
    • 2009
  • SIFT is an algorithm to extract vectors at pixels around keypoints, in which the pixel colors are very different from neighbors, such as vertices and edges of an object. The SIFT algorithm is being actively researched for various image processing applications including 3D image reconstructions and intelligent vision system for robots. In this paper, we implement a hardware to sift feature detection algorithm for real time processing in embedded systems. We estimate that the hardware implementation give a performance 25ms of $1,280{\times}960$ image and 5ms of $640{\times}480$ image at 100MHz. And the implemented hardware consumes 45,792 LUTs(85%) with Synplify 8.li synthesis tool.

Land Use Feature Extraction and Sprawl Development Prediction from Quickbird Satellite Imagery Using Dempster-Shafer and Land Transformation Model

  • Saharkhiz, Maryam Adel;Pradhan, Biswajeet;Rizeei, Hossein Mojaddadi;Jung, Hyung-Sup
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.1
    • /
    • pp.15-27
    • /
    • 2020
  • Accurate knowledge of land use/land cover (LULC) features and their relative changes over upon the time are essential for sustainable urban management. Urban sprawl growth has been always also a worldwide concern that needs to carefully monitor particularly in a developing country where unplanned building constriction has been expanding at a high rate. Recently, remotely sensed imageries with a very high spatial/spectral resolution and state of the art machine learning approaches sent the urban classification and growth monitoring to a higher level. In this research, we classified the Quickbird satellite imagery by object-based image analysis of Dempster-Shafer (OBIA-DS) for the years of 2002 and 2015 at Karbala-Iraq. The real LULC changes including, residential sprawl expansion, amongst these years, were identified via change detection procedure. In accordance with extracted features of LULC and detected trend of urban pattern, the future LULC dynamic was simulated by using land transformation model (LTM) in geospatial information system (GIS) platform. Both classification and prediction stages were successfully validated using ground control points (GCPs) through accuracy assessment metric of Kappa coefficient that indicated 0.87 and 0.91 for 2002 and 2015 classification as well as 0.79 for prediction part. Detail results revealed a substantial growth in building over fifteen years that mostly replaced by agriculture and orchard field. The prediction scenario of LULC sprawl development for 2030 revealed a substantial decline in green and agriculture land as well as an extensive increment in build-up area especially at the countryside of the city without following the residential pattern standard. The proposed method helps urban decision-makers to identify the detail temporal-spatial growth pattern of highly populated cities like Karbala. Additionally, the results of this study can be considered as a probable future map in order to design enough future social services and amenities for the local inhabitants.

Efficient Tracking System for Passengers with the Detection Algorithm of a Stopping Vehicle (차량정차감지 알고리즘을 이용한 탑승자의 효율적 위치추적시스템)

  • Lee, Byung-Mun;Shin, Hyun-Ho;Kang, Un-Gu
    • Journal of Internet Computing and Services
    • /
    • v.12 no.6
    • /
    • pp.73-82
    • /
    • 2011
  • The location-based service is emerging again to the public attention. The location recognition environment up-to-now has been studied with its focus only on a person, an object or a moving object. However, this study proposes a location recognition model that serves to recognize and track, in real time, multiple passengers in a moving vehicle. Identifying the locations of passengers can be classified into two classes: one is to use the high price terminal with GPS function, and the other is to use the economic price compact terminal without GPS function. Our model enables the simple compact terminal to provide effective location recognition under the on-boarding situation by transmitting messages through an interface device and sensor networks for a vehicle equipped with GPS. This technology reduces transmission traffic after detecting the condition of a vehicle (being parked or running), because it does not require transmission/receiving of information on the locations of passengers who are confined in a vehicle when the vehicle is running. Also it extends battery life by saving power consumption of the compact terminal. Hence, we carried out experiments to verify its serviceability by materializing the efficient tracking system for passengers with the detection algorithm of a stopping vehicle proposed in this study. Moreover, about 200 experiments using the system designed with this technology proved successful recognition on on-boarding and alighting of passengers with the maximum transmission distance of 12 km. In addition to this, the running recognition tests showed the test with the detection algorithm of a stopping vehicle has reduced transmission traffic by 41.6% compared to the algorithm without our model.

Dual CNN Structured Sound Event Detection Algorithm Based on Real Life Acoustic Dataset (실생활 음향 데이터 기반 이중 CNN 구조를 특징으로 하는 음향 이벤트 인식 알고리즘)

  • Suh, Sangwon;Lim, Wootaek;Jeong, Youngho;Lee, Taejin;Kim, Hui Yong
    • Journal of Broadcast Engineering
    • /
    • v.23 no.6
    • /
    • pp.855-865
    • /
    • 2018
  • Sound event detection is one of the research areas to model human auditory cognitive characteristics by recognizing events in an environment with multiple acoustic events and determining the onset and offset time for each event. DCASE, a research group on acoustic scene classification and sound event detection, is proceeding challenges to encourage participation of researchers and to activate sound event detection research. However, the size of the dataset provided by the DCASE Challenge is relatively small compared to ImageNet, which is a representative dataset for visual object recognition, and there are not many open sources for the acoustic dataset. In this study, the sound events that can occur in indoor and outdoor are collected on a larger scale and annotated for dataset construction. Furthermore, to improve the performance of the sound event detection task, we developed a dual CNN structured sound event detection system by adding a supplementary neural network to a convolutional neural network to determine the presence of sound events. Finally, we conducted a comparative experiment with both baseline systems of the DCASE 2016 and 2017.

Real-time Detection Technique of the Target in a Berth for Automatic Ship Berthing (선박 자동접안을 위한 정박지 목표물의 실시간 검출법)

  • Choi, Yong-Woon;;Kim, Young-Bok;Lee, Kwon-Soon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.5
    • /
    • pp.431-437
    • /
    • 2006
  • In this paper vector code correlation(VCC) method and an algorithm to promote the image-processing performance in building an effective measurement system using cameras are described far automatically berthing and controlling the ship equipped with side-thrusters. In order to realize automatic ship berthing, it is indispensable that the berthing assistant system on the ship should continuously trace a target in the berth to measure the distance to the target and the ship attitude, such that we can make the ship move to the specified location. The considered system is made up of 4 apparatuses compounded from a CCD camera, a camera direction controller, a popular PC with a built-in image processing board and a signal conversion unit connected to parallel port of the PC. The object of this paper is to reduce the image-processing time so that the berthing system is able to ensure the safety schedule against risks during approaching to the berth. It could be achieved by composing the vector code image to utilize the gradient of an approximated plane found with the brightness of pixels forming a certain region in an image and verifying the effectiveness on a commonly used PC. From experimental results, it is clear that the proposed method can be applied to the measurement system for automatic ship berthing and has the image-processing time of fourfold as compared with the typical template matching method.