• Title/Summary/Keyword: 비전 센서

Search Result 294, Processing Time 0.022 seconds

Online Monitoring System based notifications on Mobile devices with Kinect V2 (키넥트와 모바일 장치 알림 기반 온라인 모니터링 시스템)

  • Niyonsaba, Eric;Jang, Jong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.6
    • /
    • pp.1183-1188
    • /
    • 2016
  • Kinect sensor version 2 is a kind of camera released by Microsoft as a computer vision and a natural user interface for game consoles like Xbox one. It allows acquiring color images, depth images, audio input and skeletal data with a high frame rate. In this paper, using depth image, we present a surveillance system of a certain area within Kinect's field of view. With computer vision library(Emgu CV), if an object is detected in the target area, it is tracked and kinect camera takes RGB image to send it in database server. Therefore, a mobile application on android platform was developed in order to notify the user that Kinect has sensed strange motion in the target region and display the RGB image of the scene. User gets the notification in real-time to react in the best way in the case of valuable things in monitored area or other cases related to a reserved zone.

Obstacle Avoidance of Indoor Mobile Robot using RGB-D Image Intensity (RGB-D 이미지 인텐시티를 이용한 실내 모바일 로봇 장애물 회피)

  • Kwon, Ki-Hyeon;Lee, Hyung-Bong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.10
    • /
    • pp.35-42
    • /
    • 2014
  • It is possible to improve the obstacle avoidance capability by training and recognizing the obstacles which is in certain indoor environment. We propose the technique that use underlying intensity value along with intensity map from RGB-D image which is derived from stereo vision Kinect sensor and recognize an obstacle within constant distance. We test and experiment the accuracy and execution time of the pattern recognition algorithms like PCA, ICA, LDA, SVM to show the recognition possibility of it. From the comparison experiment between RGB-D data and intensity data, RGB-D data got 4.2% better accuracy rate than intensity data but intensity data got 29% and 31% faster than RGB-D in terms of training time and intensity data got 70% and 33% faster than RGB-D in terms of testing time for LDA and SVM, respectively. So, LDA, SVM have good accuracy and better training/testing time to use for obstacle avoidance based on intensity dataset of mobile robot.

An Education Method of Computational Thinking using Microbit in a Java-based SW Lecture for Non-major Undergraduates (비전공자 대상 Java SW교육 강좌에서 마이크로비트를 이용한 컴퓨팅적 사고과정 교육 방법)

  • Hur, Kyeong
    • Journal of Practical Engineering Education
    • /
    • v.11 no.2
    • /
    • pp.167-174
    • /
    • 2019
  • In the case of Java programming education for non-major undergraduates, there are no examples of applying the physical computing education method. The advantage of physical computing education is that you can directly check the SW processing output result according to the input value of digital and analog sensor, so that you can quickly correct programming errors and improve learner's learning interest and satisfaction. In this paper, we use the microbits to combine physical computing education with basic Java programming education. In addition, according to the computational thinking process, we proposed an educational method for creating Java programs using microbits. Through block programming to control the microbits, we designed an algorithm and applied a training method to convert it into a Java program. In addition, the results of students' evaluations were analyzed in the course applying the education method, and the effectiveness of the education method using the microbit was analyzed.

Vision and Depth Information based Real-time Hand Interface Method Using Finger Joint Estimation (손가락 마디 추정을 이용한 비전 및 깊이 정보 기반 손 인터페이스 방법)

  • Park, Kiseo;Lee, Daeho;Park, Youngtae
    • Journal of Digital Convergence
    • /
    • v.11 no.7
    • /
    • pp.157-163
    • /
    • 2013
  • In this paper, we propose a vision and depth information based real-time hand gesture interface method using finger joint estimation. For this, the areas of left and right hands are segmented after mapping of the visual image and depth information image, and labeling and boundary noise removal is performed. Then, the centroid point and rotation angle of each hand area are calculated. Afterwards, a circle is expanded at following pattern from a centroid point of the hand to detect joint points and end points of the finger by obtaining the midway points of the hand boundary crossing and the hand model is recognized. Experimental results that our method enabled fingertip distinction and recognized various hand gestures fast and accurately. As a result of the experiment on various hand poses with the hidden fingers using both hands, the accuracy showed over 90% and the performance indicated over 25 fps. The proposed method can be used as a without contacts input interface in HCI control, education, and game applications.

Design of Image Signal Processor greatly reduced chip area by role sharing of hardware and software (하드웨어와 소프트웨어의 역할 분담을 통해 칩 면적을 크게 줄인 Image Signal Processor의 설계)

  • Park, Jung-Hwan;Park, Jong-Sik;Lee, Seong-Soo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.14 no.8
    • /
    • pp.1737-1744
    • /
    • 2010
  • The Image sensor needs various image processing to improve image quality. ISP(Image Signal Processor) performs various image processing. Conventional vision cameras have own software ISP functions and perform in PC instead of using commercial ISP chips. However these methods have problems such as large computation for image processing. In this paper, we proposed ISP that significantly reduced chip area by efficient sharing of hardware and software. Large operation blocks are designed to hardware for high performances, and we used hardware simultaneously with software considering the size of the hardware. The implemented ISP can process VGA(640*4800) images and has 91450 gate sizes in 0.35um process.

Development of Wideband Frequency Modulated Laser for High Resolution FMCW LiDAR Sensor (고분해능 FMCW LiDAR 센서 구성을 위한 광대역 주파수변조 레이저 개발)

  • Jong-Pil La;Ji-Eun Choi
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.6
    • /
    • pp.1023-1030
    • /
    • 2023
  • FMCW LiDAR system with robust target detection capabilities even under adverse operating conditions such as snow, rain, and fog is addressed in this paper. Our focus is primarily on enhancing the performance of FMCW LiDAR by improving the characteristics of the frequency-modulated laser, which directly influence range resolution, coherence length, and maximum measurement range etc. of LiDAR. We describe the utilization of an unbalanced Mach-Zehnder laser interferometer to measure real-time changes of the lasing frequency and to correct frequency modulation errors through an optical phase-locked loop technique. To extend the coherence length of laser, we employ an extended-cavity laser diode as the laser source and implement a laser interferometer with an photonic integrated circuit for miniaturization of optical system. The developed FMCW LiDAR system exhibits a bandwidth of 10.045GHz and a remarkable distance resolution of 0.84mm.

Development of unmanned hovercraft system for environmental monitoring (환경 모니터링을 위한 무인 호버크래프트 시스템 개발)

  • Sung-goo Yoo;Jin-Taek Lim
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.2
    • /
    • pp.525-530
    • /
    • 2024
  • The need for an environmental monitoring system that obtains and provides environmental information in real time is increasing. In particular, in the case of water quality management in public waters, regular management must be conducted through manual and automatic measurement by law, and air pollution also requires regular measurement and management to reduce fine dust and exhaust gas in connection with the realization of carbon neutrality. In this study, we implemented a system that can measure and monitor water pollution and air pollution information in real time. A hovercraft capable of moving on land and water simultaneously was used as a measurement tool. Water quality measurement and air pollution measurement sensors were installed on the hovercraft body, and a communication module was installed to transmit the information to the monitoring system in real time. The structure of a hovercraft for environmental measurement was designed, and a LoRa module capable of low-power, long-distance communication was applied as a real-time information transmission communication module. The operational performance of the proposed system was confirmed through actual hardware implementation.

Comparative Study on Feature Extraction Schemes for Feature-based Structural Displacement Measurement (특징점 추출 기법에 따른 구조물 동적 변위 측정 성능에 관한 연구)

  • Junho Gong
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.28 no.3
    • /
    • pp.74-82
    • /
    • 2024
  • In this study, feature point detection and displacement measurement performance depending on feature extraction algorithms were compared and analyzed according to environmental changes and target types in the feature point-based displacement measurement algorithm. A three-story frame structure was designed for performance evaluation, and the displacement response of the structure was digitized into FHD (1920×1080) resolution. For performance analysis, the initial measurement distance was set to 10m, and increased up to 40m with an increment of 10m. During the experiments, illuminance was fixed to 450lux or 120lux. The artificial and natural targets mounted on the structure were set as regions of interest and used for feature point detection. Various feature detection algorithms were implemented for performance comparisons. As a result of the feature point detection performance analysis, the Shi-Tomasi corner and KAZE algorithm were found that they were robust to the target type, illuminance change, and increase in measurement distance. The displacement measurement accuracy using those two algorithms was also the highest. However, when using natural targets, the displacement measurement accuracy is lower than that of artificial targets. This indicated the limitation in extracting feature points as the resolution of the natural target decreased as the measurement distance increased.

Estimation of the Dimensions of Horticultural Products and the Mean Plant Height of Plug Seedlings Using Three-Dimensional Images (3차원 영상을 이용한 원예산물의 크기와 플러그묘의 평균초장 추정)

  • Jang, Dong Hwa;Kim, Hyeon Tae;Kim, Yong Hyeon
    • Journal of Bio-Environment Control
    • /
    • v.28 no.4
    • /
    • pp.358-365
    • /
    • 2019
  • This study was conducted to estimate the dimensions of horticultural products and the mean plant height of plug seedlings using three-dimensional (3D) images. Two types of camera, a ToF camera and a stereo-vision camera, were used to acquire 3D images for horticultural products and plug seedlings. The errors calculated from the ToF images for dimensions of horticultural products and mean height of plug seedlings were lower than those predicted from stereo-vision images. A new indicator was defined for determining the mean plant height of plug seedlings. Except for watermelon with tap, the errors of circumference and height of horticultural products were 0.0-3.0% and 0.0-4.7%, respectively. Also, the error of mean plant height for plug seedlings was 0.0-5.5%. The results revealed that 3D images can be utilized to estimate accurately the dimensions of horticultural products and the plant height of plug seedlings. Moreover, our method is potentially applicable for segmenting objects and for removing outliers from the point cloud data based on the 3D images of horticultural crops.

Development of the Vision System to Inspect the Inside of the Brake Calipers (브레이크 캘리퍼 내부 검사를 위한 비전시스템 개발)

  • Kwon, Gyoung Hoon;Chu, Hyung Gon;Kim, Jin Young;Kang, Joonhee
    • Journal of Sensor Science and Technology
    • /
    • v.26 no.1
    • /
    • pp.39-43
    • /
    • 2017
  • Development of vision system as a nondestructive evaluation system can be very useful in screening the defective mechanical parts before they are assembled into the final product. Since the tens of thousands of the mechanical parts are used in an automobile carefully inspecting the quality of the mechanical parts is very important to maximize the performance of the automobile. To sort out the defective mechanical parts before they are assembled, auto parts fabrication companies employ various inspection systems. Nondestructive evaluation systems are getting rapidly popular among various inspection systems. In this study, we have developed a vision system to inspect the inside of the brake caliper, a part that is used to compose a brake which is the most important to the safety of the drivers and the passengers. In a brake caliper, a piston is pushed against the brake disk by oil pressure, causing a friction to damp the rotation of the wheel. Inside the caliper, a groove is positioned to adopt an oil seal to prevent the oil leaks. Inspecting the groove with our vision system, we could examine the existence of the contaminants which are normally the residual tiny pieces from the machining process. We used a high resolution GigE camera, 360 degree lens to look in the inside view of the caliper at once, and a special illumination system in this vision system. We used the edge detection technique to successfully detect the contaminants which were in the form of small metal chips. Labview graphical program was used to process the digital data from the camera and to display the vision and the statistics of the contaminants. We were very successful in detecting the contaminants from the various size calipers. We think we are ready to employ this vision system to the caliper production factories.