• Title/Summary/Keyword: camera control

Search Result 2,031, Processing Time 0.032 seconds

Implementation of Smart Shopping Cart using Object Detection Method based on Deep Learning (딥러닝 객체 탐지 기술을 사용한 스마트 쇼핑카트의 구현)

  • Oh, Jin-Seon;Chun, In-Gook
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.7
    • /
    • pp.262-269
    • /
    • 2020
  • Recently, many attempts have been made to reduce the time required for payment in various shopping environments. In addition, for the Fourth Industrial Revolution era, artificial intelligence is advancing, and Internet of Things (IoT) devices are becoming more compact and cheaper. So, by integrating these two technologies, access to building an unmanned environment to save people time has become easier. In this paper, we propose a smart shopping cart system based on low-cost IoT equipment and deep-learning object-detection technology. The proposed smart cart system consists of a camera for real-time product detection, an ultrasonic sensor that acts as a trigger, a weight sensor to determine whether a product is put into or taken out of the shopping cart, an application for smartphones that provides a user interface for a virtual shopping cart, and a deep learning server where learned product data are stored. Communication between each module is through Transmission Control Protocol/Internet Protocol, a Hypertext Transmission Protocol network, a You Only Look Once darknet library, and an object detection system used by the server to recognize products. The user can check a list of items put into the smart cart via the smartphone app, and can automatically pay for them. The smart cart system proposed in this paper can be applied to unmanned stores with high cost-effectiveness.

Development of a CNN-based Cross Point Detection Algorithm for an Air Duct Cleaning Robot (CNN 기반 공조 덕트 청소 로봇의 교차점 검출 알고리듬 개발)

  • Yi, Sarang;Noh, Eunsol;Hong, Seokmoo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.8
    • /
    • pp.1-8
    • /
    • 2020
  • Air ducts installed for ventilation inside buildings accumulate contaminants during their service life. Robots are installed to clean the air duct at low cost, but they are still not fully automated and depend on manpower. In this study, an intersection detection algorithm for autonomous driving was applied to an air duct cleaning robot. Autonomous driving of the robot was achieved by calculating the distance and angle between the extracted point and the center point through the intersection detection algorithm from the camera image mounted on the robot. The training data consisted of CAD images of the duct interior as well as the cross-point coordinates and angles between the two boundary lines. The deep learning-based CNN model was applied as a detection algorithm. For training, the cross-point coordinates were obtained from CAD images. The accuracy was determined based on the differences in the actual and predicted areas and distances. A cleaning robot prototype was designed, consisting of a frame, a Raspberry Pi computer, a control unit and a drive unit. The algorithm was validated by video imagery of the robot in operation. The algorithm can be applied to vehicles operating in similar environments.

Driver's Status Recognition Using Multiple Wearable Sensors (다중 웨어러블 센서를 활용한 운전자 상태 인식)

  • Shin, Euiseob;Kim, Myong-Guk;Lee, Changook;Kang, Hang-Bong
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.6 no.6
    • /
    • pp.271-280
    • /
    • 2017
  • In this paper, we propose a new safety system composed of wearable devices, driver's seat belt, and integrating controllers. The wearable device and driver's seat belt capture driver's biological information, while the integrating controller analyzes captured signal to alarm the driver or directly control the car appropriately according to the status of the driver. Previous studies regarding driver's safety from driver's seat, steering wheel, or facial camera to capture driver's physiological signal and facial information had difficulties in gathering accurate and continuous signals because the sensors required the upright posture of the driver. Utilizing wearable sensors, however, our proposed system can obtain continuous and highly accurate signals compared to the previous researches. Our advanced wearable apparatus features a sensor that measures the heart rate, skin conductivity, and skin temperature and applies filters to eliminate the noise generated by the automobile. Moreover, the acceleration sensor and the gyro sensor in our wearable device enable the reduction of the measurement errors. Based on the collected bio-signals, the criteria for identifying the driver's condition were presented. The accredited certification body has verified that the devices has the accuracy of the level of medical care. The laboratory test and the real automobile test demonstrate that our proposed system is good for the measurement of the driver's condition.

A Motor-Driven Focusing Mechanism for Small Satellite (소형위성용 모터 구동형 포커싱 메커니즘)

  • Jung, Jinwon;Choi, Junwoo;Lee, Dongkyu;Hwang, Jaehyuck;Kim, Byungkyu
    • Journal of Aerospace System Engineering
    • /
    • v.12 no.4
    • /
    • pp.75-80
    • /
    • 2018
  • The working principle of a satellite camera involves a focusing mechanism for controlling the focus of the optical system, which is essential for proper functioning. However, research on focusing mechanisms of satellite optical systems in Korea is in the beginning stage and developed technology is limited to a thermal control type. Therefore, in this paper, we propose a motor-driven focusing mechanism applicable to small satellite optical systems. The proposed mechanism is designed to generate z-axis displacement in the secondary mirror by a motor. In addition, three flexure hinges have been installed on the supporter for application of preload on the mechanism resulting in minimization of the alignment error arising due to manufacturing tolerance and assembly tolerance within the mechanism. After fabrication of the mechanism, the alignment errors (de-space, de-center, and tilt) were measured with LVDT sensors and laser displacement meters. Conclusively, the proposed focusing mechanism could achieve proper alignment degree, which can be applicable to small satellite optical system.

Analysis of NWP GRIB Data for LEO Satellite Mission Planning (저궤도 관측위성 임무계획(Mission Planning)을 위한 기상수치예보 GRIB Data 분석)

  • Seo Jeong-Soo;Seo Seok-Bae;Bae Hee-Jin;Kim Eun-Kyou
    • Proceedings of the KSRS Conference
    • /
    • 2006.03a
    • /
    • pp.178-186
    • /
    • 2006
  • 기상 수치예보는 (Numerical Weather Pridiction, NWP)는 바람, 기온, 등과 같은 기상요소의 시간 변화를 나타내는 물리방정식을 컴퓨터로 풀어 미래의 대기 상태를 예상하는 과학적인 방법으로 지구를 상세한 격자 2진부호(GRIdded Binary, 이하 GRIB)로 나누어 그 격자점에서의 값으로 대기 상태를 나타낸다. 지구 각지에서의 각종 관측자료를 기초로 격자점상의 현재값을 구한다. 대용량의 격자데이터는 이진형태이어서 컴퓨터, 서버 저장장치에서 동일형태 데이터로 존재한다. 우리나라 최초의 저궤도 관측 위성인 다목적 실용위성 KOMPSAT-1호(이하, 아리랑 위성1호)는 전자광학카메라(Electro Optical Camera, EOC)를 탑재하여 1999년 12월 21일에 발사된 이후 2006년 1월 현재까지 6여년간 성공적으로 임무를 수행, 7049여회의 영상을 획득하여 국가적으로 귀중한 자료로 활용하고 있다. 아리랑 위성1호는 일일 2-3회 EOC영상을 획득하고 있으며, 임무계획(Mission Planning)은 MP(Mission Planner)가 사용자로부터 자료를 수집하여 임무분석 및 계획 서브시스템(MAPS)에 의해 계산되어진 위성의 제도예측 데이터에 촬영하고자하는 목표지점 좌표를 입력하여 자동명령생성기(KSCG)에 의해 계산된 촬영 경사각도(Tilt)값을 위성에 전송하여 목표지역의 영상을 획득하게 된다. 위성영상 획득에 있어 고가의 위성을 운영하면서 기상의 상태를 정확히 예측하여 실패없이 유효한 영상을 획득하는 것이 무엇보다 중요하다. 본 논문에서는 효율적인 위성임무계획을 위한 기상수치예보 자료를 분석하여 앞으로 발사하게 될 고해상 카메라 탑제위성인 아리랑 위성2호와 3호에 적용하고자 한다. the sufficient excess reactivity to override this poisoning must be inserted, or its concentration is decreased sufficiently when its temporary shutdown is required. As ratter of fact, these have an important influence not only on reactor safety but also on economic aspect in operation. Considering these points in this study, the shutdown process was cptimized using the Pontryagin's maximum principle so that the shutdown mirth[d was improved as to restart the reactor to its fulpower at any time, but the xenon concentration did not excess the constrained allowable value during and after shutdown, at the same time all the control actions were completed within minimum time from beginning of the shutdown.및 12.36%, $101{\sim}200$일의 경우 12.78% 및 12.44%, 201일 이상의 경우 13.17% 및 11.30%로 201일 이상의 유기의 경우에만 대조구와 삭제 구간에 유의적인(p<0.05) 차이를 나타내었다.는 담수(淡水)에서 10%o의 해수(海水)

  • PDF

A Framework of Recognition and Tracking for Underwater Objects based on Sonar Images : Part 2. Design and Implementation of Realtime Framework using Probabilistic Candidate Selection (소나 영상 기반의 수중 물체 인식과 추종을 위한 구조 : Part 2. 확률적 후보 선택을 통한 실시간 프레임워크의 설계 및 구현)

  • Lee, Yeongjun;Kim, Tae Gyun;Lee, Jihong;Choi, Hyun-Taek
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.3
    • /
    • pp.164-173
    • /
    • 2014
  • In underwater robotics, vision would be a key element for recognition in underwater environments. However, due to turbidity an underwater optical camera is rarely available. An underwater imaging sonar, as an alternative, delivers low quality sonar images which are not stable and accurate enough to find out natural objects by image processing. For this, artificial landmarks based on the characteristics of ultrasonic waves and their recognition method by a shape matrix transformation were proposed and were proven in Part 1. But, this is not working properly in undulating and dynamically noisy sea-bottom. To solve this, we propose a framework providing a selection phase of likelihood candidates, a selection phase for final candidates, recognition phase and tracking phase in sequence images, where a particle filter based selection mechanism to eliminate fake candidates and a mean shift based tracking algorithm are also proposed. All 4 steps are running in parallel and real-time processing. The proposed framework is flexible to add and to modify internal algorithms. A pool test and sea trial are carried out to prove the performance, and detail analysis of experimental results are done. Information is obtained from tracking phase such as relative distance, bearing will be expected to be used for control and navigation of underwater robots.

Effects of Visual Information Blockage on Landing Strategy during Drop Landing (시각 정보의 차단이 드롭랜딩 시 착지 전략에 미치는 영향)

  • Koh, Young-Chul;Cho, Joon-Haeng;Moon, Gon-Sung;Lee, Hae-Dong;Lee, Sung-Cheol
    • Korean Journal of Applied Biomechanics
    • /
    • v.21 no.1
    • /
    • pp.31-38
    • /
    • 2011
  • This study aimed to determine the effects of the blockage of visual feedback on joint dynamics of the lower extremity. Fifteen healthy male subjects(age: $24.1{\pm}2.3\;yr$, height: $178.7{\pm}5.2\;cm$, weight: $73.6{\pm}6.6\;kg$) participated in this study. Each subject performed single-legged landing from a 45 cm-platform with the eyes open or closed. During the landing performance, three-dimensional kinematics of the lower extremity and ground reaction force(GRF) were recorded using a 8 infrared camera motion analysis system (Vicon MX-F20, Oxford Metric Ltd, Oxford, UK) with a force platform(ORG-6, AMTI, Watertown, MA). The results showed that at 50 ms prior to foot contact and at the time of foot contact, ankle plantar-flexion angle was smaller(p<.05) but the knee joint valgus and the hip flexion angles were greater with the eyes closed as compared to with the eyes open(p<.05). An increase in anterior GRF was observed during single-legged landing with the eyes closed as compared to with the eyes open(p<.05). Time to peak GRF in the medial, vertical and posterior directions occurred significantly earlier when the eyes were closed as compared to when the eyes were open(p<.05). Landing with the eyes closed resulted in a higher peak vertical loading rate(p<.05). In addition, the shock-absorbing power decreased at the ankle joint(p<.05) but increased at the hip joints when landing with the eyes closed(p<.05). When the eyes were closed, landing could be characterized by a less plantarflexed ankle joint and more flexed hip joint, with a faster time to peak GRF. These results imply that subjects are able to adapt the control of landing to different feedback conditions. Therefore, we suggest that training programs be introduced to reduce these injury risk factors.

Mechanism of $Ca^{2+}$ Regulation in Osteoblast-like Cells (골아세포내 $Ca^{2+}$ 활성도의 조절기전)

  • Park, Mi-Jung
    • Journal of Korean Biological Nursing Science
    • /
    • v.1 no.1
    • /
    • pp.25-41
    • /
    • 1999
  • Physiological activity of osteoblast including bone formation is known to be closely related to the increase of intracellular $Ca^{2+}$ activity($[Ca^{2+}]_i$) in osteoblast. $Ca^{2+}$ is an important intracellular messenger in diverse cellular functions, and regulation of its level is mediated by the transmembrane $Ca^{2+}$ movement via $Ca^{2+}$ channels, $Na^+-Ca^{2+}$ exchange, and by intracellular $Ca^{2+}$ movement through the intracellular stores. The purpose of this study is to investigate how the intracellular $Ca^{2+}$ is regulated in osteoblast-like cells(OLCs) by measuring $Ca^{2+}$ activity with cell imaging technique. OLCs were isolated from femur and tibia of neonatal rats, and cultured for 7 days. Cultured OLCs were loaded with a $Ca^{2+}$-sensitive fluorescent dye, Fura-2, and fluorescence images were monitored with a cooled CCD camera. The images were processed and analyzed with an image analyzing software. The results were as follows. (1) $[Ca^{2+}]_i$ of OLC decreased as the $Ca^{2+}$ concentration in the superfusing Tyrode solution was lowered. When $Na^+$ concentration in the superfusing solution was decreased, $[Ca^{2+}]_i$ increased.. These suggest that $Ca^{2+}$ flux occurs via the $Na^+-Ca^{2+}$ exchange mechanism. (2) When $Na^+$ in the superfusing solution was removed. a transient $Ca^{2+}$, increase($Ca^{2+}$ spike) was occasionally observed. However, $Ca^{2+}$ spike was not observed after adding 1 ${\mu}M$ thapsigargin. This implies that the generation of $Ca^{2+}$ spike is mediated by the release of $Ca^{2+}$ from endoplasmic reticulum(ER). (3) As the $Ca^{2+}$ concentration in the superfusing solution was raised, the frequency of 0mM $Na^+$-induced $Ca^{2+}$ spike increased, suggesting that $Ca^{2+}$-induced $Ca^{2+}$ release(CICR) mechanism exists. (4) After $[Ca^{2+}]_i$ was decreased with the superfusion of $Ca^{2+}$-free solution containing thapsigargin, the recovery of $[Ca^{2+}]_i$ with reperfusion of 2.5mM $Ca^{2+}$ solution transiently exceeded the control level, suggesting that the depletion of $Ca^{2+}$ in ER induces $Ca^{2+}$ influx from extracellular medium via store-operated $Ca^{2+}$ influx(SOCI) mechanism. (5) $[Ca^{2+}]_i$ was not affected by the superfusion of 25mM $K^+$ Tyrode solution. These results suggest that intracellular $Ca^{2+}$ activity in osteoblast is regulated by transmembrane $Ca^{2+}$ flux via $Na^+-Ca^{2+}$ exchange, $Ca^{2+}$ release from the internal store (ER) via $Ca^{2+}$-induced $Ca^{2+}$ release, and store-operated $Ca^{2+}$ influx across the cell membrane.

  • PDF

Intensity Compensation for Efficient Stereo Image Compression (효율적인 스테레오 영상 압축을 위한 밝기차 보상)

  • Jeon Youngtak;Jeon Byeungwoo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.42 no.2 s.302
    • /
    • pp.101-112
    • /
    • 2005
  • As we perceive the world as 3-dimensional through our two eyes, we can extract 3-dimensional information from stereo images obtained from two or more cameras. Since stereo images have a large amount of data, with recent advances in digital video coding technology, efficient compression algorithms have been developed for stereo images. In order to compress stereo images and to obtain 3-D information such as depth, we find disparity vectors by using disparity estimation algorithm generally utilizing pixel differences between stereo pairs. However, it is not unusual to have stereo images having different intensity values for several reasons, such as incorrect control of the iris of each camera, disagreement of the foci of two cameras, orientation, position, and different characteristics of CCD (charge-coupled device) cameras, and so on. The intensity differences of stereo pairs often cause undesirable problems such as incorrect disparity vectors and consequent low coding efficiency. By compensating intensity differences between left and right images, we can obtain higher coding efficiency and hopefully reduce the perceptual burden of brain to combine different information incoming from two eyes. We propose several methods of intensity compensation such as local intensity compensation, global intensity compensation, and hierarchical intensity compensation as very simple and efficient preprocessing tool. Experimental results show that the proposed algerian provides significant improvement in coding efficiency.

Effect of fuel injection timing and pressure on the combustion and spray behavior characteristics of diesel fuel for naval vessel (연료분사시기와 압력이 함정용 디젤연료의 분무 및 연소특성에 미치는 영향)

  • Lee, Hyung-min
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.39 no.9
    • /
    • pp.911-917
    • /
    • 2015
  • The objective of this work focuses on the analysis of injection rate and macroscopic spray behavior characteristics with injection pressures as well as combustion and exhaust emission characteristics with injection timing and injection pressure by using a common rail single-cylinder diesel engine. The injection rate was measured by applying the Bosch method, and macroscopic spray behavior characteristics were analyzed with a constant-volume vessel and a high-speed camera. In addition, combustion and emission characteristics were analyzed in a common-rail single-cylinder diesel engine with precise control of fuel injection timing and pressure. For injection pressures of 30MPa and 50MPa, the injection rate was higher at 50 MPa, and the spray development (penetration) was also higher in the same elapsed time. The peak in-cylinder pressure and rate of heat release showed a tendency to decline as injection timing was delayed, and the peak in-cylinder pressure and rate of heat release were slightly higher for higher injection pressures. Higher injection pressures also reduced the mean effective pressure, while the indicated mean effective pressure and torque increased as injection timing was delayed to TDC. Nitrogen oxides had a peak level at injection timings of $BTDC20^{\circ}$(30MPa) and $BTDC15^{\circ}$(50MPa); carbon monoxide emissions were reduced by delaying injection timing from $BTDC30^{\circ}$.