• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.07a
• /
• pp.403-405
• /
• 2011

모바일 영상 기기들에 사용되는 저전력, 고화질의 이미지 센서는 Rolling Shutter 방식을 사용하는 CIS(CMOS Image Sensor)이다. 구조적 특성에 의해 Rolling Shutter 방식을 사용하는 CIS는 촬영 환경에 의해 결과물에 왜곡을 일으키게 된다. 본 논문은 Rolling Shutter에 의한 왜곡을 분석하고 촬영된 영상의 Rolling Shutter 왜곡 모션벡터를 예측하는 알고리즘을 제안하였다. 또한 제안 알고리즘의 정확성을 높이기 위해 Sub-block과 Kalman-filter를 적용하여 Sub-pixel 단위로 계산하여 기존의 Lucas-Kanade 알고리즘 보다 효율적인 모션벡터 예측 알고리즘을 제안한다. 또한 보다 정확한 성능 변화를 추적하기 위하여 MSE 방식을 사용하여 비교 분석 하였다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.07a
• /
• pp.426-427
• /
• 2010

최근 휴대기기들의 CMOS 영상 센서의 사용으로 Rolling shutter에 의한 왜곡현상이 발생하고 있다. 이러한 왜곡현상을 보정하기 위한 기존의 방법은 동영상에서의 움직임 정보만을 주로 이용하고 있다. 따라서 본 논문은 움직임 정보를 이용한 보정의 성능을 더욱 좋게 하기위하여 정지영상에서 Rolling Shutter 왜곡현상에 대한 추가적인 움직임 정보를 찾아내고 보정하는 알고리즘을 제안하고 있다.

• IEIE Transactions on Smart Processing and Computing
• /
• v.3 no.4
• /
• pp.205-211
• /
• 2014

This paper reports an efficient algorithm for accurate rolling shutter distortion removal. A hierarchical global motion estimation approach for a group of blocks reduces the level of computation by three orders of magnitude. In addition, the motion of each scanline is determined accurately by averaging two candidates obtained through cubic spline interpolation. The experimental results show that the proposed method produces accurate motion information with significant computation reduction and corrects the rolling shutter distortion effectively.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.40 no.10
• /
• pp.2065-2067
• /
• 2015

In this paper, we analyze the performance of visible light communication system using rolling shutter CMOS sensor. For analysis, the effect of ISI (Inter-symbol Interference) on visible communication has been formulated. We validate our analysis through computer simulations.

• Proceedings of the Korean Information Science Society Conference
• /
• 2011.06a
• /
• pp.454-457
• /
• 2011

현대의 휴대기기들은 대부분 저비용 저전력의 CMOS를 채용한 카메라를 사용한다. 일반적으로 CMOS 센서는 영상의 왜곡을 발생시키는 Rolling Shutter를 채용하여 촬영을 한다. Rolling Shutter에 의한 왜곡 현상을 보정하기 위해 기존의 방법들은 영상을 분석하여 카메라의 움직임을 추정한다. 하지만 증강현실과 같은 시스템에 있어 매우 중요한 실시간성을 보존하기 위해서는 더욱 빠르고 간결한 보정처리가 이루어져야 한다. 따라서 본 논문은 대부분의 모바일 기기에 장착되어있는 가속도 센서를 이용하여 왜곡현상을 고속 보정하는 방법을 제안한다.

• Current Optics and Photonics
• /
• v.2 no.5
• /
• pp.422-430
• /
• 2018

Rolling shutter operation of CMOS cameras can be utilized in optical camera communications in order to transmit data from an LED to mobile devices such as smart-phones. From temporally modulated light, a spatial flicker pattern is obtained in the captured image, and this is used for signal recovery. Due to the degradation of rolling shutter images caused by light smear, motion blur, and focus blur, the conventional decoding schemes for rolling shutter cameras based on the pattern width for 'OFF' and 'ON' cannot guarantee robust communications performance for practical uses. Aside from conventional techniques, such as polynomial fitting, histogram equalization can be used for blurry light mitigation, but it requires additional computation abilities resulting in burdens on mobile devices. This paper proposes a transition-based decoding scheme for rolling shutter cameras in order to offer simple and robust data decoding in the presence of image degradation. Based on the designed synchronization pulse and modulated data symbols according to the LED dimming level, the decoding process is conducted by observing the transition patterns of two sequential symbol pulses. For this, the extended symbol pulse caused by consecutive symbol pulses with the same level determines whether the second pulse should be included for the next bit decoding or not. The proposed method simply identifies the transition patterns of sequential symbol pulses other than the pattern width of 'OFF' and 'ON' for data decoding, and thus, it is simpler and more accurate. Experimental results ensured that the transition-based decoding scheme is robust even in the presence of blurry lights in the captured image at various dimming levels

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.4
• /
• pp.454-460
• /
• 2016

Unlike conventional visible light communications (VLC) adopting photo detectors (PD), optical camera communications (OCC) employs cameras in detecting the transmitted data. Especially, the data rate of OCC can be enhanced by using the principle of rolling-shutter, which is the operating scheme of a CMOS image sensor. In this study, we consider a novel OCC system for high-speed real time video processing to transmit high speed data from LED and to acquire image utilizing rolling-shutter effect of CMOS image sensor. Also, we demonstrate the improved performance of proposed system using a test-bed.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.8
• /
• pp.843-850
• /
• 2016

This paper introduces a novel modulation scheme for vehicular communication in taking advantage of existing LED lights available on a car. Our proposed 2-Phase Shift Keying (2-PSK) is a spatial modulation approach in which a pair of LED light sources in a car (either rear LEDs or front LEDs) is used as a transmitter. A typical camera (i.e. low frame rate at no greater than 30fps) that either a global shutter camera or a rolling shutter camera can be used as a receiver. The modulation scheme is a part of our Image Sensor Communication proposal submitted to IEEE 802.15.7r1 (TG7r1) recently. Also, a neural network approach is applied to improve the performance of LEDs detection and decoding under the noisy situation. Later, some analysis and experiment results are presented to indicate the performance of our system

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.42 no.1
• /
• pp.8-13
• /
• 2017

Compare with other communication system based RF technology, Optical Camera Communication (OCC) has limitation on data rate due to the low frame rate of camera. The limitation on data rate can be solved with multiple-input and multiple-output (MIMO) technology; and it is the final target of all researches on OCC. The MIMO topology can be implemented easily without breaking out the architecture of image sensor. For image sensor classification, there are two architectures have been developed: rolling shutter and global shutter. The operation of two techniques is different so the performance is also different. In this paper we analyze and evaluate the performance of the MIMO architecture for OCC.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.34 no.10
• /
• pp.1385-1391
• /
• 2010

In this study, we present small-size, low-power, and high-speed electromagnetic flapping shutters for phone cameras. These shutters are composed of trapezoidal twin blades suspended by H-type torsional springs. The existing electrostatic rolling and flapping shutters need high input voltage, while the existing electromagnetic rotating shutters are too big to be used for phone cameras. To achieve low-power and high-speed angle motion for small-size electromagnetic flapping shutters for camera phones, low-inertia trapezoidal twin blades, each suspended by the low-stiffness H-type torsional springs, are employed. The electromagnetic flapping shutters used in this experimental study have steady-state rotational angles of $48.8{\pm}1.4^{\circ}$ and $64.4{\pm}1.0^{\circ}$ in the magentic fields of 0.15 T and 0.30 T, respectively, for an input current of 60 mA; the maximum overshoot angles are $80.2{\pm}3.5^{\circ}$ and $90.0{\pm}1.0^{\circ}$ in the magentic fields of 0.15 T and 0.30 T, respectively. The rising/settling times of the shutter while opening are 1.0 ms/20.0 ms, while those while closing are 1.7 ms/10.3 ms. Thus, we experimentally demonstrated that the smallsize (${\sim}8{\times}8{\times}2\;mm^3$), low-power (${\leq}60\;mA$), and high-speed (~1/370 s) electromagnetic flapping shutters are suitable for phone cameras.