• 제목/요약/키워드: feature reconstruction

검색결과 217건 처리시간 0.023초

A Real-time Particle Filtering Framework for Robust Camera Tracking in An AR Environment (증강현실 환경에서의 강건한 카메라 추적을 위한 실시간 입자 필터링 기법)

  • Lee, Seok-Han
    • Journal of Digital Contents Society
    • /
    • 제11권4호
    • /
    • pp.597-606
    • /
    • 2010
  • This paper describes a real-time camera tracking framework specifically designed to track a monocular camera in an AR workspace. Typically, the Kalman filter is often employed for the camera tracking. In general, however, tracking performances of conventional methods are seriously affected by unpredictable situations such as ambiguity in feature detection, occlusion of features and rapid camera shake. In this paper, a recursive Bayesian sampling framework which is also known as the particle filter is adopted for the camera pose estimation. In our system, the camera state is estimated on the basis of the Gaussian distribution without employing additional uncertainty model and sample weight computation. In addition, the camera state is directly computed based on new sample particles which are distributed according to the true posterior of system state. In order to verify the proposed system, we conduct several experiments for unstable situations in the desktop AR environments.

Feature-Based Disparity Estimation for Intermediate View Reconstruction of Multiview Images (3차원 영상의 중간시점 영상 합성을 위한 특징 기반 변이 추정)

  • 김한성;김성식;손정영;손광훈
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • 제26권11A호
    • /
    • pp.1872-1879
    • /
    • 2001
  • As multiview video applications become more popular, correspondence problem for stereo image matching plays an important role in expanding view points. Thus, we propose an efficient dense disparity estimation algorithm considering features of each image pair of multiview image sets. Main concepts of the proposed algorithm are based on the region-dividing-bidirectional-pixel-matching method. This algorithm makes matching process efficient and keeps the reliability of the estimated disparities. Other improvement have obtained by proposed cost function, matching window expanding technique, disparity regularization, and disparity assignment in ambiguous region. These techniques make disparities more stable by removing false disparities and ambiguous regions. The estimated disparities are used to synthesize intermediate views of multiview images. Computer simulation demonstrates the excellence of the proposed algorithm in both subjective and objective evaluations. In addition, processing time is reduced as well.

  • PDF

Uncertainty in the Estimation of Arctic Surface Temperature during Early 1900s Revealed by the Comparison between HadCRU4 and 20CR Reanalysis (HadCRU4 관측 온도자료와 20CR 재분석 자료 비교로부터 확인된 1900년대 초반 극지역 평균 온도 추정의 불확실성)

  • Kim, Baek-Min;Kim, Jin-Young
    • Journal of Climate Change Research
    • /
    • 제6권2호
    • /
    • pp.95-104
    • /
    • 2015
  • To discuss whether we have credible estimations about historical surface temperature evolution since industrial revolution or not, present study investigates consistencies and differences of averaged surface air temperature since 1900 between the multiple data sources: Hadley Center Climate Research Unit (HadCRU4) surface air temperature data, ECMWF 20 Century Reanalysis data (ERA20CR), and NCEP 20 Century Reanalysis data (NCEP20CR). Averaged surface temperatures are obtained for the global, polar (90S~60S, 60N~0N), midlatitude (60S~30S, 30N~60N), tropical (30S~30N) region, separately. From the analysis, we show that: 1) spatio-temporal inhomogenity and scarcity of HadCRU4 data are not major obstacles in the reliable estimation of global surface air temperature. 2) Globally averaged temperature variability is largely contributed by those of tropical and midlatitude, which occupy more than 70% of earth surface in area. 3) Both data show consistent temperature variability in tropical region. 4) ERA20CR does not capture warm period over Arctic region in early 1900s, which is obvious feature in HadCRU4 data. Discrepancies among datasets suggest that high-level caution is needed especially in the interpretation of large Arctic warming in the early 1900s, which is often regarded as a natural variability in the Arctic region.

Single Low-Light Ghost-Free Image Enhancement via Deep Retinex Model

  • Liu, Yan;Lv, Bingxue;Wang, Jingwen;Huang, Wei;Qiu, Tiantian;Chen, Yunzhong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제15권5호
    • /
    • pp.1814-1828
    • /
    • 2021
  • Low-light image enhancement is a key technique to overcome the quality degradation of photos taken under scotopic vision illumination conditions. The degradation includes low brightness, low contrast, and outstanding noise, which would seriously affect the vision of the human eye recognition ability and subsequent image processing. In this paper, we propose an approach based on deep learning and Retinex theory to enhance the low-light image, which includes image decomposition, illumination prediction, image reconstruction, and image optimization. The first three parts can reconstruct the enhanced image that suffers from low-resolution. To reduce the noise of the enhanced image and improve the image quality, a super-resolution algorithm based on the Laplacian pyramid network is introduced to optimize the image. The Laplacian pyramid network can improve the resolution of the enhanced image through multiple feature extraction and deconvolution operations. Furthermore, a combination loss function is explored in the network training stage to improve the efficiency of the algorithm. Extensive experiments and comprehensive evaluations demonstrate the strength of the proposed method, the result is closer to the real-world scene in lightness, color, and details. Besides, experiments also demonstrate that the proposed method with the single low-light image can achieve the same effect as multi-exposure image fusion algorithm and no ghost is introduced.

Lightweight Single Image Super-Resolution Convolution Neural Network in Portable Device

  • Wang, Jin;Wu, Yiming;He, Shiming;Sharma, Pradip Kumar;Yu, Xiaofeng;Alfarraj, Osama;Tolba, Amr
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제15권11호
    • /
    • pp.4065-4083
    • /
    • 2021
  • Super-resolution can improve the clarity of low-resolution (LR) images, which can increase the accuracy of high-level compute vision tasks. Portable devices have low computing power and storage performance. Large-scale neural network super-resolution methods are not suitable for portable devices. In order to save the computational cost and the number of parameters, Lightweight image processing method can improve the processing speed of portable devices. Therefore, we propose the Enhanced Information Multiple Distillation Network (EIMDN) to adapt lower delay and cost. The EIMDN takes feedback mechanism as the framework and obtains low level features through high level features. Further, we replace the feature extraction convolution operation in Information Multiple Distillation Block (IMDB), with Ghost module, and propose the Enhanced Information Multiple Distillation Block (EIMDB) to reduce the amount of calculation and the number of parameters. Finally, coordinate attention (CA) is used at the end of IMDB and EIMDB to enhance the important information extraction from Spaces and channels. Experimental results show that our proposed can achieve convergence faster with fewer parameters and computation, compared with other lightweight super-resolution methods. Under the condition of higher peak signal-to-noise ratio (PSNR) and higher structural similarity (SSIM), the performance of network reconstruction image texture and target contour is significantly improved.

A Study on the Production of 3D Datasets for Stone Pagodas by Period in Korea

  • Byong-Kwon Lee;Eun-Ji Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • 제28권9호
    • /
    • pp.105-111
    • /
    • 2023
  • Currently, most of content restoration using artificial intelligence learning is 2D learning. However, 3D form of artificial intelligence learning is in an incomplete state due to the disadvantage of requiring a lot of computation and learning speed from the existing 2 axes (X, Y) to 3 axes (X, Y, Z). The purpose of this paper is to secure a data-set for artificial intelligence learning by analyzing and 3D modeling the stone pagodas of ourinari by era based on the two-dimensional information (image) of cultural assets. In addition, we analyzed the differences and characteristics of towers in each era in Korea, and proposed a feature modeling method suitable for artificial intelligence learning. Restoration of cultural properties relies on a variety of materials, expert techniques and historical archives. By recording and managing the information necessary for the restoration of cultural properties through this study, it is expected that it will be used as an important documentary heritage for restoring and maintaining Korean traditional pagodas in the future.

Analysis of 3D Accuracy According to Determination of Calibration Initial Value in Close-Range Digital Photogrammetry Using VLBI Antenna and Mobile Phone Camera (VLBI 안테나와 모바일폰 카메라를 활용한 근접수치사진측량의 캘리브레이션 초기값 결정에 따른 3차원 정확도 분석)

  • Kim, Hyuk Gi;Yun, Hong Sik;Cho, Jae Myoung
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • 제33권1호
    • /
    • pp.31-43
    • /
    • 2015
  • This study had been aimed to conduct the camera calibration on VLBI antenna in the Space Geodetic Observation Center of Sejong City with a low-cost digital camera, which embedded in a mobile phone to determine the three-dimension position coordinates of the VLBI antenna, based on stereo images. The initial values for the camera calibration have been obtained by utilizing the Direct Linear Transformation algorithm and the commercial digital photogrammetry system, PhotoModeler $Scanner^{(R)}$ ver. 6.0, respectively. The accuracy of camera calibration results was compared with that the camera calibration results, acquired by a bundle adjustment with nonlinear collinearity condition equation. Although two methods showed significant differences in the initial value, the final calibration demonstrated the consistent results whichever methods had been performed for obtaining the initial value. Furthermore, those three-dimensional coordinates of feature points of the VLBI antenna were respectively calculated using the camera calibration by the two methods to be compared with the reference coordinates obtained from a total station. In fact, both methods have resulted out a same standard deviation of $X=0.004{\pm}0.010m$, $Y=0.001{\pm}0.015m$, $Z=0.009{\pm}0.017m$, that of showing a high degree of accuracy in centimeters. From the result, we can conclude that a mobile phone camera opens up the way for a variety of image processing studies, such as 3D reconstruction from images captured.

A Study on Stroke Extraction for Handwritten Korean Character Recognition (필기체 한글 문자 인식을 위한 획 추출에 관한 연구)

  • Choi, Young-Kyoo;Rhee, Sang-Burm
    • The KIPS Transactions:PartB
    • /
    • 제9B권3호
    • /
    • pp.375-382
    • /
    • 2002
  • Handwritten character recognition is classified into on-line handwritten character recognition and off-line handwritten character recognition. On-line handwritten character recognition has made a remarkable outcome compared to off-line hacdwritten character recognition. This method can acquire the dynamic written information such as the writing order and the position of a stroke by means of pen-based electronic input device such as a tablet board. On the contrary, Any dynamic information can not be acquired in off-line handwritten character recognition since there are extreme overlapping between consonants and vowels, and heavily noisy images between strokes, which change the recognition performance with the result of the preprocessing. This paper proposes a method that effectively extracts the stroke including dynamic information of characters for off-line Korean handwritten character recognition. First of all, this method makes improvement and binarization of input handwritten character image as preprocessing procedure using watershed algorithm. The next procedure is extraction of skeleton by using the transformed Lu and Wang's thinning: algorithm, and segment pixel array is extracted by abstracting the feature point of the characters. Then, the vectorization is executed with a maximum permission error method. In the case that a few strokes are bound in a segment, a segment pixel array is divided with two or more segment vectors. In order to reconstruct the extracted segment vector with a complete stroke, the directional component of the vector is mortified by using right-hand writing coordinate system. With combination of segment vectors which are adjacent and can be combined, the reconstruction of complete stroke is made out which is suitable for character recognition. As experimentation, it is verified that the proposed method is suitable for handwritten Korean character recognition.

Online Multi-view Range Image Registration using Geometric and Photometric Feature Tracking (3차원 기하정보 및 특징점 추적을 이용한 다시점 거리영상의 온라인 정합)

  • Baek, Jae-Won;Moon, Jae-Kyoung;Park, Soon-Yong
    • The KIPS Transactions:PartB
    • /
    • 제14B권7호
    • /
    • pp.493-502
    • /
    • 2007
  • An on-line registration technique is presented to register multi-view range images for the 3D reconstruction of real objects. Using a range camera, we first acquire range images and photometric images continuously. In the range images, we divide object and background regions using a predefined threshold value. For the coarse registration of the range images, the centroid of the images are used. After refining the registration of range images using a projection-based technique, we use a modified KLT(Kanade-Lucas-Tomasi) tracker to match photometric features in the object images. Using the modified KLT tracker, we can track image features fast and accurately. If a range image fails to register, we acquire new range images and try to register them continuously until the registration process resumes. After enough range images are registered, they are integrated into a 3D model in offline step. Experimental results and error analysis show that the proposed method can be used to reconstruct 3D model very fast and accurately.

Proton Magnetic Resonance Chemical Shift Imaging(1H-CSI)-directed Stereotactic Brain Biopsy (양성자 화학적 이동영상기법(1H-CSI)을 이용한 정위적 뇌생검)

  • Chang, Kyung-Sool;Son, Byung-Chul;Kim, Moon-Chan;Choi, Byung-Gil;Kim, Euy-Neying;Kim, Bum-Soo;Choe, Bo-Young;Baik, Hyun-Man;Hong, Yong-Kil;Kang, Joon-Ki
    • Journal of Korean Neurosurgical Society
    • /
    • 제29권12호
    • /
    • pp.1606-1611
    • /
    • 2000
  • Objective : To obtain more reliable sample in stereotactic biopsy, authors adopted proton chemical shift imaging ($^1H$-CSI)-directed biopsy. Until now, proton single voxel spectroscopy($^1H$-SVS) technique has been reported as a technique using metabolic information in stereotactic biopsy. The authors performed $^1H$-CSI with a stereotactic headframe in place and evaluated the pathologic results obtained from local metabolic information through $^1H$-CSI. Methods : $^1H$ CSI-directed stereotactic biopsy was performed in four patients. $^1H$-CSI and conventional Gd-enhancement stereotactic MRI was done simultaneously after application of the stereotatic frame. After reconstruction of metabolic maps of NAA/Cr, Cho/Cr, and Lactate/Cr ratios, the focal areas of increased Cho/Cr ratios and decreased NAA/Cr ratios were selected for target sites in the MR images Results : There was no difficulty in performing $^1H$-CSI with the stereotactic headframe in place. In pathologic examinations, the samples taken in area of increased Cho/Cr ratios and decreased NAA/Cr ratios showed the features of increased cellularity, mitoses and cellular atypism, thus facilitated the diagnosis. The pathologic samples taken from the area of increased Lactate/Cr ratios showed prominent feature of necrosis. Conclusion : $^1H$-CSI was feasible with stereotactic head frame in place. The final pathologic results obtained in our samples were concordant with the local metabolic informations from $^1H$-CSI. Authors believe that $^1H$ CSI-directed stereotactic biopsy may provide us advantages in obtaining more reliable tissue specimen in stereotactic biopsy.

  • PDF