• Title/Summary/Keyword: SIFT

Search Result 347, Processing Time 0.025 seconds

3D feature point extraction technique using a mobile device (모바일 디바이스를 이용한 3차원 특징점 추출 기법)

  • Kim, Jin-Kyum;Seo, Young-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.10a
    • /
    • pp.256-257
    • /
    • 2022
  • In this paper, we introduce a method of extracting three-dimensional feature points through the movement of a single mobile device. Using a monocular camera, a 2D image is acquired according to the camera movement and a baseline is estimated. Perform stereo matching based on feature points. A feature point and a descriptor are acquired, and the feature point is matched. Using the matched feature points, the disparity is calculated and a depth value is generated. The 3D feature point is updated according to the camera movement. Finally, the feature point is reset at the time of scene change by using scene change detection. Through the above process, an average of 73.5% of additional storage space can be secured in the key point database. By applying the algorithm proposed to the depth ground truth value of the TUM Dataset and the RGB image, it was confirmed that the\re was an average distance difference of 26.88mm compared with the 3D feature point result.

  • PDF

In-silico and structure-based assessment to evaluate pathogenicity of missense mutations associated with non-small cell lung cancer identified in the Eph-ephrin class of proteins

  • Shubhashish Chakraborty;Reshita Baruah;Neha Mishra;Ashok K Varma
    • Genomics & Informatics
    • /
    • v.21 no.3
    • /
    • pp.30.1-30.13
    • /
    • 2023
  • Ephs belong to the largest family of receptor tyrosine kinase and are highly conserved both sequentially and structurally. The structural organization of Eph is similar to other receptor tyrosine kinases; constituting the extracellular ligand binding domain, a fibronectin domain followed by intracellular juxtamembrane kinase, and SAM domain. Eph binds to respective ephrin ligand, through the ligand binding domain and forms a tetrameric complex to activate the kinase domain. Eph-ephrin regulates many downstream pathways that lead to physiological events such as cell migration, proliferation, and growth. Therefore, considering the importance of Eph-ephrin class of protein in tumorigenesis, 7,620 clinically reported missense mutations belonging to the class of variables of unknown significance were retrieved from cBioPortal and evaluated for pathogenicity. Thirty-two mutations predicted to be pathogenic using SIFT, Polyphen-2, PROVEAN, SNPs&GO, PMut, iSTABLE, and PremPS in-silico tools were found located either in critical functional regions or encompassing interactions at the binding interface of Eph-ephrin. However, seven were reported in nonsmall cell lung cancer (NSCLC). Considering the relevance of receptor tyrosine kinases and Eph in NSCLC, these seven mutations were assessed for change in the folding pattern using molecular dynamic simulation. Structural alterations, stability, flexibility, compactness, and solvent-exposed area was observed in EphA3 Trp790Cys, EphA7 Leu749Phe, EphB1 Gly685Cys, EphB4 Val748Ala, and Ephrin A2 Trp112Cys. Hence, it can be concluded that the evaluated mutations have potential to alter the folding pattern and thus can be further validated by in-vitro, structural and in-vivo studies for clinical management.

Matching Points Filtering Applied Panorama Image Processing Using SURF and RANSAC Algorithm (SURF와 RANSAC 알고리즘을 이용한 대응점 필터링 적용 파노라마 이미지 처리)

  • Kim, Jeongho;Kim, Daewon
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.4
    • /
    • pp.144-159
    • /
    • 2014
  • Techniques for making a single panoramic image using multiple pictures are widely studied in many areas such as computer vision, computer graphics, etc. The panorama image can be applied to various fields like virtual reality, robot vision areas which require wide-angled shots as an useful way to overcome the limitations such as picture-angle, resolutions, and internal informations of an image taken from a single camera. It is so much meaningful in a point that a panoramic image usually provides better immersion feeling than a plain image. Although there are many ways to build a panoramic image, most of them are using the way of extracting feature points and matching points of each images for making a single panoramic image. In addition, those methods use the RANSAC(RANdom SAmple Consensus) algorithm with matching points and the Homography matrix to transform the image. The SURF(Speeded Up Robust Features) algorithm which is used in this paper to extract featuring points uses an image's black and white informations and local spatial informations. The SURF is widely being used since it is very much robust at detecting image's size, view-point changes, and additionally, faster than the SIFT(Scale Invariant Features Transform) algorithm. The SURF has a shortcoming of making an error which results in decreasing the RANSAC algorithm's performance speed when extracting image's feature points. As a result, this may increase the CPU usage occupation rate. The error of detecting matching points may role as a critical reason for disqualifying panoramic image's accuracy and lucidity. In this paper, in order to minimize errors of extracting matching points, we used $3{\times}3$ region's RGB pixel values around the matching points' coordinates to perform intermediate filtering process for removing wrong matching points. We have also presented analysis and evaluation results relating to enhanced working speed for producing a panorama image, CPU usage rate, extracted matching points' decreasing rate and accuracy.

A Study on Training Dataset Configuration for Deep Learning Based Image Matching of Multi-sensor VHR Satellite Images (다중센서 고해상도 위성영상의 딥러닝 기반 영상매칭을 위한 학습자료 구성에 관한 연구)

  • Kang, Wonbin;Jung, Minyoung;Kim, Yongil
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1505-1514
    • /
    • 2022
  • Image matching is a crucial preprocessing step for effective utilization of multi-temporal and multi-sensor very high resolution (VHR) satellite images. Deep learning (DL) method which is attracting widespread interest has proven to be an efficient approach to measure the similarity between image pairs in quick and accurate manner by extracting complex and detailed features from satellite images. However, Image matching of VHR satellite images remains challenging due to limitations of DL models in which the results are depending on the quantity and quality of training dataset, as well as the difficulty of creating training dataset with VHR satellite images. Therefore, this study examines the feasibility of DL-based method in matching pair extraction which is the most time-consuming process during image registration. This paper also aims to analyze factors that affect the accuracy based on the configuration of training dataset, when developing training dataset from existing multi-sensor VHR image database with bias for DL-based image matching. For this purpose, the generated training dataset were composed of correct matching pairs and incorrect matching pairs by assigning true and false labels to image pairs extracted using a grid-based Scale Invariant Feature Transform (SIFT) algorithm for a total of 12 multi-temporal and multi-sensor VHR images. The Siamese convolutional neural network (SCNN), proposed for matching pair extraction on constructed training dataset, proceeds with model learning and measures similarities by passing two images in parallel to the two identical convolutional neural network structures. The results from this study confirm that data acquired from VHR satellite image database can be used as DL training dataset and indicate the potential to improve efficiency of the matching process by appropriate configuration of multi-sensor images. DL-based image matching techniques using multi-sensor VHR satellite images are expected to replace existing manual-based feature extraction methods based on its stable performance, thus further develop into an integrated DL-based image registration framework.

Mobile Camera-Based Positioning Method by Applying Landmark Corner Extraction (랜드마크 코너 추출을 적용한 모바일 카메라 기반 위치결정 기법)

  • Yoo Jin Lee;Wansang Yoon;Sooahm Rhee
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.6_1
    • /
    • pp.1309-1320
    • /
    • 2023
  • The technological development and popularization of mobile devices have developed so that users can check their location anywhere and use the Internet. However, in the case of indoors, the Internet can be used smoothly, but the global positioning system (GPS) function is difficult to use. There is an increasing need to provide real-time location information in shaded areas where GPS is not received, such as department stores, museums, conference halls, schools, and tunnels, which are indoor public places. Accordingly, research on the recent indoor positioning technology based on light detection and ranging (LiDAR) equipment is increasing to build a landmark database. Focusing on the accessibility of building a landmark database, this study attempted to develop a technique for estimating the user's location by using a single image taken of a landmark based on a mobile device and the landmark database information constructed in advance. First, a landmark database was constructed. In order to estimate the user's location only with the mobile image photographing the landmark, it is essential to detect the landmark from the mobile image, and to acquire the ground coordinates of the points with fixed characteristics from the detected landmark. In the second step, by applying the bag of words (BoW) image search technology, the landmark photographed by the mobile image among the landmark database was searched up to a similar 4th place. In the third step, one of the four candidate landmarks searched through the scale invariant feature transform (SIFT) feature point extraction technique and Homography random sample consensus(RANSAC) was selected, and at this time, filtering was performed once more based on the number of matching points through threshold setting. In the fourth step, the landmark image was projected onto the mobile image through the Homography matrix between the corresponding landmark and the mobile image to detect the area of the landmark and the corner. Finally, the user's location was estimated through the location estimation technique. As a result of analyzing the performance of the technology, the landmark search performance was measured to be about 86%. As a result of comparing the location estimation result with the user's actual ground coordinate, it was confirmed that it had a horizontal location accuracy of about 0.56 m, and it was confirmed that the user's location could be estimated with a mobile image by constructing a landmark database without separate expensive equipment.

Orthophoto and DEM Generation in Small Slope Areas Using Low Specification UAV (저사양 무인항공기를 이용한 소규모 경사지역의 정사영상 및 수치표고모델 제작)

  • Park, Jin Hwan;Lee, Won Hee
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.34 no.3
    • /
    • pp.283-290
    • /
    • 2016
  • Even though existing methods for orthophoto production in traditional photogrammetry are effective in large areas, they are inefficient when dealing with change detection of geometric features and image production for short time periods in small areas. In recent years, the UAV (Unmanned Aerial Vehicle), equipped with various sensors, is rapidly developing and has been implemented in various ways throughout the geospatial information field. The data and imagery of specific areas can be quickly acquired by UAVs at low costs and with frequent updates. Furthermore, the redundancy of geospatial information data can be minimized in the UAV-based orthophoto generation. In this paper, the orthophoto and DEM (Digital Elevation Model) are generated using a standard low-end UAV in small sloped areas which have a rather low accuracy compared to flat areas. The RMSE of the check points is σH = ±0.12 m on a horizontal plane and σV = ±0.09 m on a vertical plane. As a result, the maximum and mean RMSE are in accordance with the working rule agreement for the airborne laser scanning surveying of the NGII (National Geographic Information Institute) on a 1/500 scale digital map. Through this study, we verify the possibilities of the orthophoto generation in small slope areas using general-purpose low specification UAV rather than a high cost surveying UAV.

Efficient Homography Estimation for Panoramic Image Generation (효율적인 호모그래피 추정을 통한 파노라마 영상 생성)

  • Seo, Sangwon;Joeng, Soowoong;Han, Yunsang;Choi, Jongsoo;Lee, Sangkeun
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.8
    • /
    • pp.215-224
    • /
    • 2013
  • An efficient homography estimation method for large sized images is proposed. Estimating an accurate homography is one of the most important parts in image stitching processes. Since hardwares have been advanced, it has been passible to take higher resolution images. However, computational cost for estimating homography has been also increased. Specifically, when too many features exist in the images, it requires lots of computations to estimate a correct homography. Furthermore, there is a high probability of obtaining an incorrect homography. Therefore, we propose a numerical method to extract the appropriate correspondences from several down-scaled images to estimate and compensate the homography numerically for restoring an original homography. Also, if there is an unbalance in color tone between the reference and the target images, we make them balanced by using local information of the overlapped regions. Experimental results show that proposed method is three times faster in 3.2 mega pixel images, five times faster in 8mega pixel images than the conventional approach. Therefore, we believe that the proposed method can be a useful tool to efficiently estimate a homography.

Interpretation of Firing Temperature and Material Characteristics of the Potteries Excavated from the Nongseori Site in Giheung, Korea (기흥 농서리유적 출토 토기의 재료과학적 특성과 소성온도 해석)

  • Gim, Ran-Hui;Lee, Sun-Myeong;Jang, So-Young;Lee, Chan-Hee
    • Journal of Conservation Science
    • /
    • v.25 no.3
    • /
    • pp.255-271
    • /
    • 2009
  • This study was examined interpretation of making techniques and provenance interpretation of raw materials for the potteries from the Nongseori site in Giheung based on archaeometric characteristics. The potteries are classified into three groups according to the archaeological age. The texture of Neolithic age potteries is sandy soil added a lot of temper such as talc and mica, and Bronze age potteries contain sandy materials which occur naturally include quartz, orthoclase, plagioclase and mica. On the other hand, Proto-three Kingdom Age potteries made of silty soil that sift out coarse minerals from the clay. But all pottery and soil samples in the study were very similar patterns with geochemical evolution trend. This result is sufficient evidence that all pottery samples were produced using the same raw materials from the host rocks around of the site area. The Neolithic age potteries had loose texture and fired probably about 700 to $760^{\circ}C$. The Bronze age potteries had experienced firing about 850 to $900^{\circ}C$. And Proto-three Kingdom Age potteries had compact textured and fired from 900 to $1,050^{\circ}C$. The making techniques of potteries are not represented discontinuation characteristics about the periodic time sequences, and are suggested that revealed a transitional change patterns for production techniques.

  • PDF

Changes in the Number of Matching Points in CCTV's Stereo Images by Indoor/Outdoor Illuminance (실내·외 조도에 따른 스테레오 CCTV 영상 정합점 수 변화)

  • Moon, Kwang Il;Pyeon, Mu Wook;Kim, Jong Hwa;Kim, Kang San
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.23 no.1
    • /
    • pp.129-135
    • /
    • 2015
  • The Ubiquitous City (U-City) spatial information technology aimed to provide services freely anytime and anywhere by converging high-tech information & communication technology in urban infrastructure has been available in diverse patterns. In particular, there have been studies on the development of 3D spatial information after selecting and matching key points with stereo images from the many Closed Circuit TV (CCTV) in the U-City. However, the data mostly used in extracting matching points haven't considered external environmental impacts such as illuminance. This study tested how much the matching points needed to construct 3D spatial information with the CCTV whose image quality is dependent upon changes in illuminance fluctuate under the same hardware performances. According to analysis on the number of matching points by illuminance, the number of matching points increased up to 3,000Lux in proportion to the illuminance when IRIS, shutter speed and ISO were fixed. In addition, a border between an object and background became more distinctive. When there was too much light, however, the page became brighter, and noise occurred. Furthermore, it was difficult to name key points because of the collapse of an inter-object border. It appears that if filmed with the study results, the number of matching points would increase.

Discovery of Deleterious nsSNPs on the Genes related to the Lipid Metabolism and Prediction of Changes on Biological Function in Korean Native Chicken (한국 재래닭에서 지질대사 관련 유전자에 존재하는 유해성 nsSNP 발굴 및 생물학적 기능 예측)

  • Oh, Jae-Don;Shin, Dong-Hyun;Shin, Sang-Soo;Yoon, Chang;Song, Ki-Duk
    • Korean Journal of Poultry Science
    • /
    • v.43 no.4
    • /
    • pp.263-272
    • /
    • 2016
  • In this study, we aimed to identify the nonsynonymous single nucleotide polymorphisms (nsSNPs) located in lipid metabolism-related genes because lipids are an important factor affecting the taste and flavor of meat, and they predict the functional consequences. The results showed that we identified 139 common nsSNPs in all five Korean native chicken (KNC) lines from the 81 genes related to lipid metabolism. Furthermore, sorting intolerant from tolerant (SIFT) and polymorphism phenotyping v2 (Polyphen-2) analyses predicted that among the genes, 14 nsSNPs of nine genes might be deleterious. Protein domain prediction of the nine genes revealed that all deleterious nsSNPs identified in this study were located outside the functional domain. This observation suggests that the common deleterious nsSNPs might be dispensable and have a minor effect on the traits of the KNCs.