• Title/Summary/Keyword: panorama image

Search Result 153, Processing Time 0.032 seconds

Image Stitching focused on Priority Object using Deep Learning based Object Detection (딥러닝 기반 사물 검출을 활용한 우선순위 사물 중심의 영상 스티칭)

  • Rhee, Seongbae;Kang, Jeonho;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.25 no.6
    • /
    • pp.882-897
    • /
    • 2020
  • Recently, the use of immersive media contents representing Panorama and 360° video is increasing. Since the viewing angle is limited to generate the content through a general camera, image stitching is mainly used to combine images taken with multiple cameras into one image having a wide field of view. However, if the parallax between the cameras is large, parallax distortion may occur in the stitched image, which disturbs the user's content immersion, thus an image stitching overcoming parallax distortion is required. The existing Seam Optimization based image stitching method to overcome parallax distortion uses energy function or object segment information to reflect the location information of objects, but the initial seam generation location, background information, performance of the object detector, and placement of objects may limit application. Therefore, in this paper, we propose an image stitching method that can overcome the limitations of the existing method by adding a weight value set differently according to the type of object to the energy value using object detection based on deep learning.

Images Grouping Technology based on Camera Sensors for Efficient Stitching of Multiple Images (다수의 영상간 효율적인 스티칭을 위한 카메라 센서 정보 기반 영상 그룹핑 기술)

  • Im, Jiheon;Lee, Euisang;Kim, Hoejung;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.22 no.6
    • /
    • pp.713-723
    • /
    • 2017
  • Since the panoramic image can overcome the limitation of the viewing angle of the camera and have a wide field of view, it has been studied effectively in the fields of computer vision and stereo camera. In order to generate a panoramic image, stitching images taken by a plurality of general cameras instead of using a wide-angle camera, which is distorted, is widely used because it can reduce image distortion. The image stitching technique creates descriptors of feature points extracted from multiple images, compares the similarities of feature points, and links them together into one image. Each feature point has several hundreds of dimensions of information, and data processing time increases as more images are stitched. In particular, when a panorama is generated on the basis of an image photographed by a plurality of unspecified cameras with respect to an object, the extraction processing time of the overlapping feature points for similar images becomes longer. In this paper, we propose a preprocessing process to efficiently process stitching based on an image obtained from a number of unspecified cameras for one object or environment. In this way, the data processing time can be reduced by pre-grouping images based on camera sensor information and reducing the number of images to be stitched at one time. Later, stitching is done hierarchically to create one large panorama. Through the grouping preprocessing proposed in this paper, we confirmed that the stitching time for a large number of images is greatly reduced by experimental results.

Development of a new ball-type phantom for evaluation of the image layer of panoramic radiography

  • Yeom, Han-Gyeol;Kim, Jo-Eun;Huh, Kyung-Hoe;Yi, Won-Jin;Heo, Min-Suk;Lee, Sam-Sun;Choi, Soon-Chul
    • Imaging Science in Dentistry
    • /
    • v.48 no.4
    • /
    • pp.255-259
    • /
    • 2018
  • Purpose: This study proposes a new ball-type phantom for evaluation of the image layer of panoramic radiography. Materials and Methods: The arch shape of an acrylic resin phantom was derived from average data on the lower dental arch in Korean adult males. Metal balls with a 2-mm diameter were placed along the center line of the phantom at a 4-mm mesiodistal interval. Additional metal balls were placed along the 22 arch-shaped lines that ran parallel to the center line at 2-mm buccolingual intervals. The height of each ball in the horizontal plane was spaced by 2.5 mm, and consequently, the balls appeared oblique when viewed from the side. The resulting phantom was named the Panorama phantom. The distortion rate of the balls in the acquired image was measured by automatically calculating the difference between the vertical and horizontal length using $MATLAB^{(R)}$. Image layer boundaries were obtained by applying various distortion rate thresholds. Results: Most areas containing metal balls (91.5%) were included in the image layer with a 50% distortion rate threshold. When a 5% distortion rate threshold was applied, the image layer was formed with a small buccolingual width along the arch-shaped center line. However, it was medially located in the temporomandibular joint region. Conclusion: The Panorama phantom could be used to evaluate the image layer of panoramic radiography, including all mesiodistal areas with large buccolingual width.

Study of High Speed Image Registration using BLOG (BLOG를 이용한 고속 이미지 정합에 관한 연구)

  • Kim, Jong-Min;Kang, Myung-A
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.14 no.11
    • /
    • pp.2478-2484
    • /
    • 2010
  • In this paper, real-time detection methods for Panorama system Key-Points offers. A recent study in PANORAMA system real-time area navigation or DVR to apply such research has recently been actively. The detection of the Key-Point is the most important elements that make up a Panorama system. Not affected by contrast, scale, Orientation must be detected Key-Point. Existing research methods are difficult to use in real-time Because it takes a lot of computation time. Therefore, this paper propose BLOG(BitRate Laplacian Of Gaussian)method for faster time Key-Point Detecting and Through various experiments to detect the Speed, Computation, detection performance is compared against.

Development of an Interactive Virtual Reality Service based on 360 degree VR Image (360도 파노라마 영상 기반 대화형 가상현실 서비스 구축)

  • Kang, Byoung-Gil;Ryu, Seuc-Ho;Lee, Wan-Bok
    • Journal of Digital Convergence
    • /
    • v.15 no.11
    • /
    • pp.463-470
    • /
    • 2017
  • Currently, virtual reality contents using VR images are spotlighted since they can be easily created and utilized. But because VR images are in a state of lack of interaction, there are limitations in their applications and usability.In order to overcome this problem, we propose a new method in which 360 degree panorama image and game engine are utilized to develop a high resolution of interactive VR service in real time. In particular, since the background image, which is represented by a form of panorama image, is pre-generated through a heavy rendering computation, it can be used to provide a immersive VR service with a relatively small amount of computation in run time on a low performance device. In order to show the effectiveness of our proposed method, an interactive game of a virtual zoo environment was implemented and illustrated showing that it can improve user interaction and immersion experience in a pretty good way.

A Study on the Internet Broadcasting Image Processing based on Offloading Technique on the Mobile Environments (모바일 환경에서 오프로딩 기술 기반 인터넷 방송 영상 처리에 관한 연구)

  • Kang, Hong-gue
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.18 no.6
    • /
    • pp.63-68
    • /
    • 2018
  • Offloading is a method of communicating, processing, and receiving results from some of the applications performed on local computers to overcome the limitations of computing resources and computational speed.Recently, it has been applied in mobile games, multimedia data, 360-degree video processing, and image processing for Internet broadcasting to speed up processing and reduce battery consumption in the mobile computing sector. This paper implements a viewer that enables users to convert various flat-panel images and view contents in a wireless Internet environment and presents actual results of an experiment so that users can easily understand the images. The 360 degree spherical image is successfully converted to a plane image with Double Panorama, Quad, Single Rectangle, 360 Overview + 3 Rectangle depending on the image acquisition position of the 360 degree camera through the interface. During the experiment, more than 100 360 degree spherical images were successfully converted into plane images through the interface below.

Parallax Distortion Detection and Correction Method for Video Stitching by using LDPM Image Assessment (LDPM 영상 평가를 활용한 동영상 스티칭의 시차 왜곡 검출 및 정정 방법)

  • Rhee, Seongbae;Kang, Jeonho;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.25 no.5
    • /
    • pp.685-697
    • /
    • 2020
  • Immersive media videos, such as panorama and 360-degree videos, must provide a sense of realism as if the user visited the space in the video, so they should be able to represent the reality of the real world. However, in panorama and 360-degree videos, objects appear to overlap or disappear due to parallax between cameras, and such parallax distortion may interfere with immersion of the user's content. Accordingly, although many video stitching algorithms have been proposed to overcome parallax distortion, parallax distortion still occurs due to the low performance of the Object detection module and limitations of the Seam generation method. Therefore, this paper analyzes the limitations of the existing video stitching technology and proposes a method for detecting and correcting parallax distortion of video stitching using the LDPM (Local Differential Pixel Mean) image evaluation method that overcomes the limitations of the video stitching technique.

An algorithm of the natural view transition in the panoramic image based navigation using Fast Fourier Transform Techniques (파노라마 영상 기반 네비게이션에서 FFT 기술을 이용한 자연스러운 장면 전환 알고리즘)

  • Kim, Dae-Hyun;Choi, Jong-Soo;Kim, Tae-Eun
    • The KIPS Transactions:PartB
    • /
    • v.10B no.5
    • /
    • pp.561-566
    • /
    • 2003
  • This paper proposes a new algorithm that generates smooth and realistic transition views from one viewpoint to another view point on the panorama based navigation system. The proposed algorithm is composed with two steps. One is prewarping that aligns the viewing direction in two panorama image, the other is bidirectional disparity morphing (BDM) that generates the intermediate scene from the aligned panorama images. For the prewarping, first of all, we compute the phase correlation between two images in order to get the information such as the displacement, rotation, and scale. Then we align the original images using these information. As soon as finishing the prewarping, we compute the block based disparity vectors (DVs) and smooth them using the two occluding patterns. As we apply these DVs to the BDM, we can get the elaborate intermediate scenes. We make an experiment on the proposed algorithm with real panoramic images and we can get the satisfactory results.

Bifid Mandibular Canal: Radiographic Observation and Clinical Relevance -A Case Report- (이열 하악관(Bifid Mandibular Canal): 방사선적 소견과 임상적 의의 -증례보고-)

  • Lee, Hyun-Woo;Kim, Yeo-Gab;Lee, Baek-Soo;kwon, Yong-Dae;Choi, Byung-Jun;Kim, Young-Ran
    • Journal of The Korean Dental Society of Anesthesiology
    • /
    • v.9 no.1
    • /
    • pp.24-29
    • /
    • 2009
  • When performing the inferior alveolar nerve block anesthesia, surgeon often faced a difficulty of the surgical operation due to the incomplete anesthesia. One of the reason is the variety of mandibular canal anatomy. Up to now, there are some reports of index cases about bifid mandibular canal among mandibular canal anatomic variation, and some classification is applied according to anatomical location and configuration. When surgical operation is performed involving mandible such as dantal implant treatment, extraction of an impacted third molar, sagittal split ramus osteotomy, etc, the position of mandibular canal should be considered. Bifid mandibular canal clinically causes troublesome cases of anesthesia when inferior alvelor nerve block, especially is performed extraction of an impacted third molar. Therefore, It is important for clinicians to recognize the presence of bifid canals on radiographys. Nowadays, the position of mandibular canal can be measured precisely by using Dental CT. It is not found by panorama image but is found by Dental CT sometimes. Among the patients, which take panorama and Dental CT simultaneously, for tooth extraction of lower impacted third molar in our department, we report the case that did not identifying in panorama but identifying it in Dental CT.

  • PDF

Automatic Individual Tooth Region Separation using Accurate Tooth Curve Detection for Orthodontic Treatment Planning

  • Lee, Chan-woo;Chae, Ok-sam
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.4
    • /
    • pp.57-64
    • /
    • 2018
  • In this paper, we propose the automatic detection method for individual region separation using panorama image. Finding areas that contain individual teeth is one of the most important tasks in automating 3D models through individual tooth separation. In the conventional method, the maxillary and mandibular teeth regions are separated using a straight line or a specific CT slide, and the tooth regions are separated using a straight line in the vertical direction. In the conventional method, since the teeth are arranged in a curved shape, there is a problem that each tooth region is incorrectly detected in order to generate an accurate tooth region. This is a major obstacle to automating the creation of individual tooth models. In this study, we propose a method to find the correct tooth curve by using the jawbone curve which is very similar to the tooth curve in order to overcome the problem of finding the area containing the existing tooth. We have proposed a new method to accurately set individual tooth regions using the feature that individual teeth are arranged in a direction similar to the normal direction of the tooth alignment curve. In the proposed method, the maxillary and mandibular teeth can be more precisely separated than the conventional method, and the area including the individual teeth can be accurately set. Experiments using real dental CT images demonstrate the superiority of the proposed method.