• Title/Summary/Keyword: augmented reality (AR)

Search Result 728, Processing Time 0.028 seconds

Preliminary study on application of augmented reality visualization in robotic thyroid surgery

  • Lee, Dongheon;Kong, Hyoun-Joong;Kim, Donguk;Yi, Jin Wook;Chai, Young Jun;Lee, Kyu Eun;Kim, Hee Chan
    • Annals of Surgical Treatment and Research
    • /
    • v.95 no.6
    • /
    • pp.297-302
    • /
    • 2018
  • Purpose: Increased robotic surgery is attended by increased reports of complications, largely due to limited operative view and lack of tactile sense. These kinds of obstacles, which seldom occur in open surgery, are challenging for beginner surgeons. To enhance robotic surgery safety, we created an augmented reality (AR) model of the organs around the thyroid glands, and tested the AR model applicability in robotic thyroidectomy. Methods: We created AR images of the thyroid gland, common carotid arteries, trachea, and esophagus using preoperative CT images of a thyroid carcinoma patient. For a preliminary test, we overlaid the AR images on a 3-dimensional printed model at five different angles and evaluated its accuracy using Dice similarity coefficient. We then overlaid the AR images on the real-time operative images during robotic thyroidectomy. Results: The Dice similarity coefficients ranged from 0.984 to 0.9908, and the mean of the five different angles was 0.987. During the entire process of robotic thyroidectomy, the AR images were successfully overlaid on the real-time operative images using manual registration. Conclusion: We successfully demonstrated the use of AR on the operative field during robotic thyroidectomy. Although there are currently limitations, the use of AR in robotic surgery will become more practical as the technology advances and may contribute to the enhancement of surgical safety.

Usability Principles for a Mobile Augmented Reality Application -Focus on Wayfinding- (증강현실 기반 모바일 애플리케이션의 사용성 원칙 연구 -길찾기 서비스 중심으로-)

  • Yoo, Chang-Hwa;Oh, Dong-Woo
    • Journal of the Korea Convergence Society
    • /
    • v.13 no.4
    • /
    • pp.643-651
    • /
    • 2022
  • The mobile augmented reality(MAR) market is rapidly growing with following the sudden rise of the metaverse. However, research on improving user experience in mobile augmented reality environment is lacking. This study aims to develop the usability principles of an AR-based smartphone app. The research conducts following methods. 1)The characteristics of MAR were understood to identify usability elements of AR apps. 2)Usability principles were collected through analysis of case studies on the usability of AR and the 14 usability principles were developed through in-depth interviews with experts for the purpose of chunking. 3)To verify the 14 developed usability principles, evaluation items were composed based on the usability principles and usability evaluation survey was conducted. Consequently, significant differences were found in immersivity, presence, efficiency, satisfaction, playfulness and It was verified that the developed usability principle is useful in developing AR based smartphone apps. This study is meaningful in that it conducted the basic research of mobile AR usability principles

Augmented Reality (AR) Fashion Shopping Service Acceptance Based on Consumers' Technology Readiness (소비자 기술준비도에 따른 증강현실(AR) 패션 쇼핑 서비스 수용의도)

  • Hur, Hee Jin;Lee, Ha Kyung
    • Fashion & Textile Research Journal
    • /
    • v.23 no.3
    • /
    • pp.347-357
    • /
    • 2021
  • This study analyzed the effects of optimism and innovativeness, the two drivers of a consumer's technological readiness to use an augmented reality(AR) fashion shopping service within the framework of the Technology Acceptance Model (TAM). The survey was conducted on 249 people (males = 58; females = 191) in their 20s who were willing to participate in the AR experience. Data were analyzed using confirmatory factor analysis (CFA) and structural equation modeling by AMOS 22.0. The results indicated that a greater level of perceived optimism had a positive influence on the ease of use and usefulness of the technology. The findings also show that consumers with a high degree of innovativeness tend to have a higher level of playfulness toward AR fashion shopping. Regarding the effects of user beliefs, ease of use had a positive effect on the perception of usefulness and playfulness with higher levels implying a higher consumer intention to adopt an AR fashion shopping service. In addition, this study reveals the moderating effect of consumers with high-fashion versus those with low-fashion innovativeness. For the latter, technological innovation had an insignificant effect on playfulness, thus indicating that consumers with low interest in fashion did not enjoy AR fashion shopping even if the technology was highly innovative. Nevertheless, the analysis confirms the possibility that experiencing a fashion product through AR technology could replace the actual experience of wearing the products.

Development of Character Goods Content Utilizing Marker-based Augmented Reality (마커기반 증강현실을 활용한 캐릭터 굿즈 콘텐츠 개발)

  • AHN CHAN JE
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.3
    • /
    • pp.953-958
    • /
    • 2024
  • Recently, there has been growing interest in the Fourth Industrial Revolution, with a particular focus on the advancement of augmented reality (AR) devices. However, there is a shortage of AR content. Augmented reality operates through marker-based and markerless methods. The marker-based approach involves using a camera to capture images that serve as markers, enhancing them through AR principles. To address the scarcity of AR content and improve the quality of character goods, this study proposes integrating AR technology into character goods. The character industry is expanding each year, leading to a diverse range of character goods. Character acrylic stands, among these goods, leverage game, webtoon, and animation character IPs for sales. To enhance the design process, we utilized the character image as a marker, allowing for the creation of content that aligns with the characteristics of the character IP. We selected a webtoon character and developed AR content, incorporating features such as voice, speech bubbles, and an introduction to the webtoon, tailored to the webtoon's characteristics. This study demonstrates the potential of AR to present visual and auditory information, paving the way for a variety of products, including diverse content. We anticipate that utilizing this research will lead to the emergence of products encompassing various contents.

A Proposal of VST-HMD based XR Experience Framework for Immersive Cultural Heritage Site Education (몰입형 문화유산 현장 교육을 위한 VST-HMD 기반 XR 체험 프레임워크 제안)

  • Kwon, Oh-Yang;Yu, Jeong-Min
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2020.07a
    • /
    • pp.397-400
    • /
    • 2020
  • 본 논문에서는 문화유산 현장에서의 몰입형 교육을 위한 VST(Video See-through) 방식의 HMD(Head Mounted Display) 기반 XR(eXtended Reality) 체험 프레임워크를 제안한다. 매장문화재적 요소가 강한 문화유산 현장의 경우 실물이 남아있지 않아 교육 및 체험 측면에서 흥미로운 정보 전달이 어렵다. 최근 모바일 기기의 대중적인 확산에 따라 이를 이용해 문화유산 현장에 소실된 문화유산을 AR(Augmented Reality)로 복원 및 시각화하거나 관련 정보를 제공하는 연구들이 이루어졌으며, 나아가 OST(Optical See-through) 방식의 안경형 AR 디스플레이를 활용하는 사례들도 등장했다. 그러나 이러한 연구들은 기기의 특성으로 인해 몰입감과 사용성 측면에서 한계점을 보였으며, 단순히 소실된 문화유산의 복원된 모습을 정적으로 시각화하는 것에 그쳐 문화유산 현장에 내재된 동적인 역사 스토리를 재현한다는 측면에서 부족한 점이 있었다. 본 논문에서는 문화유산 현장에서 VST-HMD를 이용하여 AR 기반의 정적 문화유산 시각화뿐만 아니라 VR(Virtual Reality) 기반의 동적 역사 스토리 애니메이션을 제공하는 XR 체험 프레임워크를 제안하여 더욱 몰입감 있고 만족스러운 문화유산 교육을 제공하는 방안에 대해 검토한다.

  • PDF

Design and Implementation of Mobile System for Supporting AR (증강 현실 지원을 위한 모바일 시스템 설계 및 구현)

  • Lee, Jong-Keun;Lee, Jong-Hyeok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.16 no.9
    • /
    • pp.2072-2077
    • /
    • 2012
  • In this paper we tried to overcome the limit of contents which occur when we implement the augmented reality technology adapted application on commercialized mobile system. First of all, we checked the requirement analysis of exclusive mobile system to support augmented reality. And then we designed and realized the mobile system based on this facts. Also we embodied augmented reality application based on NyARToolkit which assists augmented reality techniques. Finally the implemented contents operated properly in our exclusive mobile system. Consequently we confirmed the suitability and validity of our system through above test.

Augmented Reality Haptic Upper Garment for Wear Sensation (착용감 구현을 위한 증강현실용 햅틱 상의(上衣))

  • Yim, Eunhyuk;Kwon, Jeanne;Lee, Sooyong
    • The Journal of Korea Robotics Society
    • /
    • v.14 no.2
    • /
    • pp.150-156
    • /
    • 2019
  • Haptic systems have been widely used for both virtual reality and augmented reality application including game, entertainment, education and medical sectors. Clothing designers and retailers initiated using AR and VR technologies to help the consumers find style with the perfect fit. Most of the developed augmented reality shopping is implemented by overlapping the image of the clothes on the customer so that he/she can find the fit. However, those are only visual information and the customer cannot experience the real size and the stiffness of the clothes. In this paper, we present the haptic upper garment which provides the haptic feedback to the user using cables. By controlling the length of the cable, the size of the clothes is set and by stiffness control, the compliance of the fabric is implemented. The haptic garment is modeled for precise control and the distributed controller architecture is described. With the haptic upper garment, the user's experience of the virtual clothes is greatly enhanced.

A Sketch-based 3D Object Retrieval Approach for Augmented Reality Models Using Deep Learning

  • Ji, Myunggeun;Chun, Junchul
    • Journal of Internet Computing and Services
    • /
    • v.21 no.1
    • /
    • pp.33-43
    • /
    • 2020
  • Retrieving a 3D model from a 3D database and augmenting the retrieved model in the Augmented Reality system simultaneously became an issue in developing the plausible AR environments in a convenient fashion. It is considered that the sketch-based 3D object retrieval is an intuitive way for searching 3D objects based on human-drawn sketches as query. In this paper, we propose a novel deep learning based approach of retrieving a sketch-based 3D object as for an Augmented Reality Model. For this work, we introduce a new method which uses Sketch CNN, Wasserstein CNN and Wasserstein center loss for retrieving a sketch-based 3D object. Especially, Wasserstein center loss is used for learning the center of each object category and reducing the Wasserstein distance between center and features of the same category. The proposed 3D object retrieval and augmentation consist of three major steps as follows. Firstly, Wasserstein CNN extracts 2D images taken from various directions of 3D object using CNN, and extracts features of 3D data by computing the Wasserstein barycenters of features of each image. Secondly, the features of the sketch are extracted using a separate Sketch CNN. Finally, we adopt sketch-based object matching method to localize the natural marker of the images to register a 3D virtual object in AR system. Using the detected marker, the retrieved 3D virtual object is augmented in AR system automatically. By the experiments, we prove that the proposed method is efficiency for retrieving and augmenting objects.

Construction of Skin Color Map for Resolving Hand Occlusion in AR Environments (증강현실 환경에서 손 가림 해결을 위한 피부 색상 정보 획득)

  • Park, Sang-Jin;Park, Hyungjun
    • Korean Journal of Computational Design and Engineering
    • /
    • v.19 no.2
    • /
    • pp.111-118
    • /
    • 2014
  • In tangible augmented reality (AR) environments, the user interacts with virtual objects by manipulating their physical counterparts, but he or she often encounters awkward situations in which his or her hands are occluded by the augmented virtual objects, which causes great difficulty in figuring out hand positions, and reduces both immersion and ease of interaction. To solve the problem of such hand occlusion, skin color information has been usefully exploited. In this paper, we propose an approach to simple and effective construction of a skin color map which is suitable for hand segmentation and tangible AR interaction. The basic idea used herein is to obtain hand images used in a target AR environment by simple image subtraction and to represent their color information by a convex polygonal map in the YCbCr color space. We experimentally found that the convex polygonal map is more accurate in representing skin color than a conventional rectangular map. After implementing a solution for resolving hand occlusion using the proposed skin color map construction, we showed its usefulness by applying it to virtual design evaluation of digital handheld products in a tangible AR environment.

LEGO House Multi Interaction Space Collaboration (레고하우스 : 멀티 인터렉션 공간에서의 협업)

  • Irawati, Sylvia;Ahn, Sang-Chul;Ahn, Jong-Gil;Kim, Jin-Wook;Ko, Hee-Dong
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.481-486
    • /
    • 2008
  • Recent advanced interlace technologies allow the user to interact with different spaces such as Virtual Reality (VR), Augmented Reality (AR) and Ubiquitous Computing (UC) spaces. Here, we present a LEGO House application, a collaborative application which involves multi interaction spaces -VR, AR and UC spaces. The LEGO House application is built based on the VARU framework which is designed for enabling the prototyping of a tangible space application. The application is about an interior design. One user is located in the combined AR and UC space and interacts with the AR LEGO house and the physical smart devices. The other users interact with the virtual LEGO house but they share the same environment, the LEGO house. Therefore, they can collaborate together as they are co-located.

  • PDF