• IEMEK Journal of Embedded Systems and Applications
• /
• v.5 no.4
• /
• pp.195-205
• /
• 2010

The popularity of Smartphones makes new fields of applications based on location based service easily feasible with a new user interface called augmented reality (AR). It presents a particularly powerful user interface to context-aware computing environments. AR on Smartphones integrates virtual information into a person's physical environment by overlaying information on an image taken through Smartphone's camera and motion sensors. Mobile augmented reality systems provide this service without constraining the individual's whereabouts to a specially equipped area. This work presents an overview of handheld augmented reality focusing on applications with introducing the basic issues of them. For this purpose, an example system, Studierstube ES (embedded system), is cited, which introduces the most significant problems and various methods of solving them through the experience of converting existing PC-based AR system into handheld AR.

• International Journal of Advanced Culture Technology
• /
• v.9 no.4
• /
• pp.295-301
• /
• 2021

Digital media technology is gradually developing with the development of convergence quaternary industrial technology and mobile devices. The combination of deep learning and augmented reality can provide more convenient and lively services through the interaction of 3D virtual images with the real world. We combine deep learning-based pose prediction with augmented reality technology. We predict the eight vertices of the bounding box of the object in the image. Using the predicted eight vertices(x,y), eight vertices(x,y,z) of 3D mesh, and the intrinsic parameter of the smartphone camera, we compute the external parameters of the camera through the PnP algorithm. We calculate the distance to the object and the degree of rotation of the object using the external parameter and apply to AR content. Our method provides services in a web environment, making it highly accessible to users and easy to maintain the system. As we provide augmented reality services using consumers' smartphone cameras, we can apply them to various business fields.

• Journal of the Korea Computer Graphics Society
• /
• v.27 no.3
• /
• pp.55-63
• /
• 2021

This study proposes an interface for providing mobile interaction suitable for mobile virtual reality (VR) and analyzes it through comparative experiments. The proposed interface is premised on not using additional equipment except for the mobile head-mounted display(HMD) in consideration of accessibility and usability. And the interface that controls the movement interaction using the user's gaze is designed in two phases. The key is to minimize the occurrence of negative factors such as VR sickness that can be caused by straight line movement in virtual reality. To this end, two phases are designed: an interface composed of forward/backward buttons to move the gaze toward the ground, and an interface composed of left and right buttons on the front in consideration of the gaze change in real walking motion. An application that can compare and analyze movement interactions through the proposed interface is produced, and a survey experiment is conducted to analyze the user's satisfaction with the interface experience and the negative impact on the movement process. It was confirmed that the proposed movement interaction reduced negative effects such as VR sickness along with a satisfactory interface experience for users.

• Educational Technology International
• /
• v.20 no.2
• /
• pp.137-168
• /
• 2019

This study examined the effects of information volume and distribution on learners' cognitive load and recall in a mobile augmented reality (AR) environment. Information volume refers to the degree of information users are provided in a learning task, while information distribution indicates the way in which information is distributed, either in a virtual or real format. Sixteen undergraduate students participated in the study, which employed a 2 × 3 randomized block factorial design with repeated measures. Information volume and distribution were independent variables, and factors in learners' cognitive load (mental effort, perceived ease of use, and perceived task difficulty) and recall test scores were the dependent variables. Information volume had significant main effects on perceived ease of use and task difficulty, and recall test scores, while information distribution had significant main effects on perceived task difficulty and test scores. A detailed discussion and implications are provided.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.4
• /
• pp.21-27
• /
• 2018

In this paper, we propose a real-time interaction method using user's mouth wind in mobile device. In mobile and virtual reality, user interaction technology is important, but various user interface methods is still lacking. Most of the interaction technologies are hand touch screen touch or motion recognition. In this study, we propose an interface technology that can interact with real time using user's mouth wind. The direction of the wind is determined by using the angle and the position between the user and the mobile device, and the size of the wind is calculated by using the magnitude of user's mouth wind. To show the superiority of the proposed technique, we show the result of visualizing the flow of the vector field in real time by integrating the mouth-wind interface into the Navier-Stokes equations. We show the results of the paper on mobile devices, but can be applied in the Agumented reality(AR) and Virtual reality(VR) fields requiring interface technology.

• Journal of Internet Computing and Services
• /
• v.12 no.3
• /
• pp.119-129
• /
• 2011

Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. Especially, recent increasing demands for mobile augmented reality require the development of efficient interactive technologies between the augmented virtual object and users. This paper presents a novel approach to construct marker-less mobile augmented reality object and control the object. Replacing a traditional market, the human hand interface is used for marker-less mobile augmented reality system. In order to implement the marker-less mobile augmented system in the limited resources of mobile device compared with the desktop environments, we proposed a method to extract an optimal hand region which plays a role of the marker and augment object in a realtime fashion by using the camera attached on mobile device. The optimal hand region detection can be composed of detecting hand region with YCbCr skin color model and extracting the optimal rectangle region with Rotating Calipers Algorithm. The extracted optimal rectangle region takes a role of traditional marker. The proposed method resolved the problem of missing the track of fingertips when the hand is rotated or occluded in the hand marker system. From the experiment, we can prove that the proposed framework can effectively construct and control the augmented virtual object in the mobile environments.

• International Journal of Internet, Broadcasting and Communication
• /
• v.13 no.1
• /
• pp.54-60
• /
• 2021

AR (Augmented Reality) is a technology that provides virtual content to the real world and provides additional information to objects in real-time through 3D content. In the past, a high-performance device was required to experience AR, but it was possible to implement AR more easily by improving mobile performance and mounting various sensors such as ToF (Time-of-Flight). Also, the importance of mobile augmented reality is growing with the commercialization of high-speed wireless Internet such as 5G. Thus, this paper proposes a system that can provide AR services via GNN (Graph Neural Network) using cameras and sensors on mobile devices. ToF of mobile devices is used to capture depth maps. A 3D point cloud was created using RGB images to distinguish specific colors of objects. Point clouds created with RGB images and Depth Map perform downsampling for smooth communication between mobile and server. Point clouds sent to the server are used for 3D object detection. The detection process determines the class of objects and uses one point in the 3D bounding box as an anchor point. AR contents are provided through app and web through class and anchor of the detected object.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.8 no.12
• /
• pp.1933-1940
• /
• 2013

Recently, due to improvement of computer performance and development of information devices, technology of mobile augmented reality is proliferating rapidly. However, because most of contents are passive or limitary, user can not feel interest and immersion. This paper designs interaction user interface system of 2 dimensional drawing based on mobile augmented reality to make bi-directional communication between the real world and the virtual world possible by using the vision based augmented reality and the database system.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.1179-1186
• /
• 2022

Building Information Modeling (BIM) is widely used to efficiently share, utilize and manage information generated in every phase of a construction project. Recently, mixed reality (MR) technologies have been introduced to more effectively utilize BIM elements. This study deals with the haptic interactions between humans and BIM elements in MR to improve BIM usability. As the first step in interacting with virtual objects in mixed reality, we challenged moving a virtual object to the desired location using finger-pointing. This paper presents the procedure of developing a haptic interface system where users can interact with a BIM object to move it to the desired location in MR. The interface system consists of an MR-based head-mounted display (HMD) and a mobile application developed using Unity 3D. This study defined two segments to compute the scale factor and rotation angle of the virtual object to be moved. As a result of testing a cuboid, the user can successfully move it to the desired location. The developed MR-based haptic interface can be used for aligning BIM elements overlaid in the real world at the construction site.

• Journal of Internet Computing and Services
• /
• v.16 no.4
• /
• pp.25-37
• /
• 2015

This study has developed a mobile AR contents Builder (MARB) featuring the augmentation of virtual objects, e. g. 2D images, 3D models and videos on user-preferred markers in mobile environment and with connected interaction events. The developed MARB is capable of augmenting multiple virtual objects on markers preferred by users, and selectively supporting many marker-specific interaction events. The MARB is also developed as a mobile App for convenience of use in the mobile environment. This makes users to implement AR contents by a GUI-based authoring procedure on the mobile device. The developed MARB allows App developers and general users to author mobile contents easily and can be applied to various field by those who wish to use diverse mobile AR contents. Moreover, the MARB will provide solutions for the expansion of mobile AR market, by overcoming the difficulties of mobile AR content development.