• Journal of KIBIM
• /
• v.11 no.3
• /
• pp.45-54
• /
• 2021

The augmented reality (AR) has recently became an attractive technology in construction industry, which can play a critical role in realizing smart construction concepts. The AR has a great potential to help construction workers access digitalized information about design and construction more flexibly and efficiently. Though several AR applications have been introduced for on-site made to enhance on-site and off-site tasks, few are utilized in actual construction fields. This paper proposes a new AR framework that provides on-site managers with an opportunity to easily access the information about construction resources such as workers and equipment. The framework records videos with the camera installed on a wearable AR device and streams the video in a server equipped with high-performance processors, which runs an object detection algorithm on the streamed video in real time. The detection results are sent back to the AR device so that menu buttons are visualized on the detected objects in the user's view. A user is allowed to access the information about a worker or equipment appeared in one's view, by touching the menu button visualized on the resource. This paper details implementing parts of the framework, which requires the data transmission between the AR device and the server. It also discusses thoroughly about accompanied issues and the feasibility of the proposed framework.

• Korean Journal of Computational Design and Engineering
• /
• v.16 no.1
• /
• pp.1-10
• /
• 2011

In this paper, we propose an AR-based tangible interaction using a finger fixture for virtual evaluation of digital handheld products. To realize tangible interaction between a user and a product in a computer-vision based AR environment, we uses two types of tangible objects: a product-type object and a finger fixture. The product-type object is used to acquire the position and orientation of the product, and the finger fixture is used to recognize the position of a finger tip. The two objects are fabricated by RP technology and AR markers are attached to them. The finger fixture is designed to satisfy various requirements with an ultimate goal that the user holding the finger fixture in his or her index finger can create HMI events by touching specified regions (buttons or sliders) of the product-type object with the finger tip. By assessing the accuracy of the proposed interaction, we have found that it can be applied to a wide variety of digital handheld products whose button size is not less than 6 mm. After performing the design evaluation of several handheld products using the proposed AR-based tangible interaction, we received highly encouraging feedback from users since the proposed interaction is intuitive and tangible enough to provide a feeling like manipulating products with human hands.

• Journal of the Semiconductor & Display Technology
• /
• v.20 no.4
• /
• pp.23-28
• /
• 2021

Augmented reality is a technique for combining virtual images into real life by showing information of virtual 3D objects on top of a real-world environment (Azuma et al., 2001). This study is an augmented reality-based educational content delivery device that receives user input that selects either a preset object or a photographed object for augmented reality-based training; It includes a three-dimensional design generation unit that generates a stereoscopic model of the augmented reality environment from an object, a three-dimensional view of the scene, a disassembly process of the developing road from a three-dimensional model, and a content control unit provided by the user terminal by generating educational content including a three-dimensional model, a scene chart, a scene, a decomposition process, and a coupling process to build a coupling process from the scene to the three-dimensional model in an augmented reality environment. The next study provides a variety of educational content so that children can use AR technology as well as shapes to improve learning effectiveness. We also believe that studies are needed to quantitatively measure the efficacy of which educational content is more effective when utilizing AR technology.

• Journal of Internet Computing and Services
• /
• v.21 no.1
• /
• pp.33-43
• /
• 2020

Retrieving a 3D model from a 3D database and augmenting the retrieved model in the Augmented Reality system simultaneously became an issue in developing the plausible AR environments in a convenient fashion. It is considered that the sketch-based 3D object retrieval is an intuitive way for searching 3D objects based on human-drawn sketches as query. In this paper, we propose a novel deep learning based approach of retrieving a sketch-based 3D object as for an Augmented Reality Model. For this work, we introduce a new method which uses Sketch CNN, Wasserstein CNN and Wasserstein center loss for retrieving a sketch-based 3D object. Especially, Wasserstein center loss is used for learning the center of each object category and reducing the Wasserstein distance between center and features of the same category. The proposed 3D object retrieval and augmentation consist of three major steps as follows. Firstly, Wasserstein CNN extracts 2D images taken from various directions of 3D object using CNN, and extracts features of 3D data by computing the Wasserstein barycenters of features of each image. Secondly, the features of the sketch are extracted using a separate Sketch CNN. Finally, we adopt sketch-based object matching method to localize the natural marker of the images to register a 3D virtual object in AR system. Using the detected marker, the retrieved 3D virtual object is augmented in AR system automatically. By the experiments, we prove that the proposed method is efficiency for retrieving and augmenting objects.

• Journal of information and communication convergence engineering
• /
• v.20 no.1
• /
• pp.65-72
• /
• 2022

With the mark of the fourth industrial revolution, the smart factory is evolving into a new future manufacturing plant. As a human-machine-interactive tool, augmented reality (AR) helps workers acquire the proficiency needed in smart factories. The valuable data displayed on the AR device must be delivered intuitively to users. Current AR applications used in smart factories lack user movement calibration, and visual fiducial markers for position correction are detected only nearby. This paper demonstrates a marker-based object detection using perspective projection to adjust augmented content while maintaining the user's original perspective with displacement. A new angle, location, and scaling values for the AR content can be calculated by comparing equivalent marker positions in two images. Two experiments were conducted to verify the implementation of the algorithm and its practicality in the smart factory. The markers were well-detected in both experiments, and the applicability in smart factories was verified by presenting appropriate displacement values for AR contents according to various movements.

• Korean Journal of Computational Design and Engineering
• /
• v.18 no.5
• /
• pp.374-383
• /
• 2013

Various interaction techniques have been studied for providing the feeling of touch and improve immersion in augmented reality (AR) environments. Tangible AR interaction exploiting two types (product-type and pointer-type) of simple objects has earned great interest for cost-effective design evaluation of digital handheld products. When the sizes of markers attached to the objects are kept big to obtain better marker recognition, the pointer-type object frequently and significantly occludes the product-type object, which deteriorates natural visualization and level of immersion in an AR environment. In this paper, in order to overcome such problems, we propose tangible AR interaction using fingertip touch combined with small-sized markers. The proposed approach facilitates the use of convex polygons to recover the boundaries of AR markers which are partially occluded. It also properly enlarges the pattern area of each AR marker to reduce the sizes of AR markers without sacrificing the quality of marker detection. We empirically verified the quality of the proposed approach, and applied it in the process of design evaluation of digital products. From experimental results, we found that the approach is comparably accurate enough to be applied to the design evaluation process and tangible enough to provide a pseudo feeling of manipulating virtual products with human hands.

• Journal of Internet Computing and Services
• /
• v.15 no.1
• /
• pp.171-178
• /
• 2014

This paper presents dynamic modelling of a virtual object in augmented reality environments when external forces are applied to the object in real-time fashion. In order to simulate a natural behavior of the object we employ the theory of Newtonian physics to construct motion equation of the object according to the varying external forces applied to the AR object. In dynamic modelling process, the physical interaction is taken placed between the augmented object and the physical object such as a haptic input device and the external forces are transferred to the object. The intrinsic properties of the augmented object are either rigid or elastically deformable (non-rigid) model. In case of the rigid object, the dynamic motion of the object is simulated when the augmented object is collided with by the haptic stick by considering linear momentum or angular momentum. In the case of the non-rigid object, the physics-based simulation approach is adopted since the elastically deformable models respond in a natural way to the external or internal forces and constraints. Depending on the characteristics of force caused by a user through a haptic interface and model's intrinsic properties, the virtual elastic object in AR is deformed naturally. In the simulation, we exploit standard mass-spring damper differential equation so called Newton's second law of motion to model deformable objects. From the experiments, we can successfully visualize the behavior of a virtual objects in AR based on the theorem of physics when the haptic device interact with the rigid or non-rigid virtual object.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.33 no.6
• /
• pp.2509-2518
• /
• 2013

Augmented reality (AR) technology visualizes a real type object that cannot simulate in virtual reality technology by overlapping a virtual object and real object in a computer system. This study suggests a methodology and prototype system for applying AR system to rebar distribution work in a civil engineering project. Rebar work in civil engineering project is a representative activity that is progressed by empirical approach of skilled labor rather than formalized manual. AR technology improves the constructability of rebar work because AR tool can identify missing rebars and different rebars comparing with the drawings. AR system developed in this study can enhance the understanding of rebar work using 3D modeling with real image of construction site and save construction cost by reducing reconstruction work.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.21 no.1
• /
• pp.195-200
• /
• 2021

With the development of transportation and mobiles demand for tourism travel is increasing and related industries are also developing significantly. The combination of augmented reality and tourism contents one of the areas of digital media technology, is also actively being studied, and artificial intelligence is already combined with the tourism industry in various directions, enriching tourists' travel experiences. In this paper, we propose a system that scans miniature models produced by reducing tourist areas, finds the relevant tourist sites based on models learned using deep learning in advance, and provides relevant information and 3D models as AR services. Because model learning and object detection are carried out using YOLOv3 neural networks, one of various deep learning neural networks, object detection can be performed at a fast rate to provide real-time service.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.9 no.3
• /
• pp.297-302
• /
• 2014

The AR(Augmented Reality) is the technique that make the fusion between real world and virtual object. The augmented object on real world can provide the visualization of digital information to user. Also, the real-time AR system makes the interaction between user and computers. Therefore, the immersion of user be increasing and help the information transfer to user with AR system. In this paper, we implement the AR system with the modeled VRML as a three-dimensional object using programming language. The application technique is proposed that augment the various virtual clothes to three-dimensional avatar. Moreover, we propose the novel interface by using marker that can be increase the immersion of user.