• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.49 no.3
• /
• pp.8-14
• /
• 2012

Improving the speed of image processing is in great demand according to spread of high quality visual media or massive image applications such as 3D TV or movies, AR(Augmented reality). SIMD computer attached to a host computer can accelerate various image processing and massive data operations. MAMS is a multi-access memory system which is, along with multiple processing elements(PEs), adequate for establishing a high performance pipelined SIMD machine. MAMS supports simultaneous access to pq data elements within a horizontal, a vertical, or a block subarray with a constant interval in an arbitrary position in an $M{\times}N$ array of data elements, where the number of memory modules(MMs), m, is a prime number greater than pq. MAMS-PP4 is the first realization of the MAMS architecture, which consists of four PEs in a single chip and five MMs. This paper presents implementation of image processing algorithms and performance analysis for MAMS-PP16 which consists of 16 PEs with 17 MMs in an extension or the prior work, MAMS-PP4. The newly designed MAMS-PP16 has a 64 bit instruction format and application specific instruction set. The author develops a simulator of the MAMS-PP16 system, which implemented algorithms can be executed on. Performance analysis has done with this simulator executing implemented algorithms of processing images. The result of performance analysis verifies consistent response of MAMS-PP16 through the pyramid operation in image processing algorithms comparing with a Pentium-based serial processor. Executing the pyramid operation in MAMS-PP16 results in consistent response of processing time while randomly response time in a serial processor.

• Journal of Korea Entertainment Industry Association
• /
• v.15 no.4
• /
• pp.383-390
• /
• 2021

Recently, the drone industry is rapidly expanding as it is suggested that it will be used in various fields. As the size of the drone market grows, interest in drone-related certificates is also increasing. However, the current drone-related qualification system and education system are insufficient. Thus this study, analyzed the necessity of drone training, the features of functional games, and the effectiveness of educational training using AR through related technical studies to solve the practical difficulties of drone educational training. Later, drone educational training game contents using AR were divided into practice mode and test mode based on the drone national qualification course practical test, and the result screen was displayed at the end of the curriculum so that players could learn by level and evaluate the results on their own. In addition, constructed a hybrid processing system and network and AR operation system for response rate and response speed, implemented drone training game contents utilizing AR based on the design contents. It is expected that the use of game content using AR presented in this paper for drone training will further alleviate environmental difficulties and improve the sense of immersion in play, which will lead to a more effective drone educational training experience.

• Archives of design research
• /
• v.19 no.5 s.67
• /
• pp.213-222
• /
• 2006

This paper presents MIDAS (Media Interaction Design Authoring System), an authoring toolkit for designers and artists to develop working prototypes in new interaction design projects. Field research were conducted to identify the requirements and a case study of designing new interactive products was carried out to examine the feasibility of the new tool. MIDAS provides easier ways of integrating hardware and software, to manage a wide range of electric input and output elements and to employ 3D Augmented Reality technology within conventional multimedia authoring tools, such as Director and Flash, which are popularly used by designers. MIDAS was used in case study projects of design education as well as by voluntary designers for evaluation. From the result of case studies, it was found that many design projects were successfully accomplished using MIDAS. Designers who participated in the projects reported that MIDAS not only helped them to concentrate more on ideation but also was very easy to use as they implemented the physical interface concepts without advanced engineering skills. It is expected that MIDAS can also support prototyping in interactive media an, tangible user interface development and related human computer interaction fields.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.3
• /
• pp.57-67
• /
• 2007

Researchers in mobile AR systems have so far put the value on the technical challenges involved in the limitations imposed from mobility. Beyond such immediate technical questions, however, are questions regarding the possible contents that are to be used for the user’s interaction in ubiquitous computing environment. Various aspects of context of user and environment can be utilized easily as well as effectively. Moreover, the environment will be equipped with lots of pervasive but invisible computing resources. However, it is difficult for users to have access to those computing resources. At the same time, as the smart appliances get to have more features, their user interfaces tend to become harder to use. Thus, in this paper, we propose Context-Aware Mobile Augmented Reality (CAMAR) system. In our system, users only need to take a picture of smart appliances with a built-in camera in a mobile device when they intend to control the appliances. It lets users interact with the smart appliances through personalized control interfaces on their mobile devices. Also, it supports enabling contents to be not only personalized but also shared selectively and interactively among user communities.

• Journal of Intelligence and Information Systems
• /
• v.18 no.1
• /
• pp.1-21
• /
• 2012

In recent years, mobile phone has experienced an extremely fast evolution. It is equipped with high-quality color displays, high resolution cameras, and real-time accelerated 3D graphics. In addition, some other features are includes GPS sensor and Digital Compass, etc. This evolution advent significantly helps the application developers to use the power of smart-phones, to create a rich environment that offers a wide range of services and exciting possibilities. To date mobile AR in outdoor research there are many popular location-based AR services, such Layar and Wikitude. These systems have big limitation the AR contents hardly overlaid on the real target. Another research is context-based AR services using image recognition and tracking. The AR contents are precisely overlaid on the real target. But the real-time performance is restricted by the retrieval time and hardly implement in large scale area. In our work, we exploit to combine advantages of location-based AR with context-based AR. The system can easily find out surrounding landmarks first and then do the recognition and tracking with them. The proposed system mainly consists of two major parts-landmark browsing module and annotation module. In landmark browsing module, user can view an augmented virtual information (information media), such as text, picture and video on their smart-phone viewfinder, when they pointing out their smart-phone to a certain building or landmark. For this, landmark recognition technique is applied in this work. SURF point-based features are used in the matching process due to their robustness. To ensure the image retrieval and matching processes is fast enough for real time tracking, we exploit the contextual device (GPS and digital compass) information. This is necessary to select the nearest and pointed orientation landmarks from the database. The queried image is only matched with this selected data. Therefore, the speed for matching will be significantly increased. Secondly is the annotation module. Instead of viewing only the augmented information media, user can create virtual annotation based on linked data. Having to know a full knowledge about the landmark, are not necessary required. They can simply look for the appropriate topic by searching it with a keyword in linked data. With this, it helps the system to find out target URI in order to generate correct AR contents. On the other hand, in order to recognize target landmarks, images of selected building or landmark are captured from different angle and distance. This procedure looks like a similar processing of building a connection between the real building and the virtual information existed in the Linked Open Data. In our experiments, search range in the database is reduced by clustering images into groups according to their coordinates. A Grid-base clustering method and user location information are used to restrict the retrieval range. Comparing the existed research using cluster and GPS information the retrieval time is around 70~80ms. Experiment results show our approach the retrieval time reduces to around 18~20ms in average. Therefore the totally processing time is reduced from 490~540ms to 438~480ms. The performance improvement will be more obvious when the database growing. It demonstrates the proposed system is efficient and robust in many cases.

• Journal of Internet Computing and Services
• /
• v.15 no.6
• /
• pp.27-34
• /
• 2014

Todays, the rapid technical progress of smart device has been used for various social (wall-fare) services in our lives. Especially, most of these services are based on the Local-based Services (LBS) and this technology is getting popular more and more compared with before. Basically, LBS is able to support various types of geographical services such as vehicles' navigation services, Augmented reality services as using extensional local information such as GPS. However, LBS has serious mathematical vulnerability on the services frequently because of its miscalculated GPS data under interior and ambiguous geographical environment such like shadowed area. So, to overcome this limitation, iBeacon, which would be able to mitigate LBS miscalculation process, has been proposed recently among network experts. Compared with other wireless technologies, iBeacon is able to determine the accurate geographical data of certain local positions easily because it is not only designed based on low-powered data transmitting technology, but also, it can be much easy to be deployed. As users' dependency of smart devices are getting higher and higher and the use of smart device is also getting complex more and more, the users prefer to use various types of smart devices at one time. Therefore, in this paper, we propose the loss prevention system that is able to interwork smart devices networks as using iBeacon technology for users' better conveniences.

• Journal of Intelligence and Information Systems
• /
• v.29 no.1
• /
• pp.353-376
• /
• 2023

The global pandemic and the development of virtual and augmented reality technologies have led a metaverse boom that enables a lot of interactions in virtual worlds, and is being utilized in various fields such as business, government, and education etc. Despite the growing interest in the metaverse, its scope and definition are still unclear and the concept is still evolving, making it challenging to establish its governance. Governmental entities are also investing intensively in public metaverses to make public value and promote social welfare, but they are underutilized due to lack of systematic governance. Therefore, in this study, we propose a public metaverse governance framework and identify the relative importance of the factors. Furthermore, since a public metaverse should be accessible to anyone who wants to use, we explore the factors of shadow work and examine the ways to minimize it. Based on the socio-technical system theory, we derived public metaverse governance factors from previous literature and topic modeling and then generate a framework with 23 factors through expert interviews. We then tested relative priority of the factors using the analytic hierarchical process (AHP) from the experts. As a result, the top five overall rankings are: 'roles and responsibilities', 'standardization/modularization', 'collaboration and communication', 'law and policies', and 'availability/accessibility'. The academic implications of this study are that it provides a comprehensive framework for public metaverse governance, and then the practical implications include suggesting prioritized considerations for metaverse operations in the public sector.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.3
• /
• pp.243-250
• /
• 2020

In this paper, we propose an effective software education scheme for universities. The key idea of this software education scheme is to analyze software curriculum of QS world university rankings Top 10, SW-oriented university, and regional main national university. And based on the results, we propose five improvements for the effective SW education method of universities. The first is to enhance the adaptability of the industry by developing courses based on the SW developer's job analysis in the curriculum development process. Second, it is necessary to strengthen the curriculum of the 4th industrial revolution core technologies(cloud computing, big data, virtual/augmented reality, Internet of things, etc.) and integrate them with various fields such as medical, bio, sensor, human, and cognitive science. Third, programming language education should be included in software convergence course after basic syntax education to implement projects in various fields. In addition, the curriculum for developing system programming developers and back-end developers should be strengthened rather than application program developers. Fourth, it offers opportunities to participate in industrial projects by reinforcing courses such as capstone design and comprehensive design, which enables product-based self-directed learning. Fifth, it is necessary to develop university-specific curriculum based on local industry by reinforcing internship or industry-academic program that can acquire skills in local industry field.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.30 no.2
• /
• pp.211-221
• /
• 2012

To utilize omni-directional images acquired by a rotating line camera for indoor spatial information services, we should register precisely the images with respect to an indoor coordinate system. In this study, we thus develop a georeferencing method to estimate the exterior orientation parameters of an omni-directional image - the position and attitude of the camera at the acquisition time. First, we derive the collinearity equations for the omni-directional image by geometrically modeling the rotating line camera. We then estimate the exterior orientation parameters using the collinearity equations with indoor control points. The experimental results from the application to real data indicate that the exterior orientation parameters is estimated with the precision of 1.4 mm and $0.05^{\circ}$ for the position and attitude, respectively. The residuals are within 3 and 10 pixels in horizontal and vertical directions, respectively. Particularly, the residuals in the vertical direction retain systematic errors mainly due to the lens distortion, which should be eliminated through a camera calibration process. Using omni-directional images georeferenced precisely with the proposed method, we can generate high resolution indoor 3D models and sophisticated augmented reality services based on the models.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.22 no.2
• /
• pp.63-70
• /
• 2022

Although 2D Object detection has been largely improved in the past years with the advance of deep learning methods and the use of large labeled image datasets, 3D object detection from 2D imagery is a challenging problem in a variety of applications such as robotics, due to the lack of data and diversity of appearances and shapes of objects within a category. Google has just announced the launch of Objectron that has a novel data pipeline using mobile augmented reality session data. However, it also is corresponding to 2D-driven 3D object detection technique. This study explores more mature 2D object detection method, and applies its 2D projection to Objectron 3D lifting system. Most object detection methods use bounding boxes to encode and represent the object shape and location. In this work, we explore a stochastic representation of object regions using Gaussian distributions. We also present a similarity measure for the Gaussian distributions based on the Hellinger Distance, which can be viewed as a stochastic Intersection-over-Union. Our experimental results show that the proposed Gaussian representations are closer to annotated segmentation masks in available datasets. Thus, less accuracy problem that is one of several limitations of Objectron can be relaxed.