• Proceedings of the KSPS conference
• /
• 2007.05a
• /
• pp.41-44
• /
• 2007

In this paper, we introduce a system in which car navigation scenario is plugged multimodal interface based on multimodal middleware. In map-based system, the combination of speech and pen input/output modalities can offer users better expressive power. To be able to achieve multimodal task in car environments, we have chosen SCXML(State Chart XML), a multimodal authoring language of W3C standard, to control modality components as XHTML, VoiceXML and GPS. In Network Manager, GPS signals from navigation software are converted to EMMA meta language, sent to MultiModal Interaction Runtime Framework(MMI). Not only does MMI handles GPS signals and a user's multimodal I/Os but also it combines them with information of device, user preference and reasoned RDF to give the user intelligent or personalized services. The self-simulation test has shown that middleware accomplish a navigational multimodal task over multiple users in car environments.

• Advances in Computational Design
• /
• v.3 no.4
• /
• pp.339-366
• /
• 2018

Parametric design systems serve as powerful assistive tools in the design process by providing a flexible approach for the generation of a vast number of design alternatives. However, contemporary parametric design systems focus primarily on low-level engineering and structural forms, without an explicit means to also take into account high-level, cognitively motivated people-centred design goals. We present a precedent-based parametric design method that integrates people-centred design "precedents" rooted in empirical evidence directly within state of the art parametric design systems. As a use-case, we illustrate the general method in the context of an empirical study focusing on the multi-modal analysis of wayfinding behaviour in two large-scale healthcare environments. With this use-case, we demonstrate the manner in which: (1). a range of empirically established design precedents -e.g., pertaining to visibility and navigation- may be articulated as design constraints to be embedded directly within state of the art parametric design tools (e.g., Grasshopper); and (2). embedded design precedents lead to the (parametric) generation of a number of morphologies that satisfy people-centred design criteria (in this case, pertaining to wayfinding). Our research presents an exemplar for the integration of cognitively motivated design goals with parametric design-space exploration methods. We posit that this opens-up a range of technological challenges for the engineering and development of next-generation computer aided architecture design systems.

• Wind and Structures
• /
• v.26 no.5
• /
• pp.267-277
• /
• 2018

Numerical simulations are performed of a long flexible cylinder undergoing vortex-induced vibration at a Reynolds number of 500. The cylinder is pinned at both ends, having an aspect ratio of 100 (cylinder length to cylinder diameter) and a mass ratio of 4.2 (structural mass to displaced fluid mass). Temporal and spatial information on the cross-flow (CF) and in-line (IL) vibrations is extracted. High modal vibrations up to the $6^{th}$ in the CF direction and the $11^{th}$ in the IL direction are observed. Both the CF and IL vibrations feature a multi-mode mixed pattern. Mode competition is observed. The $2^{nd}$ mode with a low frequency dominates the IL vibration and its existence is attributed to a wave group propagating back and forth along the span. Distributions of fluid force coefficients are correlated to those of the CF and IL vibrations along the span. Histograms of the x'-y motion phase difference are evaluated from the total simulation time and a complete vibration cycle representing the standing or travelling wave pattern. Correlations between the phase difference and the vibrations are discussed. Vortex structures behind the cylinder show an interwoven near-wake pattern when the standing wave pattern dominates, but an oblique near-wake pattern when the travelling wave pattern prevails.

• Journal of the Society of Naval Architects of Korea
• /
• v.51 no.4
• /
• pp.274-282
• /
• 2014

Time series of the dynamic response of a slender marine structure was predicted using quadratic Volterra series. The wave-structure interaction system was identified using the NARX(Nonlinear Autoregressive with Exogenous Input) technique, and the network parameters were determined through the supervised training with the prepared datasets. The dataset used for the network training was obtained by carrying out the nonlinear finite element analysis on the freely standing riser under random ocean waves of white noise. The nonlinearities involved in the analysis were both large deformation of the structure under consideration and the quadratic term of relative velocity between the water particle and structure in Morison formula. The linear and quadratic frequency response functions of the given system were extracted using the multi-tone harmonic probing method and the time series of response of the structure was predicted using the quadratic Volterra series. In order to check the applicability of the method, the response of structure under the realistic ocean wave environment with given significant wave height and modal period was predicted and compared with the nonlinear time domain simulation results. It turned out that the predicted time series of the response of structure with quadratic Volterra series successfully captures the slowly varying response with reasonably good accuracy. It is expected that the method can be used in predicting the response of the slender offshore structure exposed to the Morison type load without relying on the computationally expensive time domain analysis, especially for the screening purpose.

• Design Convergence Study
• /
• v.16 no.5
• /
• pp.177-190
• /
• 2017

This research aims to suggest a multimodal non-touch gesture interface design to improve the usability of 3D sculpting task. The task and procedure of design sculpting of users were analyzed across multiple circumstances from the physical sculpting to computer software. The optimal body posture, design process, work environment, gesture-task relationship, the combination of natural hand gesture and arm movement of designers were defined. The preliminary non-touch 3D S/W were also observed and natural gesture interaction, visual metaphor of UI and affordance for behavior guide were also designed. The prototype of gesture based 3D sculpting system were developed for validation of intuitiveness and learnability in comparison to the current S/W. The suggested gestures were proved with higher performance as a result in terms of understandability, memorability and error rate. Result of the research showed that the gesture interface design for productivity system should reflect the natural experience of users in previous work domain and provide appropriate visual - behavioral metaphor.

• Journal of Internet Computing and Services
• /
• v.25 no.1
• /
• pp.9-15
• /
• 2024

As virtual reality technology became popular, a high demand emerged for natural and efficient interaction with the virtual environment. Mid-air manipulation is one of the solutions to such needs, letting a user manipulate a virtual object in a 3D virtual space. In this paper, we focus on manipulating a remote virtual object while visually displaying the object and providing tactile information on the object's weight. We developed two types of wearable interfaces that can provide cutaneous or vibrotactile feedback on the virtual object weight to the user's fingertips. Human perception of the remote virtual object weight during manipulation was evaluated by conducting a psychophysics experiment. The results indicate a significant effect of haptic feedback on the perceived weight of the virtual object during manipulation.

• Journal of the Korea Computer Graphics Society
• /
• v.15 no.3
• /
• pp.1-9
• /
• 2009

Traditional computer simulation uses only traditional input and output devices. With the recent emergence of haptic techniques, which can give users kinetic and tactile feedback, the field of computer simulation is diversifying. In particular, as the virtual-reality-based surgical simulation has been recognized as an effective training tool in medical education, the practical virtual simulation of surgery becomes a stimulating new research area. The surgical simulation framework should represent the realistic properties of human organ for the high immersion of a user interaction with a virtual object. The framework should make proper both haptic and visual feedback for high immersed virtual environment. However, one model may not be suitable to simulate both haptic and visual feedback because the perceptive channels of two feedbacks are different from each other and the system requirements are also different. Therefore, we separated two models to simulate haptic and visual feedback independently but at the same time. We propose an adaptive mass-spring method as a multi-modal simulation technique to synchronize those two separated models and present a framework for a dual model of simulation that can realistically simulate the behavior of the soft, pliable human body, along with haptic feedback from the user's interaction.

• The Journal of the Korea Contents Association
• /
• v.17 no.4
• /
• pp.200-208
• /
• 2017

Despite a rapid market growth in VR, cyber sickness has become the most serious problem in terms of user experience. The aim of this study is to verify whether there are differences in user's perception of cyber sickness by the point-of-view and the movement in VR contents. An experimental testing of game playing with VR headset was conducted on the effects of two conditions: first-person and third-person views in the point-of-view condition, and yaw - pitch rotations in the head movement condition. The results showed that cyber sickness worsened in the first-person point-of-view and in the yaw rotation movement. Point-of-view and movement had main effects on the cyber sickness, but an interaction effect between point-of-view and movement was not found. Based on the findings, along with reducing VR sickness, we proposed practical implications for VR contents planning for building balanced VR user experience. Positive VR experience can be reinforced through visual design, multi-modal interface design, and experience marketing for the optimal level of contents immersion. A future research was suggested on the roll rotation for diverse content genre development.

• Science of Emotion and Sensibility
• /
• v.23 no.1
• /
• pp.29-40
• /
• 2020

Visually impaired people use tactile maps to get spatial information about their surrounding environment, find their way, and improve their independent mobility. However, classical tactile maps that make use of braille to describe the location within the map have several limitations, such as the lack of information due to constraints on space and limited feedback possibilities. This study describes the development of a new multi-modal interactive tactile map interface that addresses the challenges of tactile maps to improve the usability and independence of visually impaired people when using tactile maps. This interface adds touch gesture recognition to the surface of tactile maps and enables the users to verbally interact with a voice agent to receive feedback and information about navigation routes and points of interest. A low-cost prototype was developed to conduct usability tests that evaluated the interface through a survey and interview given to blind participants after using the prototype. The test results show that this interactive tactile map prototype provides improved usability for people over traditional tactile maps that use braille only. Participants reported that it was easier to find the starting point and points of interest they wished to navigate to with the prototype. Also, it improved self-reported independence and confidence compared with traditional tactile maps. Future work includes further development of the mobility solution based on the feedback received and an extensive quantitative study.