• Title/Summary/Keyword: multi-screen

Search Result 342, Processing Time 0.032 seconds

Interactive Interface Design Through VR Hand Tracking (VR 핸드트레킹을 통한 상호작용 인터페이스 설계)

  • Ju-Sang Lee;Hyo-Seung Lee;Woo-Jun Choi
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.1
    • /
    • pp.213-218
    • /
    • 2023
  • In order to use the VR HMD, operation through separate controllers in both hands is required. Methods for text input in VR include a method of selecting virtual keyboard keys on the screen one by one using a controller, a method of inputting through a keyboard that is a resource of a computer by connecting a computer and VR, or a method of inputting through a keyboard that is a resource of a computer by purchasing a wireless keyboard in VR and wireless keyboard connection method. As such, the text input method in current VR equipment causes inconvenience and additional costs to users. For these reasons, most of the VR-related contents are limited to simple functions such as games or viewers, and there is a risk that VR equipment will be recognized as a simple game machine. Therefore, in this study, a multi-input interface using hand tracking provided by the Oculus Quest2 device is designed and partially implemented. Through this, it is expected that various tasks such as document work and business processing as well as games can be conveniently used using VR equipment.

Using Interaction for an Experiential Story 'The Three Little Pigs and Wolf' - for ipad - (인터랙션을 활용한 체험형 동화 '아기 돼지 삼형제와 늑대' - ipad를 중심으로 -)

  • Kim, Hyunhee
    • Design Convergence Study
    • /
    • v.14 no.3
    • /
    • pp.1-15
    • /
    • 2015
  • Storytelling which is part of human nature, has changed over millions of years. The development of technology and media has shaped Storytelling into various forms and shapes, and due to the recent spread of smart devices, the influence of interactive storytelling has grown significantly. The technology which allows diverse and natural input of users, have transformed the listener to user and has allowed the user to 'experience' the story rather than 'hear' it. In line with the trend in the development of these technologies, this study seeks to design and implement an interactive tale for children on an ipad platform. Focusing on the interaction aspect, this story is designed mainly for 3-7 years olds, which contains various multimedia elements and interaction elements that use built in technology such as multi-touch technology and microphone technology to allow user input that aline with the context of story. Focusing on children's experience and empathy with the characters of the story, 'Three Little Pigs and the Wolf' contains 22 steps and was published in the itunes Store.

Game Platform and System that Synchronize Actual Humanoid Robot with Virtual 3D Character Robot (가상의 3D와 실제 로봇이 동기화하는 시스템 및 플랫폼)

  • Park, Chang-Hyun;Lee, Chang-Jo
    • Journal of Korea Entertainment Industry Association
    • /
    • v.8 no.2
    • /
    • pp.283-297
    • /
    • 2014
  • The future of human life is expected to be innovative by increasing social, economic, political and personal, including all areas of life across the multi-disciplinary skills. Particularly, in the field of robotics and next-generation games with robots, by multidisciplinary contributions and interaction, convergence between technology is expected to accelerate more and more. The purpose of this study is that by new interface model beyond the technical limitations of the "human-robot interface technology," until now and time and spatial constraints and through fusion of various modalities which existing human-robot interface technologies can't have, the research of more reliable and easy free "human-robot interface technology". This is the research of robot game system which develop and utilizing real time synchronization engine linking between biped humanoid robot and the behavior of the position value of mobile device screen's 3D content (contents), robot (virtual robots), the wireless protocol for sending and receiving (Protocol) mutual information and development of a teaching program of "Direct Teaching & Play" by the study for effective teaching.

Development of Wholistic Hospice Nursing Intervention Program for In-patient of Hospice Palliative Care Unit (병동형 호스피스 대상자를 위한 전인적 호스피스 간호중재 프로그램의 개발)

  • Kang, Eun-Sil;Choi, Sung-Eun;Kang, Sung-Nyun
    • Korean Journal of Hospice Care
    • /
    • v.7 no.1
    • /
    • pp.29-45
    • /
    • 2007
  • People in the end of life and their families suffer in their physical disease and other aspects as a whole person. They need hospice care to palliate their total suffering in physical, emotional, social and also spiritual aspect through professional hospice team. To care their whole personal needs, hospice team must be a multi-discipline team which consists of medical doctors, nurses, social workers, pastors and volunteers. Recently those who die in hospice palliative care unit have trend to increase more than in home year by year. So it is necessary to develop the nursing intervention program to be performed by multi-discipline team approach for in-patient of hospice palliative care unit. The purposes of this study were to develop of wholistic hospice nursing intervention program for inpatient of hospice palliative care unit. The subjects of study were collected from 30 patients those who were over 18 years old and admitted in hospice palliative care unit of S hospital in P city with agreement in hospice palliative care in their terminal disease. The period of data collection was from December 15, 2003 to March 15, 2004. The result were as follows : 1. The result of Wholistic Hospice Nursing Program's development was as follow : A Wholistic Hospice Nursing Program was developed by me in this study is one of the service program for hospice palliative care unit. It was named as ‘Rainbow Program’ to be approached easily by hospice patients. The purposes of it are to improve the quality of life of the terminal patients with their dignity, to help them live in abundant and meaningful in their lives, to care them in peaceful in dying process with understanding them in whole personal, and also to palliate the grief and suffering of the bereaved. It was provided by hospice professionals(nurses, medical doctors, social worker, pastors, art therapists) and volunteers those who were educated in hospice for multi-diciplinary team approach to collaborate with each role play I 20-30 minuters of each through visiting their rooms individually and a place of hospice palliative care unit of S hospital in P city. The subjects of it were the terminal patients those who admitted hospice palliative care unit and their familes. with agreement in hospice palliative care in their terminal disease. The characteristics of it were multi-disciplinary team approach, whole personal care, individual care and total care according to their needs in their condition. The contents of it were pain control, symptom control, counseling patient, counseling family, hair cutting, hair shampooing, bed bath, recreation, taking a walk, event of culture(screen, recital, festival of praises, exhibition and so on), pastoral counseling, ritual service in bed, praying, service in bed, sing a worship praise, listening to the music, sharing remembrance of life, individual visiting music service(sing and praying), meditation Bible, art therapies(dance and drawing), social worker's counselling, confessing and sharing love and thanksgiving. The experimental group subjects participated in Wholistic Hospice Nursing Program which takes 120 minutes per session, total 10 sessions(total 1,200 minutes) altogether. In conclusion, this Wholistic Hospice Nursing Intervention can be used actively for whole personal well-being of the patients in hospice palliative in hospice palliative care unit and also applied in hospice practice as an useful model of multi-disciplinary team approach by hospice professionals.

  • PDF

A Multi-level Representation of the Korean Narrative Text Processing and Construction-Integration Theory: Morpho- syntactic and Discourse-Pragmatic Effects of Verb Modality on Topic Continuity (한국어 서사 텍스트 처리의 다중 표상과 구성 통합 이론: 주제어 연속성에 대한 양태 어미의 형태 통사적, 담화 화용적 기능)

  • Cho Sook-Whan;Kim Say-Young
    • Korean Journal of Cognitive Science
    • /
    • v.17 no.2
    • /
    • pp.103-118
    • /
    • 2006
  • The main purpose of this paper is to investigate the effects of discourse topic and morpho-syntactic verbal information on the resolution of null pronouns in the Korean narrative text within the framework of the construction-integration theory (Kintsch, 1988, Singer & Kintsch, 2001, Graesser, Gernsbacher, & Goldman. 2003). For the purpose of this paper, two conditions were designed: an explicit condition with both a consistently maintained discourse topic and the person-specific verb modals on one hand, and a neutral condition with no discourse topic or morpho-syntactic information provided, on the other. We measured the reading tines far the target sentence containing a null pronoun and the question response times for finding an antecedent, and the accuracy rates for finding an antecedent. During the experiments each passage was presented at a tine on a computer-controlled display. Each new sentence was presented on the screen at the moment the participant pressed the button on the computer keyboard. Main findings indicate that processing is facilitated by macro-structure (topicality) in conjunction with micro-structure (morpho-syntax) in pronoun interpretation. It is speculated that global processing alone may not be able to determine which potential antecedent is to be focused unless aided by lexical information. It is argued that the results largely support the resonance-based model, but not the minimalist hypothesis.

  • PDF

A Bio-Edutainment System to Virus-Vaccine Discovery based on Collaborative Molecular in Real-Time with VR

  • Park, Sung-Jun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.25 no.6
    • /
    • pp.109-117
    • /
    • 2020
  • An edutainment system aims to help learners to recognize problems effectively, grasp and classify important information needed to solve the problems and convey the contents of what they have learned. Edutainment contents can be usefully applied to education and training in the both scientific and industrial areas. Our present work proposes an edutainment system that can be applied to a drug discovery process including virtual screening by using intuitive multi-modal interfaces. In this system, a stereoscopic monitor is used to make three-dimensional (3D) macro-molecular images, with supporting multi-modal interfaces to manipulate 3D models of molecular structures effectively. In this paper, our system can easily solve a docking simulation function, which is one of important virtual drug screening methods, by applying gaming factors. The level-up concept is implemented to realize a bio-game approach, in which the gaming factor depends on number of objects and users. The quality of the proposed system is evaluated with performance comparison in terms of a finishing time of a drug docking process to screen new inhibitors against target proteins of human immunodeficiency virus (HIV) in an e-drug discovery process.

Technology Development for Non-Contact Interface of Multi-Region Classifier based on Context-Aware (상황 인식 기반 다중 영역 분류기 비접촉 인터페이스기술 개발)

  • Jin, Songguo;Rhee, Phill-Kyu
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.6
    • /
    • pp.175-182
    • /
    • 2020
  • The non-contact eye tracking is a nonintrusive human-computer interface providing hands-free communications for people with severe disabilities. Recently. it is expected to do an important role in non-contact systems due to the recent coronavirus COVID-19, etc. This paper proposes a novel approach for an eye mouse using an eye tracking method based on a context-aware based AdaBoost multi-region classifier and ASSL algorithm. The conventional AdaBoost algorithm, however, cannot provide sufficiently reliable performance in face tracking for eye cursor pointing estimation, because it cannot take advantage of the spatial context relations among facial features. Therefore, we propose the eye-region context based AdaBoost multiple classifier for the efficient non-contact gaze tracking and mouse implementation. The proposed method detects, tracks, and aggregates various eye features to evaluate the gaze and adjusts active and semi-supervised learning based on the on-screen cursor. The proposed system has been successfully employed in eye location, and it can also be used to detect and track eye features. This system controls the computer cursor along the user's gaze and it was postprocessing by applying Gaussian modeling to prevent shaking during the real-time tracking using Kalman filter. In this system, target objects were randomly generated and the eye tracking performance was analyzed according to the Fits law in real time. It is expected that the utilization of non-contact interfaces.

Energy Demand/Supply Prediction and Simulator UI Design for Energy Efficiency in the Industrial Complex (산업단지 에너지 효율화를 위한 에너지 수요/공급 예측 및 시뮬레이터 UI 설계)

  • Hyungah Lee;Jong-hyeok Park;Woojin Cho;Dongju Kim;Jae-hoi Gu
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.4
    • /
    • pp.693-700
    • /
    • 2024
  • As of the end of March 2022, the total area of domestic industrial complexes is 606 km2, which is only about 0.6% of the total land area. However, as of 2018, the annual energy consumption of domestic industrial complexes is 110,866.1 thousand TOE, accounting for 53.5% of the country's total energy consumption and 83.1% of the entire industrial sector energy consumption. In addition, industrial complexes have a significant impact on the environment, accounting for 45.1% of the country's total greenhouse gas emissions and 76.8% of industrial sector greenhouse gas emissions. Under this background, in this study, in order to contribute to the energy efficiency of industrial complexes, a prediction study on energy demand and supply for an industrial complex in Korea using machine learning was conducted. In addition, a simulator UI screen was designed to more efficiently convey information on energy demand/supply prediction results and energy consumption status. Among the machine learning algorithms, Multi-Layer Perceptron (MLP) was used, and Bayesian Optimization was applied as an optimization technique for the prediction model. The energy prediction model for the industrial complex built in this study showed a prediction accuracy of 87.90% for compressed air demand and 99.54% for the flow rate available for the public air compressor.

Wearable Computers

  • Cho, Gil-Soo;Barfield, Woodrow;Baird, Kevin
    • Fiber Technology and Industry
    • /
    • v.2 no.4
    • /
    • pp.490-508
    • /
    • 1998
  • One of the latest fields of research in the area of output devices is tactual display devices [13,31]. These tactual or haptic devices allow the user to receive haptic feedback output from a variety of sources. This allows the user to actually feel virtual objects and manipulate them by touch. This is an emerging technology and will be instrumental in enhancing the realism of wearable augmented environments for certain applications. Tactual displays have previously been used for scientific visualization in virtual environments by chemists and engineers to improve perception and understanding of force fields and of world models populated with the impenetrable. In addition to tactual displays, the use of wearable audio displays that allow sound to be spatialized are being developed. With wearable computers, designers will soon be able to pair spatialized sound to virtual representations of objects when appropriate to make the wearable computer experience even more realistic to the user. Furthermore, as the number and complexity of wearable computing applications continues to grow, there will be increasing needs for systems that are faster, lighter, and have higher resolution displays. Better networking technology will also need to be developed to allow all users of wearable computers to have high bandwidth connections for real time information gathering and collaboration. In addition to the technology advances that make users need to wear computers in everyday life, there is also the desire to have users want to wear their computers. In order to do this, wearable computing needs to be unobtrusive and socially acceptable. By making wearables smaller and lighter, or actually embedding them in clothing, users can conceal them easily and wear them comfortably. The military is currently working on the development of the Personal Information Carrier (PIC) or digital dog tag. The PIC is a small electronic storage device containing medical information about the wearer. While old military dog tags contained only 5 lines of information, the digital tags may contain volumes of multi-media information including medical history, X-rays, and cardiograms. Using hand held devices in the field, medics would be able to call this information up in real time for better treatment. A fully functional transmittable device is still years off, but this technology once developed in the military, could be adapted tp civilian users and provide ant information, medical or otherwise, in a portable, not obstructive, and fashionable way. Another future device that could increase safety and well being of its users is the nose on-a-chip developed by the Oak Ridge National Lab in Tennessee. This tiny digital silicon chip about the size of a dime, is capable of 'smelling' natural gas leaks in stoves, heaters, and other appliances. It can also detect dangerous levels of carbon monoxide. This device can also be configured to notify the fire department when a leak is detected. This nose chip should be commercially available within 2 years, and is inexpensive, requires low power, and is very sensitive. Along with gas detection capabilities, this device may someday also be configured to detect smoke and other harmful gases. By embedding this chip into workers uniforms, name tags, etc., this could be a lifesaving computational accessory. In addition to the future safety technology soon to be available as accessories are devices that are for entertainment and security. The LCI computer group is developing a Smartpen, that electronically verifies a user's signature. With the increase in credit card use and the rise in forgeries, is the need for commercial industries to constantly verify signatures. This Smartpen writes like a normal pen but uses sensors to detect the motion of the pen as the user signs their name to authenticate the signature. This computational accessory should be available in 1999, and would bring increased peace of mind to consumers and vendors alike. In the entertainment domain, Panasonic is creating the first portable hand-held DVD player. This device weight less than 3 pounds and has a screen about 6' across. The color LCD has the same 16:9 aspect ratio of a cinema screen and supports a high resolution of 280,000 pixels and stereo sound. The player can play standard DVD movies and has a hour battery life for mobile use. To summarize, in this paper we presented concepts related to the design and use of wearable computers with extensions to smart spaces. For some time, researchers in telerobotics have used computer graphics to enhance remote scenes. Recent advances in augmented reality displays make it possible to enhance the user's local environment with 'information'. As shown in this paper, there are many application areas for this technology such as medicine, manufacturing, training, and recreation. Wearable computers allow a much closer association of information with the user. By embedding sensors in the wearable to allow it to see what the user sees, hear what the user hears, sense the user's physical state, and analyze what the user is typing, an intelligent agent may be able to analyze what the user is doing and try to predict the resources he will need next or in the near future. Using this information, the agent may download files, reserve communications bandwidth, post reminders, or automatically send updates to colleagues to help facilitate the user's daily interactions. This intelligent wearable computer would be able to act as a personal assistant, who is always around, knows the user's personal preferences and tastes, and tries to streamline interactions with the rest of the world.

  • PDF

Development of Greenhouse Cooling and Heating Load Calculation Program Based on Mobile (모바일 기반 온실 냉난방 부하 산정 프로그램 개발)

  • Moon, Jong Pil;Bang, Ji Woong;Hwang, Jeongsu;Jang, Jae Kyung;Yun, Sung Wook
    • Journal of Bio-Environment Control
    • /
    • v.30 no.4
    • /
    • pp.419-428
    • /
    • 2021
  • In order to develope a mobile-based greenhouse energy calculation program, firstly, the overall thermal transmittance of 10 types of major covers and 16 types of insulation materials were measured. In addition, to estimate the overall thermal transmittance when the cover and insulation materials were installed in double or triple layers, 24 combinations of double installations and 59 combinations of triple installations were measured using the hotbox. Also, the overall thermal transmittance value for a single material and the thermal resistance value were used to calculate the overall thermal transmittance value at the time of multi-layer installation of covering and insulating materials, and the linear regression equation was derived to correct the error with the measured values. As a result of developing the model for estimating thermal transmittance when installing multiple layers of coverings and insulating materials based on the value of overall thermal transmittance of a single-material, the model evaluation index was 0.90 (good when it is 0.5 or more), indicating that the estimated value was very close to the actual value. In addition, as a result of the on-site test, it was evaluated that the estimated heat saving rate was smaller than the actual value with a relative error of 2%. Based on these results, a mobile-based greenhouse energy calculation program was developed that was implemented as an HTML5 standard web-based mobile web application and was designed to work with various mobile device and PC browsers with N-Screen support. It had functions to provides the overall thermal transmittance(heating load coefficient) for each combination of greenhouse coverings and thermal insulation materials and to evaluate the energy consumption during a specific period of the target greenhouse. It was estimated that an energy-saving greenhouse design would be possible with the optimal selection of coverings and insulation materials according to the region and shape of the greenhouse.