• 제목/요약/키워드: Face Tracking

Search Result 342, Processing Time 0.024 seconds

Performance Comparison for Exercise Motion classification using Deep Learing-based OpenPose (OpenPose기반 딥러닝을 이용한 운동동작분류 성능 비교)

  • Nam Rye Son;Min A Jung
    • Smart Media Journal
    • /
    • v.12 no.7
    • /
    • pp.59-67
    • /
    • 2023
  • Recently, research on behavior analysis tracking human posture and movement has been actively conducted. In particular, OpenPose, an open-source software developed by CMU in 2017, is a representative method for estimating human appearance and behavior. OpenPose can detect and estimate various body parts of a person, such as height, face, and hands in real-time, making it applicable to various fields such as smart healthcare, exercise training, security systems, and medical fields. In this paper, we propose a method for classifying four exercise movements - Squat, Walk, Wave, and Fall-down - which are most commonly performed by users in the gym, using OpenPose-based deep learning models, DNN and CNN. The training data is collected by capturing the user's movements through recorded videos and real-time camera captures. The collected dataset undergoes preprocessing using OpenPose. The preprocessed dataset is then used to train the proposed DNN and CNN models for exercise movement classification. The performance errors of the proposed models are evaluated using MSE, RMSE, and MAE. The performance evaluation results showed that the proposed DNN model outperformed the proposed CNN model.

The Prevalence of Retirement Planning Among Women in Malaysia - A Conceptual Article

  • DAUKIN, Mellisa;MOHD ISA, Mohd Yaziz;MOHAMED, Zulkifflee
    • Journal of Wellbeing Management and Applied Psychology
    • /
    • v.5 no.4
    • /
    • pp.1-9
    • /
    • 2022
  • Purpose: Many people recognize the fact that women are basically poor at financial and retirement planning. A small number of scholars have explored the factors and situations that influence the level of awareness of pre-retirement women and men with regards to planning for their retirement years. In most developing countries, including Malaysia, there are more men in the younger segment of the population and more women in the older segment, since women tend to live longer than men due to having jobs of relatively lower risk, their behaviors, and activities. Research design, data and methodology: Given that it is hard to predict whether they will be healthy in old age, women may require additional resources to obtain the care and assistance that they need. The transition from career life into retirement is a long process for people to go through. Some may be able to prepare for the next stage of life, and some may not be able to prepare due to personal reasons. Planning for future retirement is important because it will affect the quality of a woman's life after a certain age. Results: Without proper planning, women may face financial instability, depression, and poor psychological well-being. However, many women are unaware of their financial status or do not know their family's financial status, such as tracking the main income, budget, and expenses, financial commitments and have no proper record of assets owned, loans owed, or updated loan balances. Conclusions: The findings of this research have led to the conclusion that pre-retiree women are likely to regard their retirement savings as sufficient without realizing that they should have at least several types of savings instead of just one, and the grave consequences of not having any savings at all for their retirement years.

A Study on the Use of Haar Cascade Filtering to check Wearing Masks and Fever Abnormality (Haar Cascade 필터링을 통한 마스크 착용 여부와 발열 체크)

  • Kim, Eui-Jeong;Kim, In-Jung
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.474-477
    • /
    • 2021
  • Recently, in order to prevent the proliferation of COVID-19, which began in earnest in 2020, an increasing number of places have been measuring the temperature and required to wear a mask. However, as wearing a mask and checking the temperature are typically measured directly by a person or by a single individual positioned in front of the machine, standards may vary based on the person's manual measurement method, wasting workforce. While standing in front of a device often measures the maximum temperature of the face, the standard of fever is also unclear. Both approaches can create bottleneck situations when checking large numbers of people. Furthermore, it is unable to conduct periodic measurements and tracking because the measuring machines are generally put only at the entrance. Thus, this study suggests a method for preventing the spread of infectious diseases by automatically identifying and displaying unmasked people and those with fever in real-time using a general camera, a thermal imaging camera, and an artificial intelligence algorithm.

  • PDF

The Effects of Emotional Interaction with Virtual Student on the User's Eye-fixation and Virtual Presence in the Teaching Simulation (가상현실 수업시뮬레이션에서 가상학생과의 정서적 상호작용이 사용자의 시선응시 및 가상실재감에 미치는 영향)

  • Ryu, Jeeheon;Kim, Kukhyeon
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.2
    • /
    • pp.581-593
    • /
    • 2020
  • The purpose of this study was to examine the eye-fixation times on different parts of a student avatar and the virtual presence with two scenarios in the virtual reality-based teaching simulation. This study was to identify user attention while he or she is interacting with a student avatar. By examining where a user is gazing during a conversation with the avatar, we have a better understanding of non-verbal communication. For this study, forty-five college students (21 females and 24 males) participated in the experiment. They had a conversation with a student avatar in a virtual reality-based teaching simulation. The participants had verbal interactions with the student avatar with two scenarios. While they were having a conversation with the virtual character in the teaching simulation, their eye-movements were collected through a head-mounted display with an eye-tracking function embedded. The results revealed that there were significant differences in eye-fixation times. Participants gazed a longer time on facial expression than any other area. The fixation time on the facial expression was more prolonged than on gestures (F=3.75, p<.05). However, the virtual presence was not significantly different in two scenario levels. This result suggested that users focus on the face more than the gesture when they emotionally interact with the virtual character.

A Prototype Architecture of an Interactive Service System for Digital Hologram Videos (디지털 홀로그램 비디오를 위한 인터랙티브 서비스 시스템의 프로토타입 설계)

  • Seo, Young-Ho;Lee, Yoon-Hyuk;Yoo, Ji-Sang;Kim, Man-Bae;Choi, Hyun-Jun;Kim, Dong-Wook
    • Journal of Broadcast Engineering
    • /
    • v.17 no.4
    • /
    • pp.695-706
    • /
    • 2012
  • The purpose of this paper is to propose a service system for a digital hologram video, which has not been published yet. This system assumes the existing service frame for 2-dimensional or 3-dimensional image/video, which includes data acquisition, processing, transmission, reception, and reconstruction. This system also includes the function to service the digital hologram at the viewer's view point by tracking the viewer's face. For this function, the image information at the virtual view point corresponding to the viewer's view point is generated to get the corresponding hologram. Here in this paper, only a prototype that includes major functions of it is implemented, which includes camera system for data acquisition, camera calibration and image rectification, depth/intensity image enhancement, intermediate view generation, digital hologram generation, and holographic image reconstruction by both simulation and optical apparatus. The proposed prototype system was implemented and the result showed that it takes about 352ms to generate one frame of digital hologram and reconstruct the image by simulation, or 183ms to reconstruct image by optical apparatus instead of simulation.

A study on the new Business Opportunity of E-Commerce (e-비즈니스의 기회창출 방안에 대한 연구)

  • Cho, Jae-Wan;Ko, Chang-Bae
    • Information Systems Review
    • /
    • v.4 no.2
    • /
    • pp.191-208
    • /
    • 2002
  • In the area of new millennium of twenty first century, one of the urgent and critical research issues in commerce area is the regenerating of new business opportunities from the high value added perspectives. With this motivation, in this paper, we create new on-line e-businesses with the speed of lightning their affiliated supply, finance and business communities - which are involved in more and more tightly connected, open trading - we find that we need to deal with hundreds of business collaborative partners, millions of buyers and sellers while we have to face incompatible IT systems. Challenges of new business opportunities linking multi-enterprise data and processes cost effectively, reliably and securely in real time remains an open area in e-business. This challenge we shall describe as the problem of synchronization of multiple enterprise collaborative e-business opportunities (production related), value (finance related), business (operations related) in new business opportunity and infrastructure integrated all together over the off-line and online basis. It brings a new e-commerce opportunities infrastructure into this profitable challenge: by extracting and tracking new business information, new trends in the events of e-business processes. The transformation of the traditional commerce into this type of electronic based commerce can be interpreted as new Cultural Revolution. The revolution will be a new paradigm crossing over the geographical, and organizational zone, restructuring enterprise business process infrastructure.

Improvement of Nottingham Grading System for Facial Asymmetry Evaluation (안면비대칭 평가를 위한 Nottingham Grading System의 문제점 개선)

  • Lee, Min-Woo;Jang, Min;Kim, Jina;Shin, Sang-Hoon
    • Journal of rehabilitation welfare engineering & assistive technology
    • /
    • v.11 no.2
    • /
    • pp.179-186
    • /
    • 2017
  • Because facial asymmetry is caused by various causes, the cause analysis is important and quantitative index is needed to the evaluation. In this study, we applied the Nottingham Grading System that was used as a quantitative index to evaluate the facial paralysis by tracking the markers through the image processing and calculating the distance between the markers with images obtained by using the webcam, to evaluate facial asymmetry. The existing Nottingham Grading System has a problem of causing a measurement error in the specific case because the left and right are compared by summing the distance change between the feature points of the face part according to the change of the facial expression. We compared the case of the facial asymmetry and case of normal subject by using the existing Nottingham Grading System and the improved Nottingham grading system. In the existing Nottingham Grading System, case of facial asymmetry and case of facial symmetry were 99.0% and 95.0% respectively in the normal range, but the improved Nottingham Grading System showed facial asymmetry case was 74.0% and facial symmetrical case was 93.2%. The results of experiment show that the improved Nottingham Grading System allows detailed evaluation of each site and improved the problem of the Nottingham Grading System for specific cases.

Intermediate View Image and its Digital Hologram Generation for an Virtual Arbitrary View-Point Hologram Service (임의의 가상시점 홀로그램 서비스를 위한 중간시점 영상 및 디지털 홀로그램 생성)

  • Seo, Young-Ho;Lee, Yoon-Hyuk;Koo, Ja-Myung;Kim, Dong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.1
    • /
    • pp.15-31
    • /
    • 2013
  • This paper proposes an intermediate image generation method for the viewer's view point by tracking the viewer's face, which is converted to a digital hologram. Its purpose is to increase the viewing angle of a digital hologram, which is gathering higher and higher interest these days. The method assumes that the image information for the leftmost and the rightmost view points within the viewing angle to be controlled are given. It uses a stereo-matching method between the leftmost and the rightmost depth images to obtain the pseudo-disparity increment per depth value. With this increment, the positional informations from both the leftmost view point and the rightmost view point are generated, which are blended to get the information at the wanted intermediate viewpoint. The occurrable dis-occlusion region in this case is defined and a inpainting method is proposed. The results from implementing and experimenting this method showed that the average image qualities of the generated depth and RGB image were 33.83[dB] and 29.5[dB], respectively, and the average execution time was 250[ms] per frame. Also, we propose a prototype system to service digital hologram interactively to the viewer by using the proposed intermediate view generation method. It includes the operations of data acquisition for the leftmost and the rightmost viewpoints, camera calibration and image rectification, intermediate view image generation, computer-generated hologram (CGH) generation, and reconstruction of the hologram image. This system is implemented in the LabView(R) environments, in which CGH generation and hologram image reconstruction are implemented with GPGPUs, while others are implemented in software. The implemented system showed the execution speed to process about 5 frames per second.

Analysis of Space Use Patterns of Public Library Users through AI Cameras (AI 카메라를 활용한 공공도서관 이용자의 공간이용행태 분석 연구)

  • Gyuhwan Kim;Do-Heon Jeong
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.57 no.4
    • /
    • pp.333-351
    • /
    • 2023
  • This study investigates user behavior in library spaces through the lens of AI camera analytics. By leveraging the face recognition and tracking capabilities of AI cameras, we accurately identified the gender and age of visitors and meticulously collected video data to track their movements. Our findings revealed that female users slightly outnumbered male users and the dominant age group was individuals in their 30s. User visits peaked between Tuesday to Friday, with the highest footfall recorded between 14:00 and 15:00 pm, while visits decreased over the weekend. Most visitors utilized one or two specific spaces, frequently consulting the information desk for inquiries, checking out/returning items, or using the rest area for relaxation. The library stacks were used approximately twice as much as they were avoided. The most frequented subject areas were Philosophy(100), Religion(200), Social Sciences(300), Science(400), Technology(500), and Literature(800), with Literature(800) and Religion(200) displaying the most intersections with other areas. By categorizing users into five clusters based on space utilization patterns, we discerned varying objectives and subject interests, providing insights for future library service enhancements. Moreover, the study underscores the need to address the associated costs and privacy concerns when considering the broader application of AI camera analytics in library settings.

Issue tracking and voting rate prediction for 19th Korean president election candidates (댓글 분석을 통한 19대 한국 대선 후보 이슈 파악 및 득표율 예측)

  • Seo, Dae-Ho;Kim, Ji-Ho;Kim, Chang-Ki
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.3
    • /
    • pp.199-219
    • /
    • 2018
  • With the everyday use of the Internet and the spread of various smart devices, users have been able to communicate in real time and the existing communication style has changed. Due to the change of the information subject by the Internet, data became more massive and caused the very large information called big data. These Big Data are seen as a new opportunity to understand social issues. In particular, text mining explores patterns using unstructured text data to find meaningful information. Since text data exists in various places such as newspaper, book, and web, the amount of data is very diverse and large, so it is suitable for understanding social reality. In recent years, there has been an increasing number of attempts to analyze texts from web such as SNS and blogs where the public can communicate freely. It is recognized as a useful method to grasp public opinion immediately so it can be used for political, social and cultural issue research. Text mining has received much attention in order to investigate the public's reputation for candidates, and to predict the voting rate instead of the polling. This is because many people question the credibility of the survey. Also, People tend to refuse or reveal their real intention when they are asked to respond to the poll. This study collected comments from the largest Internet portal site in Korea and conducted research on the 19th Korean presidential election in 2017. We collected 226,447 comments from April 29, 2017 to May 7, 2017, which includes the prohibition period of public opinion polls just prior to the presidential election day. We analyzed frequencies, associative emotional words, topic emotions, and candidate voting rates. By frequency analysis, we identified the words that are the most important issues per day. Particularly, according to the result of the presidential debate, it was seen that the candidate who became an issue was located at the top of the frequency analysis. By the analysis of associative emotional words, we were able to identify issues most relevant to each candidate. The topic emotion analysis was used to identify each candidate's topic and to express the emotions of the public on the topics. Finally, we estimated the voting rate by combining the volume of comments and sentiment score. By doing above, we explored the issues for each candidate and predicted the voting rate. The analysis showed that news comments is an effective tool for tracking the issue of presidential candidates and for predicting the voting rate. Particularly, this study showed issues per day and quantitative index for sentiment. Also it predicted voting rate for each candidate and precisely matched the ranking of the top five candidates. Each candidate will be able to objectively grasp public opinion and reflect it to the election strategy. Candidates can use positive issues more actively on election strategies, and try to correct negative issues. Particularly, candidates should be aware that they can get severe damage to their reputation if they face a moral problem. Voters can objectively look at issues and public opinion about each candidate and make more informed decisions when voting. If they refer to the results of this study before voting, they will be able to see the opinions of the public from the Big Data, and vote for a candidate with a more objective perspective. If the candidates have a campaign with reference to Big Data Analysis, the public will be more active on the web, recognizing that their wants are being reflected. The way of expressing their political views can be done in various web places. This can contribute to the act of political participation by the people.