Browse > Article
http://dx.doi.org/10.7471/ikeee.2020.24.4.1180

Living Lab and Confusion Matrix for Performance Improvement and Evaluation of Artificial Intelligence System in Life Environment  

Ha, Ji-Won (Korea Conformity Laboratory)
Seo, Ji-Seok (Korea Conformity Laboratory)
Lee, Seongsoo (Soongsil University)
Publication Information
Journal of IKEEE / v.24, no.4, 2020 , pp. 1180-1183 More about this Journal
Abstract
Recently, the daily life safety detection functionalities such as fall accident detection and burn danger detection are widely disseminated along with the development of IoT and smart home. These safety detection functionalities are mostly performed by artificial intelligence. However, simple accuracy measurement of the safety detection in laboratory environment is often far from practical performance in daily life environment. To mitigate this problem, this paper introduces two techniques, i.e. living lab and confusion matrix. Living lab is more than simple simulation of daily life environment, and it enables users to directly participate technology development and product design. Various performance measures induced from confusion matrix significantly help to evaluate the performance of artificial intelligence system for proper application purposes.
Keywords
Living Lab; Confusion Matrix; Artificial Intelligence; Life Environment; Performance Evaluation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 N. Norbert, L. Sevrin, and B. Massot, "From Health Smart Homes to Living Labs for Health," Proceedings of IEEE International Conference on e-Health Networking, Applications, and Services, pp.164-169, 2015. DOI: 10.1109/HealthCom.2015.7454492   DOI
2 J. Colomer et al, "Experience in Evaluating AAL Solutions in Living Labs," Sensors, vol.14, no.4, pp.7277-7311, 2014. DOI: 10.3390/s140407277   DOI
3 J. Seong et al, "Current Status of Korean Living Labs and Its Development Plan," STEPI Annual Research Topics, 2017.
4 https://www.iscapeproject.eu/iscape-living-labs/
5 K. Ting, "Confusion Matrix," Encyclopedia of Machine Learning and Data Mining, Springer, 2017.
6 T. Octaviani, Z. Rustam, and T. Siswantining, "Ovarian Cancer Classification Uusing Bayesian Logistic Regression," IOP Conference Series: Materials Science and Engineering, vol.546, pp. 1-7, 2019. DOI: 10.1088/1757-899X/546/5/052049   DOI