Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Voice-based Device Control Using oneM2M IoT Platforms

  • Jeong, Isu (Dept. of Internet of Things, Soonchunhyang University) ;
  • Yun, Jaeseok (Dept. of Internet of Things, Soonchunhyang University)
  • Received : 2019.01.25
  • Accepted : 2019.02.19
  • Published : 2019.03.29
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we present a prototype system for controlling IoT home appliances via voice-based commands. A voice command has been widely deployed as one of unobtrusive user interfaces for applications in a variety of IoT domains. However, interoperability between diverse IoT systems is limited by several dominant companies providing voice assistants like Amazon Alexa or Google Now due to their proprietary systems. A global IoT standard, oneM2M has been proposed to mitigate the lack of interoperability between IoT systems. In this paper, we deployed oneM2M-based platforms for a voice record device like a wrist band and LED control device like a home appliance. We developed all the components for recording voices and controlling IoT devices, and demonstrate the feasibility of our proposed method based on oneM2M platforms and Google STT (Speech-to-Text) API for controlling home appliances by showing a user scenario for turning the LED device on and off via voice commands.

Keywords

CPTSCQ_2019_v24n3_151_f0001.png 이미지

Fig. 1. Overall System Design using oneM2M Platforms

CPTSCQ_2019_v24n3_151_f0002.png 이미지

Fig. 2. Prototype System Architecture

CPTSCQ_2019_v24n3_151_f0003.png 이미지

Fig. 3. Voice Command to Text Conversion Procedure

CPTSCQ_2019_v24n3_151_f0004.png 이미지

Fig. 4. Implementation of Voice Recording Device (a) All Components (b) Packed in a Container (6*4*3.5 cm)

CPTSCQ_2019_v24n3_151_f0005.png 이미지

Fig. 5. Containers and Uploaded Data in Resource Monitor

CPTSCQ_2019_v24n3_151_f0006.png 이미지

Fig. 6. LED Control Device Architecture

CPTSCQ_2019_v24n3_151_f0007.png 이미지

Fig. 7. Implementation of LED Control Device (a) All Components (b) Packed in a Container

CPTSCQ_2019_v24n3_151_f0008.png 이미지

Fig. 8. Data Format Uploaded to Mobius server

CPTSCQ_2019_v24n3_151_f0009.png 이미지

Fig. 9. Demonstration of Voice-based LED Device Control (a) voice recording using Voice Recording Device (b) LED control by received command

Table 1. Voice Recording Device Components

CPTSCQ_2019_v24n3_151_t0001.png 이미지

References

  1. L. Atzori, A. Iera, and G. Morabito, "The Internet of Things: A survey," Computer Networks, vol. 54, no. 15, pp. 2787-2805, October 2010. https://doi.org/10.1016/j.comnet.2010.05.010
  2. J. Swetina, G. Lu, P. Jacobs, F. Ennesser, and J. Song, "Toward a standardized common M2M service layer platform: Introduction to one M2M," IEEE Wireless Communications, vol. 21, no. 3, pp. 20-26, June 2014. https://doi.org/10.1109/MWC.2014.6845045
  3. M. Ryu, J. Kim, and J. Yun. "Integrated semantics service platform for the Internet of Things: A case study of a smart office," Sensors Vol. 15, No. 1, pp. 2137-2160, 2015. https://doi.org/10.3390/s150102137
  4. M. Ryu, J. Yun, T. Miao, I.-Y. Ahn, S.-C. Choi, and J. Kim, "Design and Implementation of a Connected Farm for Smart Farming System," in Proceedings of the IEEE Sensors, pp. 1724-1728, November 1-4 2015.
  5. S. M. M. Fattah, N.-M. Sung, I.-Y. Ahn, M. Ryu, and J. Yun, "Building IoT Services for Aging in Place Using Standard-Based IoT Platforms and Heterogeneous IoT Products," Sensors, vol. 17, no. 10, pp. 2311, October 2017. https://doi.org/10.3390/s17102311
  6. D. Wang and H. Yu, "Development of the Control System of a Voice-Operated Wheelchair with Multi-posture Characteristics," Proceedings of the 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS '17), pp. 151-155, Wuhan, China, June 16-18 2017.
  7. M. F. Ruzaij, S. Neubert, N. Stoll, and K. Thurow, "Design and Implementation of Low-Cost Intelligent Wheelchair Controller for Quadriplegias and Paralysis Patient," Proceedings of the IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI '17), pp. 399-404, Herl'any, Slovakia, January 26-28 2017.
  8. M. Pleva, J. Juhar, A. Cizmar, C. Hudson, D. W. Carruth, and C. L. Bethel, "Implementing English Speech Interface to Jaguar Robot for SWAT Training," Proceedings of the IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI '17), pp. 105-110, Herl'any, Slovakia, January 26-28 2017.
  9. I.-J. Ding and J.-Y. Shi, "Kinect microphone array-based speech and speaker recognition for the exhibition control of humanoid robots," Computers & Electrical Engineering, vol. 62, no. , pp. 719-729, August 2017. https://doi.org/10.1016/j.compeleceng.2015.12.010
  10. J. C. Vaz and P. Oh, "Transformer-DARwIn: A Miniature Humanoid for Potential Robot Companion," Proceedings of the IEEE International Conference on Consumer Electronics (ICCE '18), pp. 1-5, Las Vegas, NV, USA, January 12-14 2018.
  11. K. Zinchenko, C.-Y. Wu, and K.-T. Song, "A Study on Speech Recognition Control for a Surgical Robot," IEEE Transactions on Industrial Informatics, vol. 13, no. 2, pp. 607-615, April 2017. https://doi.org/10.1109/TII.2016.2625818
  12. H. Basanta, Y.-P. Huang, and T.-T. Lee, "Using Voice and Gesture to Control Living Space for the Elderly People," Proceedings of the International Conference on System Science and Engineering (ICSSE '17), pp. 20-23, Ho Chi Minh City, Vietnam, September 11 2017..
  13. R. K. Nath, R. Bajpai, and H. Thapliyal, "IoT Based Indoor Location Detection System for Smart Home Environment," Proceedings of the ieee, pp. 1-3, Las Vegas, NV, USA, January 12-14 2018.
  14. D. Sunitha, V. C. Patil, M. Hn, and S. Jebakani, "Digital notice board using Smart Phones- Speech Recognition Voice command," Proceedings of the International Conference on Current Trends towards Converging Technologies, pp. 1-4, Coimbatore, India, March 1-3 2018.
  15. R. Raj and N. Rai, "Voice Controlled Cyber-Physical System for Smart Home," Proceedings of the Workshop Program of the 19th International Conference on Distributed Computing and Networking (ICDCN '18), pp. Article No. 28 , Varanasi, India, January 4-7 2018.
  16. Sang-Min Lee and Ho-Joon Lee, "How to Express Emotion: Role of Prosody and Voice Quality Parameters," Journal of The Korea Society of Computer and Information, vol. 19, no. 11, pp. 159-166, November 2014. https://doi.org/10.9708/JKSCI.2014.19.11.159
  17. Byeongsoo Kang and Ky Vannroath and Hyun-syug Kang, "A Mobile Stress Management System utilizing Variable Voice Information According to the Wearing Area," Journal of The Korea Society of Computer and Information, vol. 22, no. 6, pp. 95-100, June 2017 https://doi.org/10.9708/jksci.2017.22.06.095
  18. OCEAN, http://developers.iotocean.org/