International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Research on Efficient Skeleton Retargeting Method Suitable for MetaHuman

  • Shijie Sun (Department of Visual Contents,Dongseo University) ;
  • Ki-Hong Kim (Department of Visual Contents,Dongseo University) ;
  • David-Junesok Lee (Department of Visual Contents, Dongseo University)
  • Received : 2023.12.11
  • Accepted : 2024.01.16
  • Published : 2024.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

With the rapid development of 3D animation, MetaHuman is widely used in film production, game development and VR production as a virtual human creation platform.In the animation production of virtual humans, motion capture is usually used.Since different motion capture solutions use different skeletons for motion recording, when the skeleton level of recorded animation data is different from that of MetaHuman, the animation data recorded by motion capture cannot be directly used on MetaHuman. This requires Reorient the skeletons of both.This study explores an efficient skeleton reorientation method that can maintain the accuracy of animation data by reducing the number of bone chains.In the experiment, three skeleton structures, Rokoko, Mixamo and Xsens were used for efficient redirection experiments, to compare and analyze the adaptability of different skeleton structures to the MetaHuman skeleton, and to explore which skeleton structure has the highest compatibility with the MetaHuman skeleton.This research provides an efficient skeleton reorientation idea for the production team of 3D animated video content, which can significantly reduce time costs and improve work efficiency.

Keywords

References

  1. Bin Hammam Ghassan, M. Wensing Patrick, Dariush Behzad, E.Orin David, "Kinodynamically Consistent Motion Retargeting for Humanoids". The international journal of Humanold Robotics.Vol. 12. No. 4,pp. 1550017:1-1550017:27, Sep 2015. DOI:https://doi.org/10.1142/S0219843615500176
  2. Hecker Chris, Bernd Raabe, Ryan W. Enslow, John DeWeese, Jordan Maynard, Kees van Prooijen, "Real-time motion retargeting to highly varied user-created morphologies", The Journal of ACM Transactions on Graphics (TOG),Vol. 27,No.3,pp. 1-11,Aug 2008. DOI:https://doi.org/10.1145/1360612.1360626
  3. Sejin Oh, Taeheun Kang, Hojin Lee, Wooksang Chang, "Analysis of Real-time Cyber Character Production Technology for Metaverse", The Journal of Arts and Imaging Science(TECHART), Vol. 9, No. 2, pp. 20-25, Jun 2022. DOI:https://doi.org/10.15323/techart.2022.6.9.2.20
  4. Pan, Yang, "Research on the application of digital human production based on photoscan realistic head 3D scanning and unreal engine metahuman technology in the metaverse",The International Journal of Advanced Smart Convergence, Vol. 11, No. 3, pp. 102-118, Sep 2022. DOI:https://dx.doi.org/10.7236/IJASC.2022.11.3.102
  5. Kfir Aberman, Perzhuo Li, Dani Lischinski, Olga Sorkine-Hornung, Daniel Cohen-Or, Baoquan Chen. "Skeleton-aware networks for deep motion retargeting",The journal of ACM Transactions on Graphics (TOG),Vol. 39,No. 4,pp. 62:1-62:14,Aug 2020. DOI:https://doi.org/10.1145/3386569.3392462
  6. Abdul-Massih, Michel, Innfarn Yoo, Bedrich Benes,"Motion style retargeting to characters with different morphologies", The journal of Computer Graphics Forum, Vol. 36,No.6, pp. 86-99,Mar 2017. DOI:https://doi.org/10.1111/cgf.12860
  7. Monzani Jean-Sebastien, Baerlocher Paolo, Boulic Ronan, Thaimann Daniel, "Using an intermediate skeleton and inverse kinematics for motion retargeting". The journal of Computer Graphics Forum.Vol. 19. No. 3. Oxford, UK and Boston, USA: Blackwell Publishers Ltd,pp 11-19,Sep 2000. DOI:https://doi.org/10.1111/1467-8659.00393
  8. Imran Ghani, Emily Hattman, David T. Smith, Muhammad Hasnain, Israr Ghani, Seung Ryul Jeong, "3D Motion Capture based Physical Fitness using Full Body Tracking Suit",The Journal of Internet Computing and Services,Vol. 24, No. 4,pp. 47-56, Aug. 2023. DOI :https://doi.org/10.7472/jksii.2023.24.4.47
  9. Blackman Sue,"Rigging with mixamo",Unity for Absolute Beginners ,pp. 565-573,Jun. 2014. DOI:https://doi.org/10.1007/978-1-4302-6778-2_12
  10. Roetenberg Daniel, Henk Luinge, Per Slycke."Xsens MVN: Full 6DOF human motion tracking using miniature inertial sensors", Xsens Motion Technologies BV, Tech. Rep,pp. 1-7,Jan.2009.