Research Overview

Metaverse Quality Assessment

• Scene Naturalness Assessment
• 3D Discomfort Assessment
• Salient Region Detection

Multi-View 4D Capture System

• Dome-type Light Stage Capture Studio
• 3D Face & Body Capture
• Human Motion Capture
• Lighting Control system

Deep Learning based Metaverse Avatar Modeling

• 3D Facial Modeling
• 3D Body & Garment Modeling
• Cloth Parameter Estimation
• 3D Avatar (Character) Animation

Big Data based Metaverse Realization

• Multi-view based Human Database Construction
• 3D Facial Landmark / Human Pose Estimation
• Hand / Foot Tracking
• Facial Landmark / Human Motion Interpolation
• Lip Synthesis from Human Voice