Home
Introduction to MediaPipe4U¶
MediaPipe4U is an Unreal Engine plugin that integrates multiple advanced technologies into Unreal Engine,
offering a one-stop solution for digital human development.
What You Need to Know
While you can obtain a free license file, MediaPipe4U is not free software.
-
I make no commitments to users who use the free license file. This includes providing free license files,
and this policy may change in the future.
The MediaPipe4U plugin includes a license file with an expiration date. Typically, this license file
expires 30 to 60 days after the release of a new version. -
In other words, you must update the license file periodically.
For more details about licensing, please refer to this section.
Features¶
-
Motion capture
- Full-body motion capture
- Finger tracking
- Displacement tracking
- 3D model driving
- Real-time motion driving
- Supports standard webcams
- ControlRig support
-
Facial capture
- Facial expression tracking
- ARKit Blendshape compatibility (52 blendshapes)
- Live Link compatibility
- Real-time facial motion driving
- Supports standard webcams
-
Multiple capture sources
- Standard webcams
- Video files
- Images
- Streaming (RTMP/SMTP)
- Android devices (phones, tablets) via M4U Remoting
-
Large language models (LLM)
- OLLama
-
Text-to-speech (TTS)
- Offline synthesis
- Real-time synthesis
- 3D model lip-syncing
- Multi-model support
- PaddleSpeech (ZH/EN)
- Kokoro (ZH/EN)
- Melo (ZH/EN)
- F5-TTS (ZH/EN/KO)
-
Automatic speech recognition (ASR)
- Offline recognition
- Real-time recognition
- Multi-model support
- FunASR (ZH/EN)
- Whisper (99 languages)
- FireReadASR (ZH/EN)
- SenseVoice (ZH、EN、JA、KO、YUE)
-
Animation export
- BVH data export
-
Pure plugin
- No external software required
- All functionalities integrated within Unreal Engine
Video Tutorials¶
YouTube (English)¶
