GeneFace
GeneFace is an audio-driven 3D face synthesis tool that excels in lip synchronization and expressiveness, even with out-of-domain audio. Utilizing a RAD-NeRF-based renderer, it supports real-time inference and cuts training times to 10 hours. The project features GeneFace++, an enhanced variant with improved synchronization and video quality, and MimicTalk for talking style control. It incorporates a PyTorch-based deep3D reconstruction module and pitch-aware audio-to-motion conversion. Visit the project page for more details and video demonstrations.
