Seeing-and-Hearing
Discover a method for enhancing video and audio content creation by integrating existing models through a shared latent space. This approach supports joint and conditional tasks such as video-to-audio and audio-to-video generation, utilizing a multimodal latent aligner and the pre-trained ImageBind, serving the needs of professionals in the film industry.
