# Woven-Artificial-Profile-WARP-Face-Video-Synthesis-from-Profile-and-Audio

**Repository Path**: studioai/Woven-Artificial-Profile-WARP-Face-Video-Synthesis-from-Profile-and-Audio

## Basic Information

- **Project Name**: Woven-Artificial-Profile-WARP-Face-Video-Synthesis-from-Profile-and-Audio
- **Description**: https://github.com/NethraGunti/Woven-Artificial-Profile-WARP-Face-Video-Synthesis-from-Profile-and-Audio.git
- **Primary Language**: Python
- **License**: MIT
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-04-22
- **Last Updated**: 2022-04-22

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## Woven Artificial Profile (WARP): Face Video Synthesis from Profile and Audio

Given a face image and text, WARP is a highly versatile model that can generate realistic talking videos with audio and lip synchronization. It's aim is to personalise indirect communication and make it a touch more interesting. There are several commercial and non-commercial uses. Entertainment and Broadcasting industries can, in a way, be revolutionized. Education can be made more interesting by bringing those history and science lessons to life. Marketing can be made more direct. Avatars and Virtual Assistants. like Siri and Alexa can now have a face. It also provides the opportunity for remote officials and general public to communicate across the internet with a face. The pipeline has 4 modules:

* Fake Face Genreration using StyleGAN

* Speech generation using standard Text-to-Speech techniques

* Lip synchronized frame genration using LipGAN

* Video genertion using OpenCV

---

### Additional Links:

Pretrained LipGAN model: https://drive.google.com/drive/folders/1Re5ok6yGhhp-0KUDa8TQg4qyK1DPF_09?usp=sharing

Preprocessing LRS2: https://drive.google.com/drive/folders/1QXz4I-QKP5xAZhXX5BCRRiqFpeWbu0VU?usp=sharing

Training LipGAN: https://colab.research.google.com/drive/1KfhzyqZA6SNVGBcy1VXy2YK3aex2sss2?usp=sharing

Video Generation: https://colab.research.google.com/drive/1fDTbMc0i4JoO2DCjfN8H97dgdHFZ03My?usp=sharing

---

### Contributors

Nethra Gunti

Tarun Teja Obbinni

Nithin Ramancha