Photorealistic digital re-aging of faces in video is becoming increasingly common in entertainment and advertising. But the predominant 2D painting workflow often requires frame-by-frame manual work that can take days to accomplish, even by skilled artists. Although research on facial image re-aging has attempted to automate and solve this problem, current techniques are of little practical use as they typically suffer from facial identity loss, poor resolution, and unstable results across subsequent video frames. In this paper, we present the first practical, fully-automatic and production-ready method for re-aging faces in video images. Our first key insight is in addressing the problem of collecting longitudinal training data for learning to re-age faces over extended periods of time, a task that is nearly impossible to accomplish for a large number of real people. We show how such a longitudinal dataset can be constructed by leveraging the current state-of-the-art in facial re-aging that, although failing on real images, does provide photoreal re-aging results on synthetic faces. Our second key insight is then to leverage such synthetic data and formulate facial re-aging as a practical image-to-image translation task that can be performed by training a well-understood U-Net architecture, without the need for more complex network designs. We demonstrate how the simple U-Net, surprisingly, allows us to advance the state of the art for re-aging real faces on video, with unprecedented temporal stability and preservation of facial identity across variable expressions, viewpoints, and lighting conditions. Finally, our new face re-aging network (FRAN) incorporates simple and intuitive mechanisms that provides artists with localized control and creative freedom to direct and fine-tune the re-aging effect, a feature that is largely important in real production pipelines and often overlooked in related research work.
Publication link:
1 view
304
80
7 months ago 00:01:16 1
Dinolords - Announcement Trailer
7 months ago 00:03:42 1
Angela Merkel - Ruf mich Angela (The Unofficial Oktoberfest Anthem) by Klemen Slakonja
7 months ago 00:09:05 1
Домашний Щербет!
7 months ago 00:08:44 1
Heel Haul ft. Newbella!
7 months ago 00:05:23 1
TARJA “Die Alive“ (Luna Park Ride, Live in Buenos Aires 2011)
7 months ago 00:04:53 1
Tarja “Stargazers“ Luna Park Ride (Live in Buenos Aires 2011)
7 months ago 00:03:38 1
My best pet l CEFR Level A0-A1 l Learn English @boosterasmus
7 months ago 00:03:01 1
My journey to school l CEFR Level A0-A1 l Learn English @boosterasmus
7 months ago 00:03:21 1
Sistar19 - Gone Not Around Any Longer (Areia Remix)
7 months ago 00:04:12 1
Walrus Audio Pedal Play: Eras Five State Distortion
7 months ago 00:03:42 1
Walrus Audio Pedal Play: Iron Horse High-Gain Distortion
7 months ago 00:55:19 1
ASMR I went to Medical EYE EXAM by Japanese Doctor (KEYBOARD, FEATHER, EYE CARE, GLASSES) ROLEPLAY
7 months ago 00:04:21 1
MAWAR BODAS - ALEXANDRA DOVGAN PIANO CONCERT ( parodi )
7 months ago 00:12:23 74
Assembly of Massive Scania Truck Engine and Start Test| Start to Finish @trucks_channel_razborgruz
7 months ago 00:01:12 1
Gladiator 2 (2024) | TEASER TRAILER | Paramount | Pedro Pascal, Denzel Washington (4K)
7 months ago 00:04:52 1
André Rieu - Figaro Cavatina
7 months ago 00:07:23 1
GI’S BIKINIS Show 4K 2023 / New York Swim Week
7 months ago 00:01:37 1
Demon Slayer: The Movie | First Look (Teaser Trailer) 2023 - Trailer #1 | Live Action - Shueisha’
7 months ago 00:03:10 1
Savaria - Official Video | Neeti Mohan | Shakti | Mukti | Salman | Vikram Montrose | Shekhar Astitwa
7 months ago 00:07:14 1
BETTER THAN TAKEOUT - Cantonese Beef Chow Mein
7 months ago 00:03:35 1
Italo Disco Hit 80s - Vol 4 #italodisco
7 months ago 01:49:23 1
Healing Your Nervous System And Body | Release Of Melatonin And Toxin • Eliminate Stress
7 months ago 00:05:01 1
DJ Crisps - I Believe [Reptile Mob]
7 months ago 00:01:38 2
Dissidia Final Fantasy NT - Rinoa Announce Trailer | PS4