AudioLift: Audio-Driven Single Image to
Full-Head Gaussian Avatar via Multi-view Video Generation

Ours on HDTF

More Results

Ours on HDTF

23 HDTF clips at their natural length (11–43 s). The input is the first frame of each clip and the audio is the clip's own speech; nothing else from the video is used. Rows: input portrait, frontal rendering, and the same avatar sequence from a moving camera: a full turn around the head, or a sweep across the viewing range the training cameras cover. Videos autoplay muted; Audio unmutes one subject at a time.

HDTF 01
39.7 s
HDTF 02
18.0 s
HDTF 03
39.6 s
HDTF 04
24.9 s
HDTF 05
39.7 s
HDTF 06
36.9 s
Input portrait
input portraitHDTF 01 · input
input portraitHDTF 02 · input
input portraitHDTF 03 · input
input portraitHDTF 04 · input
input portraitHDTF 05 · input
input portraitHDTF 06 · input
Frontal
talking
Frontal
Frontal
Frontal
Frontal
Frontal
Frontal
Novel views
talking while the camera moves
Novel views
Novel views
Novel views
Novel views
Novel views
Novel views
HDTF 07
26.2 s
HDTF 08
42.6 s
HDTF 09
40.1 s
HDTF 10
25.7 s
HDTF 11
39.3 s
HDTF 12
38.7 s
Input portrait
input portraitHDTF 07 · input
input portraitHDTF 08 · input
input portraitHDTF 09 · input
input portraitHDTF 10 · input
input portraitHDTF 11 · input
input portraitHDTF 12 · input
Frontal
talking
Frontal
Frontal
Frontal
Frontal
Frontal
Frontal
Novel views
talking while the camera moves
Novel views
Novel views
Novel views
Novel views
Novel views
Novel views
HDTF 13
40.1 s
HDTF 14
39.4 s
HDTF 15
23.4 s
HDTF 16
39.3 s
HDTF 17
15.0 s
HDTF 18
39.6 s
Input portrait
input portraitHDTF 13 · input
input portraitHDTF 14 · input
input portraitHDTF 15 · input
input portraitHDTF 16 · input
input portraitHDTF 17 · input
input portraitHDTF 18 · input
Frontal
talking
Frontal
Frontal
Frontal
Frontal
Frontal
Frontal
Novel views
talking while the camera moves
Novel views
Novel views
Novel views
Novel views
Novel views
Novel views
HDTF 19
10.9 s
HDTF 20
27.3 s
HDTF 21
34.9 s
HDTF 22
22.8 s
HDTF 23
40.3 s
Input portrait
input portraitHDTF 19 · input
input portraitHDTF 20 · input
input portraitHDTF 21 · input
input portraitHDTF 22 · input
input portraitHDTF 23 · input
Frontal
talking
Frontal
Frontal
Frontal
Frontal
Frontal
Novel views
talking while the camera moves
Novel views
Novel views
Novel views
Novel views
Novel views