Publications
Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling
SHELLS reconstructs topologically consistent 3D heads from multi-view images in 0.08 s via layered surface sampling.
Representing 3D Faces with Learnable B-spline Volumes
CUBE: a 3D face representation that combines B-spline volumes with learned features, for scan registration and monocular reconstruction.
Multimodal Conditional 3D Face Geometry Generation
One diffusion model that generates 3D face geometry from sketches, photos, landmarks, FLAME parameters, or text.
Joint Learning of Depth and Appearance for Portrait Images
A diffusion portrait generator that jointly learns RGB and depth, enabling depth estimation and depth-driven editing.
Monocular Facial Appearance Capture in the Wild
Recovers studio-quality face geometry and reflectance maps from a single in-the-wild video of a head rotation.
ScaffoldAvatar: High-Fidelity Gaussian Avatars with Patch Expressions
ScaffoldAvatar couples local patch expressions with 3D Gaussian splatting for ultra-high-fidelity photoreal head avatars.
Neural Facial Deformation Transfer
NFDT transfers blendshapes and animations from a template character to a new character given only its neutral shape.
Spline-based Transformers
Transformers without positional encoding: sequences become smooth latent spline trajectories with editable control points.
Learning a Generalized Physical Face Model From Data
A generalized physical face model learned from data that fits any new identity into a ready-to-animate simulation rig.
Infinite 3D Landmarks: Improving Continuous 2D Facial Landmark Detection
Architectural changes that make continuous 2D facial landmark detectors more accurate and temporally stable.
Artist-Friendly Relightable and Animatable Neural Heads
Neural head avatars that can be both animated with unseen expressions and relit in any environment.
Anatomically Constrained Implicit Face Models
Implicit networks that jointly model skin and underlying anatomy, a drop-in replacement for blendshape rigs.
Fast Dynamic Facial Wrinkles
Animates skin micro-wrinkles that widen and deepen under stretch and compression, with a real-time shader approximation.
Stylize My Wrinkles: Bridging the Gap from Simulation to Reality
Style transfer from real skin scans onto simulated wrinkles, giving controllable yet organic micro-detail across whole faces.
An Implicit Physical Face Model Driven by Expression and Style
An implicit neural physics face model that can be driven independently by expression and by per-subject style.
A Perceptual Shape Loss for Monocular 3D Face Reconstruction
A perceptual loss for monocular 3D face reconstruction that scores shape by how well its shading matches the image.
ReNeRF: Relightable Neural Radiance Fields with Nearfield Lighting
ReNeRF: relightable radiance fields captured with a few area lights, supporting novel views and near-field lighting.
Graph-Based Synthesis for Skin Micro Wrinkles
Graph-based simulation that synthesizes realistic skin micro-wrinkle geometry, scaling to millions of wrinkles.
Continuous Landmark Detection With 3D Queries
The first facial landmark detector that predicts any number of continuous landmarks, queried by 3D position at inference.
Production-Ready Face Re-Aging for Visual Effects
FRAN: production-ready, temporally stable face re-aging for video, trained on synthetic longitudinal data.
Learning Dynamic 3D Geometry and Texture for Video Face Swapping
Video face swapping by jointly learning dynamic 3D geometry and texture with identity-specific decoders.
Facial Animation with Disentangled Identity and Motion using Transformers
A transformer autoencoder for 3D facial animation that disentangles identity from motion for synthesis and retargeting.
MoRF: Morphable Radiance Fields for Multiview Neural Head Modeling
MoRF turns NeRF into a generative head model, rendering multiview-consistent heads with controllable, morphable identity.
Facial Hair Tracking for High Fidelity Performance Capture
The first multi-view pipeline that tracks dense 3D facial hair and the skin beneath it throughout a performance.
Local Anatomically – Constrained Facial Performance Retargeting
Retargets captured facial performances to digital characters using local expression transfer plus anatomical constraints.
Improved Lighting Models for Facial Appearance Capture
Shows how more physically accurate lighting models (near-field lights, indirect bounces) improve facial appearance capture.
Shape Transformers: Topology-Independent 3D Shape Models Using Transformers
A transformer-based 3D shape model that is trained once and works on any mesh topology, for faces, hands, and bodies.
Rendering with Style: Combining Traditional and Neural Approaches for High-Quality Face Rendering
Completes high-quality skin-only renders with neural rendering to produce photoreal full-head portraits without artist work.
Adaptive Convolutions for Structure-Aware Style Transfer
AdaConv generalizes AdaIN to transfer both statistical and structural style, enabling real-time structure-aware style transfer.
Semantic Deep Face Models
A nonlinear neural 3D face model with disentangled, semantic control over identity and expression.
Attention-Driven Cropping for Very High Resolution Facial Landmark Detection
Attention-driven cropping lets landmark detectors run on very high-resolution face images without exhausting GPU memory.
Road tracking using particle filters for Advanced Driver Assistance Systems
Tracks road edges from a vehicle-mounted camera using particle filters, for advanced driver assistance systems.
Segmentation and grading of diabetic retinopathic exudates using error-boost feature selection method
Segments exudates in retinal fundus images and grades diabetic retinopathy severity using error-boost feature selection.
