Zhuoyuan (Daniel) Jiang

I am a machine learning researcher at the Vision and Learning Lab at the University of California, Merced, advised by Prof. Ming-Hsuan Yang, where I work on avatars, 3D/4D generation, and video generation.

I received my M.S. in Biostatistics (Data Science Pathway) from Yale University in 2026. Before that, I received my B.S. in Psychological & Brain Sciences and Financial Mathematics & Statistics from the University of California, Santa Barbara in 2023, where I was advised by Prof. Michael Ludkovski and Prof. Mary Hegarty.

My research interests include multimodal learning, 3D/4D generation, avatars, and vision-language models.

Email  /  Resume  /  GitHub  /  Hugging Face  /  LinkedIn

profile photo

I am looking for full-time Machine Learning Engineer, Research Engineer, and Research Scientist positions. If you think I might be a good fit, or would simply like to connect, please feel free to reach out at zhuoyuan.jiang625@gmail.com. Thanks!

Education
Yale University

Yale University
M.S. in Biostatistics (Data Science)
Sept. 2024 – May 2026

UC Santa Barbara

University of California, Santa Barbara
B.S. in Psychological & Brain Sciences
and Financial Mathematics & Statistics
Sept. 2019 – Jun. 2023

Work Experience
UC Merced

UC Merced Vision and Learning Lab
Machine Learning Research Intern
Jun. 2025 – Present

UC Santa Barbara

UCSB Center for Financial Mathematics
and Actuarial Research
Machine Learning Researcher
Sept. 2022 – May 2023

Preprints
AudioLift teaser
AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation
Zhuoyuan Jiang, Weijie Lyu, Xiaoyuan Wang, Tiancheng Shen, Ming-Hsuan Yang
Preprint, 2026
Project Page / Video

Generalizable single-image to 4D talking avatar without parametric face models or per-subject optimization.

ML Projects
Audio Fashion Retrieval System
Audio Fashion Retrieval System: Two-Tower Architecture for Composed Fashion Search
2026
Code / Model

An audio-native composed fashion retrieval system: show a garment, speak a modification, and get the matching item from the database.

Nutrition-Table-Detector
Nutrition-Table-Detector: End-to-End Multimodal Localization System
2025
Code / Model

Qwen2-VL-7B fine-tuned with 4-bit QLoRA to localize nutrition-facts tables on food packaging, then quantized to GPTQ INT4 and deployed on NVIDIA Triton with a vLLM backend.

Omni-Qwen
Omni-Qwen: Unified Audio-Vision-Language Omni Model
2025
Code / Model

An omni model that extends Qwen2-VL-7B with speech understanding: an audio-vision-language model.

SmolLM-GEC-135M
SmolLM-GEC-135M: Style-Preserving Grammatical Error Correction LLM
2025
Code / Model

A 135M-parameter grammar-correction model that fixes only the errors and keeps the writer's voice instead of rewriting the sentence.

Products
Lingo Chrome extension
Lingo: AI Chrome Extension for Real-time Slang & Cultural-Reference Learning
Startup project, Apr. 2025 – Present

A Chrome extension that helps non-native English speakers learn slang, phrasal verbs, and cultural references while watching YouTube, with real-time AI detection and explanations on the video.

 

Updated Oct. 2026. Template from Jon Barron