PuzzleAvatar: Assembly of Avatar from Unconstrained Photo Collections
Yuliang Xiu · Yufei Ye · Zhen Liu · Dimitris Tzionas · Michael J. Black
SIGGRAPH Asia 2024 (Journal Track)
PuzzleAvatar reconstructs a textured 3D clothed human from unconstrained photo collections
Works For | Without Requiring |
---|---|
✅ Any number of photos | ❌ Human body pose (3D HPS, 2D Keypoints, etc.) |
✅ In any poses | ❌ Camera pose |
✅ From any views | ❌ Geometric cues (depth, normal, etc.) |
✅ With any cropping or occlusion | ❌ Re-projection losses |
Video
Acknowledgments
We thank Peter Kulits and Yandong Wen for proofreading, Yifei Zeng for providing the results of AvatarBooth, Yamei Chen and Kexin Wang for teaser photos, Jiaxiang Tang, Yangyi Huang, Nikos Athanasiou, Yao Feng and Weiyang Liu for fruitful discussions, Jinlong Yang and Tsvetelina Alexiadis for data capture, and Priyanka Patel for body fitting. This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No.860768 (CLIPE project). Yufei Ye's PhD research is partially supported by a Google Gift.
Disclosure
MJB has received research gift funds from Adobe, Intel, Nvidia, Meta/Facebook, and Amazon. MJB has financial interests in Amazon and Meshcapade GmbH. While MJB is a co-founder and Chief Scientist at Meshcapade, his research in this project was performed solely at, and funded solely by, the Max Planck Society.
Citation
@article{xiu2024puzzleavatar, title={PuzzleAvatar: Assembling 3D Avatars from Personal Albums}, author={Xiu, Yuliang and Ye, Yufei and Liu, Zhen and Tzionas, Dimitrios and Black, Michael J}, journal={ACM Transactions on Graphics (TOG)}, year={2024}, publisher={ACM New York, NY, USA} }
Contact
For technical questions, please contact yuliang.xiu@tue.mpg.de
For commercial licensing, please contact ps-licensing@tue.mpg.de