Hao Li

Biography

Li was born in 1981 in Saarbrücken, Germany (then West Germany). His parents are both Taiwanese immigrants living in Germany. He went to a French-German high school in Saarbrücken and speaks four languages fluently (English, German, French, and Mandarin Chinese). He obtained his Diplom (eq. M.Sc.) in Computer Science at the Karlsruhe Institute of Technology (then University of Karlsruhe (TH)) in 2006 and his PhD in Computer Science at ETH Zurich in 2010. He was a visiting researcher at ENSIMAG in 2003, the National University of Singapore in 2006, Stanford University in 2008, and EPFL in 2010. He was also a postdoctoral fellow at Columbia University and Princeton University between 2011 and 2012.

Career

Li joined Industrial Light & Magic / Lucasfilm in 2012 as a research lead to develop the next generation real-time performance capture technologies for virtual production and visual effects. In 2013, he became a tenure-track assistant professor of Computer Science at the University of Southern California. In 2014, he spent a summer as a visiting professor at Weta Digital advancing the facial tracking and hair digitization technologies for the visual effects of Furious 7 and The Hobbit: The Battle of the Five Armies. In 2015, he founded Pinscreen, Inc., an Augmented Reality and social media startup based on his research in 3D human capture. In 2016, he was appointed director of the Vision and Graphics Lab at the USC Institute for Creative Technologies.

Research

He is best known for his work on dynamic geometry processing and data-driven techniques for making 3D human digitization and facial animation accessible to the masses. During his PhD, Li co-created the first real-time and markerless system for performance-driven facial animation based on depth sensors which won the best paper award at the ACM SIGGRAPH / Eurographics Symposium on Computer Animation in 2009. A similar technology was later used in the facial animation software Faceshift (acquired by Apple Inc. in 2015). His technique in deformable shape registration is used by the company C-Rad AB and widely deployed in hospitals for tracking tumors in real-time during radiation therapy. In 2013, he introduced a home scanning system that uses a Kinect to capture people into game characters or realistic miniature versions. This technology was licensed by Artec and released as a free software Shapify.me. In 2014, he was brought on as visiting professor at Weta Digital to build the high-fidelity facial performance capture pipeline for reenacting the deceased actor Paul Walker in the movie Furious 7 (2015).

His recent research focuses on combining techniques in Deep Learning and Computer Graphics to facilitate the creation of 3D avatars and to enable true immersive face-to-face communication and telepresence in Virtual Reality. In collaboration with Oculus / Facebook, he developed in 2015, the first facial performance sensing head-mounted display, which allows users to transfer their facial expressions onto their digital avatars while being immersed in a virtual environment. In the same year, he founded the company Pinscreen, Inc. in Santa Monica, which introduced a technology that can generate realistic 3D avatars of a person including the hair from a single photograph. Their innovation includes the development of a deep neural network that can infer photorealistic facial textures from a low resolution still.

Awards

Miscellaneous

For his technological contributions in visual effects, Li has been credited in major motion pictures, including Valerian and the City of a Thousand Planets (2017), Furious 7 (2015), The Hobbit: The Battle of the Five Armies (2014), and Noah (2014).