ABAB Pedia

Matthias Niessner

Matthias Niessner (Matthias Nießner, born 1986) is a professor of computer science at the Technical University of Munich in Germany and head of its Visual Computing Lab, known for the real-time facial reenactment system Face2Face and 3D reconstruction research such as ScanNet; he is a co-founder of the AI video company Synthesia and in 2024 co-founded the 3D world-model company SpAItial.

Contents21 sections
Key facts

Birth

Matthias Nießner, often written Matthias Niessner in English, was born in 1986.⁠[1]

Studies at FAU

He studied computer science at the University of Erlangen-Nuremberg (FAU), receiving his Diploma in 2010, and in 2013 submitted his doctoral thesis, “Subdivision Surface Rendering using Hardware Tessellation,” which received the highest honors.⁠[1]

His doctoral supervisor was Günther Greiner; he graduated in 2013.⁠[2]

Stanford

From 2013 to 2017 he was a visiting assistant professor at Stanford UniversityStanford UniversityStanford University is a research university in California founded by Leland and Jane Stanford in 1885 and opened in 1891.Open the full entry, working with the Max Planck Center for Visual Computing and Communication.⁠[2]

Face2Face

With Justus Thies, Michael Zollhöfer, Marc Stamminger and Christian Theobalt he published Face2Face at CVPR 2016, reenacting faces in a target video in real time from a commodity webcam.⁠[3]

The paper was presented as an oral, with Nießner listed at Stanford University; outlets including Wired, The Verge and The Washington Post covered the work.⁠[4]

The Face2Face live demo won the SIGGRAPH 2016 Emerging Technologies Award.⁠[5]

ScanNet

With Angela Dai and others he published ScanNet at CVPR 2017, a dataset of richly annotated 3D reconstructions of indoor scenes for RGB-D scene understanding.⁠[7]

Joins TUM

In 2017 he became a professor at the Technical University of Munich, where he established the Visual Computing Group.⁠[8]

From that year he was a TUM-IAS Rudolph Moessbauer Fellow, and he received a Google Faculty Award for machine perception.⁠[6]

Co-Founds Synthesia

ERC Starting Grant

In 2018 he received a European Research Council Starting Grant (1.5 million euros) and an NVIDIANVIDIANVIDIA is an American semiconductor and computing technology company that provides graphics processing units, artificial intelligence infrastructure, networking interconnects, and computing software, and is listed on Nasdaq under the ticker NVDA.Open the full entry Professor Partnership Award. Papers he co-authored won best paper awards at SIGCHI 2014, HPG 2015 and SPG 2018.⁠[10]

Deep Video Portraits

On May 29, 2018, he and co-authors including Hyeongwoo Kim and Christian Theobalt released Deep Video Portraits, which photo-realistically re-animates portrait videos using only an input video.⁠[11]

Scan2CAD

In November 2018 he released the Scan2CAD paper with TUM’s Armen Avetisyan, Angela Dai and others, on aligning CAD models with RGB-D scans.⁠[12]

With Angela Dai he also proposed Scan2Mesh, which turns incomplete range scans into structured 3D meshes.⁠[13]

Young Researcher Award

In 2019 Eurographics gave him its Young Researcher Award, recognizing his spatial-hashing system for real-time 3D reconstruction and Face2Face, which “set new standards” in real-time face reenactment.⁠[8]

That year he published FaceForensics++ at ICCV 2019 with Andreas Rössler, Justus Thies and others, on detecting manipulated facial images.⁠[14]

Scan2CAD Project

His ERC project, “Scan2CAD: Learning to Digitize the Real World,” hosted by TUM, ran from January 1, 2019, to December 31, 2024, with EU funding of 1.5 million euros.⁠[15]

On Research and Startups

In 2022 he said his main passion remained academic research while he continued to support local startups at TUM, adding: “Research is the backbone of the economy of the future.”⁠[16]

Alumnus’s Startup Becomes a Unicorn

In July 2023 FAU’s Faculty of Engineering featured him, an alumnus who earned his degree and doctorate there, under the title “Unicorn status for Synthesia start up.”⁠[17]

Co-Founds SpAItial

In 2024 he co-founded the London-headquartered SpAItial with Luke Rogers, David Novotny and Ricardo Martin-Brualla to develop spatial foundation models.⁠[18]

Seed Round

In May 2025 SpAItial raised a $13 million seed round led by Earlybird Venture Capital, aiming to generate interactive, photorealistic 3D environments from text prompts.⁠[19]

Leave to Lead SpAItial

By April 2026 he was CEO of SpAItial and had taken leave from leading his TUM lab; he said 3D AI models are “kind of where ChatGPT for language was five years ago.”⁠[20]

May–June 2026: Echo

SpAItial’s world model Echo turns images and prompts into explorable 3D Gaussian Splat worlds; in May 2026 the company launched a developer API and Echo HQ, and in June a Startup Program.⁠[21]

As of October 2026: Current Status

As of October 2026 he was a TUM professor leading the Visual Computing & AI Lab, co-founder and CEO of SpAItial, and a co-founder of Synthesia.⁠[22]

He has published more than 150 papers, 25 of them in ACM Transactions on Graphics.⁠[5]

Related Organizations, Websites, and Public Accounts

Stanford University: Official website: https://www.stanford.edu/ (opens in a new window)⁠[4]

Technical University of Munich: Official website: https://www.tum.de/ (opens in a new window)⁠[22]

Sources

  1. Prof. Dr. Matthias Nießner (opens in a new window)
  2. Reconstructing and Understanding 3D Indoor Environments (opens in a new window)
  3. Face2Face: Real-Time Face Capture and Reenactment of RGB Videos (opens in a new window)
  4. Face2Face: Real-time Face Capture and Reenactment of RGB Videos (opens in a new window)
  5. 33 Years - Chair of Visual Computing (opens in a new window)
  6. TUM Visual Computing & Artificial Intelligence: Prof. Matthias Nießner (opens in a new window)
  7. ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes (opens in a new window)
  8. Young Researcher Award 2019 – Matthias Niessner (opens in a new window)
  9. Synthesia, the AI video generation platform, raises $12.5 million Series A (opens in a new window)
  10. Photo-realistic AI Avatars (opens in a new window)
  11. Deep Video Portraits (opens in a new window)
  12. Scan2CAD: Learning CAD Model Alignment in RGB-D Scans (opens in a new window)
  13. Scan2Mesh: From Unstructured Range Scans to 3D Meshes (opens in a new window)
  14. FaceForensics++: Learning to Detect Manipulated Facial Images (opens in a new window)
  15. Scan2CAD: Learning to Digitize the Real World | Scan2CAD | Project | Fact Sheet | H2020 | CORDIS | European Commission (opens in a new window)
  16. Computer Vision News - September 2022 (opens in a new window)
  17. Unicorn status for Synthesia start up (opens in a new window)
  18. spAitial Ai (opens in a new window)
  19. The 'Holy Grail' of AI: Creating Interactive 3D Worlds from Text Just Got $13M (opens in a new window)
  20. “We are where ChatGPT was five years ago,” says European 3D AI foundation model startup boss (opens in a new window)
  21. SpAItial — Frontier World Models for 3D Space (opens in a new window)
  22. Bits & Pretzels (opens in a new window)
  23. About Synthesia (opens in a new window)