ABAB Pedia

Jürgen Schmidhuber

Jürgen Schmidhuber is a German computer scientist who published Long Short-Term Memory (LSTM) networks with Sepp Hochreiter in 1997, has long been scientific director of the Swiss AI Lab IDSIA and has led the KAUST AI Initiative since 2021; he has worked extensively on meta-learning, artificial curiosity and Gödel machines, and has publicly criticised several Turing Award laureates over credit and priority in the history of deep learning. He appeared on the Lex FridmanLex FridmanLex Fridman is a Soviet-born, US-raised computer scientist and podcast host who works as an MIT research scientist on human-AI interaction and autonomous driving. His Lex Fridman Podcast is known for hours-long conversations with guests including heads of state and technology leaders.Open the full entry Podcast in 2018.

Contents23 sections
Key facts

Diploma Thesis at TU Munich

He has said that since about the age of 15 his main goal has been to build a self-improving artificial intelligence smarter than himself, and then retire.⁠[1]

In 1987 he completed his diploma thesis at the Institut für Informatik of TU Munich on self-referential learning and “learning how to learn,” and published his first paper on genetic programming the same year.⁠[2]

He regards the thesis as presenting the first concrete recursive self-improvement (RSI) algorithms and the start of decades of his work on meta-learning.⁠[3]

The Annus Mirabilis in Munich

He has said that in 1990–1991 his lab at TU Munich published many basic ideas of modern deep learning, including the adversarial generative principle for artificial curiosity, the unnormalised linear Transformer, pre-training of deep networks, neural network distillation and recurrent world models, though few people were interested at the time.⁠[4]

From 1990 he built “curious” agents combining a predictive model with a reinforcement learner rewarded by the predictor’s learning progress, the basis of his formal theory of creativity, fun and intrinsic motivation.⁠[5]

Colorado Postdoc and Munich

He was a postdoc at the University of Colorado at Boulder from July 1991 to December 1992, Oberassistent at TU Munich from October 1993 and Privatdozent from January 1995.⁠[6]

Scientific Director of IDSIA

From March 1995 he has been scientific director of the Swiss AI Lab IDSIA in Lugano; he was professor of AI at the University of Lugano (USI) from 2009 to 2021.⁠[6]

LSTM Paper and Family

In 1997 he and his PhD student Sepp Hochreiter published Long Short-Term Memory in Neural Computation, which he calls the most cited neural network of the 20th century. He recalls that he married and became a father that year.⁠[7]

His wife is Ulrike Krommer, and they have two daughters; his younger brother, Christof Schmidhuber, is a theoretical physicist turned finance expert.⁠[1]

The Gödel Machine

In 2003 he released a preprint on the Gödel machine, a self-referential universal problem solver that rewrites any part of itself once it proves the rewrite will improve its future performance, formalising I. J. Good’s idea of an “intelligence explosion.”⁠[8]

LSTM and Deep Networks Win Contests

In 2009–2010 his team’s CTC-trained LSTM beat all competing algorithms on important problems such as connected handwriting recognition, which he describes as triggering the supervised deep learning revolution.⁠[9]

DanNet Wins Vision Contests

In 2011 DanNet, named after his postdoc Dan Cireșan, became the first pure deep convolutional neural network to win computer vision contests, winning four in a row in 2011–2012 on NVIDIANVIDIANVIDIA is an American semiconductor and computing technology company that provides graphics processing units, artificial intelligence infrastructure, networking interconnects, and computing software, and is listed on Nasdaq under the ticker NVDA.Open the full entry GPUs and achieving the first superhuman performance in a vision challenge.⁠[10]

NNAISENSE Is Founded

Founded by AI pioneers, NNAISENSE has worked since 2014 with ACATIS Investment and other financial institutions on AI-based stock selection and portfolio construction, launching its first AI fund in 2017.⁠[11]

Highway Networks

In May 2015 his team published Highway Networks, the first working very deep gradient-based feedforward networks with hundreds of layers; he notes that ResNet, published seven months later, is equivalent to a Highway Net with all gates open.⁠[9]

IEEE Neural Networks Pioneer Award

He received the IEEE CIS Neural Networks Pioneer Award at the IJCNN 2016 award banquet in Vancouver for “pioneering contributions to deep learning and neural networks”; in his acceptance speech he called the Ukrainian mathematician A. G. Ivakhnenko the father of deep learning.⁠[12]

On Machine Consciousness

He argued that some existing AI systems are already conscious, saying: “I would like to claim we had little, rudimentary, conscious learning systems for at least 25 years.”⁠[13]

On His Lab’s Impact on Big Tech

In a 2017 article he wrote that deep learning methods his team developed since 1991 had reached billions of users through the world’s most valuable public companies, including Apple, Alphabet, MicrosoftMicrosoftMicrosoft is a technology company founded by Bill Gates and Paul Allen in 1975 and headquartered in Redmond, Washington, with businesses spanning Windows, Microsoft 365, Azure, enterprise software, artificial intelligence, gaming and devices.Open the full entry, Facebook and Amazon.⁠[14]

Appears on the Lex Fridman Podcast

He appeared on episode 11 of the Lex Fridman Podcast, titled “Godel Machines, MetaMetaMeta (Meta Platforms, Inc.) is a publicly listed American technology company, renamed from Facebook in 2021, that operates social communication, digital advertising, virtual reality, smart glasses and artificial intelligence businesses.Open the full entry-Learning, and LSTMs”; the episode description presents him as co-creator of LSTM networks and the proposer of many unconventional AI ideas, including a formal theory of creativity.⁠[15]

Critique of the 2018 Turing Award

Director of the KAUST AI Initiative

From October 1, 2021, he has directed the Artificial Intelligence Initiative at King Abdullah University of Science and Technology (KAUST) in Saudi Arabia, while remaining chief scientist of NNAISENSE, scientific director of IDSIA and a part-time adjunct professor at the University of Lugano.⁠[17]

Critique of LeCun’s Paper

He wrote that Yann LeCun’s 2022 paper on autonomous machine intelligence rehashed essential work from 1990–2015 without referencing it.⁠[18]

Technical Report on Priority Disputes

He released an IDSIA technical report alleging that the three 2018 Turing laureates often republished methods first described by his team without proper attribution, listing seven direct priority disputes with Bengio, six with Hinton and four with LeCun.⁠[19]

Criticises the Physics Nobel Prize

He released a technical report calling the 2024 Nobel Prize in Physics awarded to John Hopfield and Geoffrey Hinton “effectively a prize for plagiarism,” arguing that they republished methods developed by Ivakhnenko, Amari and others in Ukraine and Japan in the 1960s and 1970s without referencing the original papers.⁠[20]

ACATIS Acquires NNAISENSE

In 2025 longtime partner ACATIS Investment acquired NNAISENSE, which is building a generative-AI-driven quantitative multi-strategy hedge fund.⁠[11]

On the Origins of the Most Cited Neural Networks

In an article updated in March 2026 he argued that the most cited neural networks, including LSTM, the Highway Net and its variant ResNet, DanNet, GANs and Transformers, all build on work done in his labs.⁠[21]

Related Organizations, Websites, and Public Accounts

Sources

  1. Juergen Schmidhuber's home page (opens in a new window)
  2. 1987 THESIS ON LEARNING HOW TO LEARN, METALEARNING, META GENETIC PROGRAMMING, CREDIT-CONSERVING MACHINE LEARNING ECONOMY (opens in a new window)
  3. Recursive Self-Improvement (RSI) Since 1987 (opens in a new window)
  4. Deep Learning: Our Miraculous Year 1990-1991 (opens in a new window)
  5. Formal Theory of Creativity and Fun and Intrinsic Motivation Explains Science, Art, Music, Humor (Juergen Schmidhuber). Artificial Scientists, Artificial Artists, Developmental Robotics, Curiosity, Attention, Surprise, Novelty, Discovery, Open-Ended Learning, Formal Theory of Beauty, Creating Novel Patters (opens in a new window)
  6. Curriculum Vitae (opens in a new window)
  7. 2022: 25-year anniversary: LSTM (1997), all computable metaverses, hierarchical Q-learning, adversarial intrinsic Reinforcement Learning, low-complexity NNs, low-complexity art, Meta-RL, soccer learning (opens in a new window)
  8. GOEDEL MACHINE HOME PAGE (opens in a new window)
  9. Highway Networks, the first working really deep feedforward neural networks with hundreds of layers (opens in a new window)
  10. 2011: DanNet triggers deep CNN revolution (opens in a new window)
  11. NNAISENSE — Intelligent Investing, Powered by Generative AI (opens in a new window)
  12. 2016 IEEE CIS Neural Networks Pioneer Award Goes to Juergen Schmidhuber (opens in a new window)
  13. Artificial Intelligence Gained Consciousness in 1991 (opens in a new window)
  14. Our impact on the world's most valuable public companies (Google, Apple, Microsoft, Amazon, etc) (opens in a new window)
  15. Juergen Schmidhuber: Godel Machines, Meta-Learning, and LSTMs | Lex Fridman Podcast (opens in a new window)
  16. Critique of 2018 Turing Award for Drs. Bengio & Hinton & LeCun (opens in a new window)
  17. Director of AI Initiative at KAUST (opens in a new window)
  18. LeCun's 2022 paper on autonomous machine intelligence rehashes but does not cite essential work of 1990-2015 (opens in a new window)
  19. How 3 Turing Awardees Republished Key Methods and Ideas Whose Creators They Failed to Credit (opens in a new window)
  20. A Nobel Prize for Plagiarism (opens in a new window)
  21. The most cited AIs are all based on work done in my labs (opens in a new window)