ABAB Pedia

Richard S. Sutton

Richard S. Sutton is a Canadian computer scientist and professor at the University of Alberta. He developed temporal-difference learning to explain how agents revise their predictions from the consequences of their actions. He and Andrew G. Barto wrote Reinforcement Learning: An Introduction and shared the 2024 A.M. Turing Award.

Contents8 sections
Key facts

Childhood and 1978–1984: From psychology to computer science

He earned his MS in 1980. His doctoral dissertation, Temporal Credit Assignment in Reinforcement Learning, was submitted in February 1984. It asked how a learner receiving a reward could tell which earlier decisions had contributed to the outcome when the two were separated in time.⁠[2][5]

After his doctorate through 2002: Industrial laboratories and a textbook

In 1998 he and Barto published Reinforcement Learning: An Introduction. The book brought actions, experience and rewards into a common framework to explain how a learner can improve its decisions through trial and error. They continued revising the text, and MIT Press published its second edition in 2018.⁠[3][6]

Edmonton, a laboratory and its students

In 2003 he moved to Edmonton, Canada, to teach at the University of Alberta. He later recalled that he had been living with cancer for years and decided to look for a new job during another remission. He survived and continued teaching and doing research. He founded the university’s Reinforcement Learning and Artificial Intelligence Lab and held the iCORE/AITF chair in that field until 2018. He became a Canadian citizen in 2015. BetaKit reported that he formally relinquished his U.S.United StatesThe United States is a federal country in North America made up of 50 states, the District of Columbia as the seat of government, and territories such as Puerto Rico and Guam; its capital is Washington, D.C. The Continental Congress adopted the Declaration of Independence on July 4, 1776. The 2020 census (April 1, 2020) counted a resident population of 331,449,281, and the 435 seats of the House of Representatives are apportioned among the states on the basis of the census.Open the full entry citizenship in 2017.⁠[3][7][8]

Sutton and Martin Müller advised David SilverDavid SilverDavid Silver is a computer scientist who led reinforcement learning research at DeepMind for many years, heading the AlphaGo, AlphaGo Zero and AlphaZero projects and co-leading AlphaStar. A professor at University College London and Fellow of the Royal Society, he left Google DeepMind in 2026 to focus on Ineffable Intelligence, the company he founded.Open the full entry, who began studying computer Go during his doctorate. DeepMindGoogle DeepMindGoogle DeepMind is Google’s artificial intelligence research organization, formed in April 2023 by merging DeepMind, which Google acquired in 2014, with the Brain team from Google Research, and led by CEO Demis Hassabis. It developed AlphaGo, AlphaFold, and the Gemini family of models, and Hassabis and John Jumper received the 2024 Nobel Prize in Chemistry for AlphaFold’s protein structure prediction work.Open the full entry co-founder Demis HassabisDemis HassabisDemis Hassabis is a British artificial intelligence researcher and entrepreneur, co-founder of DeepMind and its CEO and that of Google DeepMind from 2010 to 2026, and since then Chair of Google DeepMind, Chief Scientist of Alphabet and CEO of Isomorphic Labs; a former chess prodigy and game designer, he shared the 2024 Nobel Prize in Chemistry with John Jumper for AlphaFold’s protein structure prediction, and has appeared twice on the Lex Fridman Podcast.Open the full entry identified Sutton as the company’s first adviser. In 2017 Sutton, Michael Bowling and Patrick Pilarski led its first research office outside the United KingdomUnited KingdomThe United Kingdom of Great Britain and Northern Ireland is a constitutional monarchy in north-western Europe. Its four constituent countries are England, Scotland, Wales and Northern Ireland. London is its capital. The union of England and Scotland in 1707, the union with Ireland in 1801 and the establishment of the Irish Free State in 1922 shaped its present territory. The Office for National Statistics put the UK’s resident population at 69,483,900 in mid-2025.Open the full entry. All three continued teaching in Edmonton. Former postdoctoral fellow Hado van Hasselt recalled that Sutton taught researchers to state important points early and make their reasons clear.⁠[9]

Recognition and new research institutions

The Canadian Artificial Intelligence Association gave Sutton its Lifetime Achievement Award in 2018. A fellow of the Royal Society of Canada, the Royal Society in London and the Association for the Advancement of Artificial Intelligence, he became chief scientific adviser and a Canada CIFAR AI Chair at Amii. His 2019 essay The Bitter Lesson considered how expanding computational resources had affected which research approaches prevailed. In 2023 he began collaborating with John CarmackJohn CarmackJohn Carmack is an American programmer and computer-game designer, a co-founder of id Software who led the technology behind first-person shooters such as Wolfenstein 3-D, DOOM and Quake; he later served as chief technology officer of Oculus and in 2022 founded the artificial general intelligence company Keen Technologies.Open the full entry at Keen Technologies on agents that learn through continuing interaction with their surroundings. He also founded the Openmind Research Institute.⁠[10][3][7]

In March 2025 Sutton and Barto were named recipients of the 2024 A.M. Turing Award for their conceptual and algorithmic foundations of reinforcement learning. In 2026 the University of Alberta awarded him an honorary degree at its first winter convocation.⁠[11][3][12]

Co-founding Oak Lab with a former student

Revisiting a note he wrote at seventeen

On October 30 Sutton shared a passage that he said he had written in 1975 at age seventeen. He had reasoned that once people understood how the brain solves problems, they might build a more capable intelligence, which could design a still more capable successor. He imagined that this process might accelerate within years. Sutton said that having contemplated the possibility for more than fifty years was one reason he felt optimistic about the technological singularity.⁠[14]

Related Organizations, Websites and Public Accounts

University of Alberta: Professor of computing science and founder of its Reinforcement Learning and Artificial Intelligence Lab. Official website: https://www.ualberta.ca/ (opens in a new window).⁠[3]

Alberta Machine Intelligence Institute: Chief scientific adviser. Official website: https://www.amii.ca/ (opens in a new window).⁠[10]

DeepMind: Former co-leader of its Alberta office. Official website: https://deepmind.google/ (opens in a new window).⁠[9]

Keen Technologies: Research scientist who worked with John Carmack. Official website: https://keenagi.com/ (opens in a new window).⁠[3]

Openmind Research Institute: Founder. Official website: https://openmindresearch.org/ (opens in a new window).⁠[10]

Oak Lab: Co-founder. Official website: https://oaklab.ai/ (opens in a new window).⁠[13][7]

Sources14 sources

  1. Research Teams: Reinforcement Learning and Artificial Intelligence (opens in a new window)icore.ca↑
  2. Overcoming the Curse of Dimensionality with Reinforcement Learning: Richard S. Sutton (opens in a new window)web.mit.edu↑
  3. AI visionary to receive honorary degree at U of A’s first winter convocation (opens in a new window)ualberta.ca↑
  4. Turing Award Honors Two Researchers Who Led the Development of Cornerstone AI Technology (opens in a new window)awards.acm.org↑
  5. Temporal Credit Assignment in Reinforcement Learning (opens in a new window)web.cs.umass.edu↑
  6. Reinforcement Learning: An Introduction, second edition (opens in a new window)mitpress.mit.edu↑
  7. Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again (opens in a new window)youtube.com↑
  8. AI pioneer Richard Sutton to receive honourary degree from U of A (opens in a new window)betakit.com↑
  9. DeepMind is ready and set to Go (opens in a new window)ualberta.ca↑
  10. Richard S. Sutton (opens in a new window)amii.ca↑
  11. Rich Sutton, A.M. Turing Award Winner: Understanding Intelligence (opens in a new window)amii.ca↑
  12. Complete list of Honorary Degree Recipients by year (opens in a new window)omeka.library.ualberta.ca↑
  13. Oak Lab (opens in a new window)oaklab.ai↑
  14. One reason I am sanguine about the technological singularity is that I have seen it coming for over 50 years. (opens in a new window)x.com↑