Kelvin Guu
Kelvin Guu is a research director at Google DeepMindGoogle DeepMindGoogle DeepMind is Google’s artificial intelligence research organization, formed in April 2023 by merging DeepMind, which Google acquired in 2014, with the Brain team from Google Research, and led by CEO Demis Hassabis. It developed AlphaGo, AlphaFold, and the Gemini family of models, and Hassabis and John Jumper received the 2024 Nobel Prize in Chemistry for AlphaFold’s protein structure prediction work.Open the full entry working on statistical learning, language processing and information retrieval. He studied mathematics at Duke and earned his doctorate in statistics at StanfordStanford UniversityStanford University is a research university in California founded by Leland and Jane Stanford in 1885 and opened in 1891.Open the full entry. As lead author of REALM he investigated how language models could draw knowledge from external documents. He has also worked on instruction tuning and checking generated answers.
Contents7 sections
Key facts
2007–2018Mathematics at Duke and statistics at Stanford
Guu studied mathematics at Duke from 2007 to 2011, then worked there on Bayesian statistics with David Dunson and Alex Hartemink in 2011–2012. He pursued his Stanford statistics doctorate from 2012 to 2018 under Percy LiangPercy LiangPercy Liang is a professor of computer science at Stanford University, director of its Center for Research on Foundation Models and a co-founder of Together AI. He studies natural language processing and machine learning. His projects include HELM, a framework for evaluating language models, and Marin, which opens model experiments to public scrutiny from registration through results. He also trained as a classical pianist.Open the full entry, with support including an NSF Graduate Research Fellowship and Stanford Math+X Fellowship. During the winter of 2014–2015 he consulted for Richard SocherRichard SocherRichard Socher is an AI researcher, entrepreneur and investor. He is co-founder and CEO of Recursive, founder and CEO of You.com, and co-founder and managing partner of AIX Ventures. A Stanford computer science PhD, he contributed to the Stanford Sentiment Treebank and GloVe, founded MetaMind, and served as chief scientist at Salesforce.Open the full entry's MetaMindMetaMindMetaMind was a deep learning company co-founded by Richard Socher and Sven Strohband. It offered text and image analysis and was acquired by Salesforce in 2016.Open the full entry, followed by a summer 2015 GoogleGoogleGoogle is an American technology company founded by Larry Page and Sergey Brin and incorporated in 1998. It became an Alphabet subsidiary in 2015. Its businesses include internet search, advertising, software platforms, cloud computing, and artificial intelligence.Open the full entry internship and a Greylock X Fellowship in 2017.[1][2]
From 2018Teaching, retrieval and instruction tuning
He taught Stanford's CS221 artificial intelligence course to more than 700 students in 2018–2019. From 2018 to 2023 he was a research scientist and manager at Google. In the 2020 ICML paper REALM, he and colleagues explored retrieving supporting documents, distinguishing knowledge learned during training from knowledge supplied by external text. In a research interview that year he said that when choosing a question he asked whether it would remain relevant as models grew. He later co-led work on FLAN, studying whether instruction tuning across tasks could improve performance on unfamiliar ones.[1][3][2]
From 2023Google DeepMind and checking answers
He became a principal research scientist and director at Google DeepMind in 2023. He identifies Bard's double-check feature as a project of his team. It used search results to show users which statements had supporting material online and which deserved a closer look. His earlier work had also brought Transformer models into Google Ads and Assistant.[1][4]
May 4, 2023Interview with No Priors
Guu discussed the retrieval of information for personalized language systems on No PriorsNo PriorsNo Priors is an AI interview podcast and media brand founded and hosted by investors Sarah Guo and Elad Gil, with episodes beginning in February 2023. It covers research, startups, infrastructure and business applications through guest interviews, host discussions and retrospectives distributed on audio platforms and YouTube.Open the full entry, distinguishing human memory from a model's ability to use context. Asked about younger researchers, he explained his approach to choosing problems that could remain valuable over time.[5]
He traced his move from mathematics and statistics to language tools to an early interest in making learning easier and information faster to find.[5]
Advice Shared on No Priors
He advised researchers who felt that most problems had been solved to set a more ambitious horizon and reconsider what remained open. (32:46)[5]
He recommended looking at how products are used to find questions that can motivate research. (32:57)[5]
Related Organizations, Websites and Public Accounts
Google DeepMind: Principal research scientist and director. Official website: https://deepmind.google/ (opens in a new window).[1]
Personal website: https://www.kelvinguu.com/ (opens in a new window).[1]
LinkedInLinkedInLinkedIn is a social networking platform for professionals. It was founded in 2002 by Reid Hoffman and others, launched in 2003, and listed on the New York Stock Exchange in 2011; after Microsoft acquired it for approximately $26.2 billion in 2016, it became a wholly owned Microsoft subsidiary. Its revenue comes from membership subscriptions, advertising, and recruitment solutions.Open the full entry: https://www.linkedin.com/in/kelvinguu/ (opens in a new window).[1]
Sources5 sources
- Kelvin Guu: Principal Research Scientist / Director at Google DeepMind (opens in a new window)kelvinguu.com↑
- Kelvin Guu, Google AI: On language models & overlooked problems (opens in a new window)imbue.com↑
- REALM: Retrieval-Augmented Language Model Pre-Training (opens in a new window)proceedings.mlr.press↑
- Bard can now connect to your Google apps and services (opens in a new window)blog.google↑
- No Priors Ep. 15 | With Kelvin Guu, Staff Research Scientist, Google Brain (opens in a new window)youtube.com↑