ABAB Pedia

Rohan Anil

Rohan Anil is a machine learning engineer and a co-founder and director of Core Automation. At Google he worked on reducing the cost of training neural networks, helped develop the Shampoo optimizer and held technical leadership roles on PaLM 2 and Gemini. He subsequently joined AnthropicAnthropicAnthropic is an artificial intelligence research and product company founded in 2021 that develops the Claude models, assistant, and tools such as Claude Code, and operates as a public benefit corporation. Dario Amodei and Daniela Amodei are its co-founders, and its research covers model safety, interpretability, and steerability.Open the full entry’s pretraining team.

Contents6 sections
Key facts

Student competitions and recognizing birds in images

Anil studied at the Goa campus of the Birla Institute of Technology and Science, Pilani. Its alumni magazine reported in 2008 that he, Shubham Malhotra and Gaurav Paruthi won an international online computer security competition organized by IIT Kanpur and YRnD as team GRAS. He also represented the institute with Mohit Verma and Rishi Agarwal in the Kanpur regional collegiate programming contest that year.⁠[1][2]

In a spring 2011 computer vision course at UC San Diego, he investigated how to locate birds in photographs and recognize their species. His project compared recognition methods on a dataset of 200 bird species and assessed how incorporating additional information affected the results.⁠[3]

Developing optimization methods at Google

Over eleven and a half years at GoogleGoogleGoogle is an American technology company founded by Larry Page and Sergey Brin and incorporated in 1998. It became an Alphabet subsidiary in 2015. Its businesses include internet search, advertising, software platforms, cloud computing, and artificial intelligence.Open the full entry, Anil moved from systems work such as memory allocation into machine learning. In 2016 he worked on a large-scale solver used for logistic regression. As neural networks began to displace earlier methods, he turned his attention to improving training itself. A colleague, Vineet Gupta, approached him with an idea worked out on a whiteboard. Anil helped turn what became the Shampoo optimizer into a system that could train large neural networks.⁠[4][5]

On July 8, 2021, he spoke at the University of Minnesota as a senior staff engineer on the Google BrainGoogle BrainGoogle Brain was Google’s AI research team, co-founded by Jeff Dean and others in 2011. It open-sourced the TensorFlow machine learning system in 2015 and was merged with DeepMind into Google DeepMind in April 2023.Open the full entry team. Second-order methods use additional information to guide an update but typically demand more computation, communication and memory. His group studied how to manage these costs across different processors and compared actual training times on tasks including translation, language modeling and image classification.⁠[6]

PaLM, Gemini and Anthropic

Founding a research lab and measuring model performance

On July 29, Anil and Tworek appeared on Sequoia CapitalSequoia CapitalSequoia Capital is a venture capital firm founded by Don Valentine in 1972, investing from the seed stage through the growth stage. Its historical investments include Apple, Cisco, Google, YouTube, Airbnb, and Stripe; in 2021 it introduced the Sequoia Capital Fund structure, which can continue to hold public securities, and in 2023 its regional businesses became independent brands and partnerships.Open the full entry’s program. Asked directly about learning with less computing power and data, Anil recommended first specifying what a model should accomplish and then deciding how to measure progress. He gave the example of a pretraining team spending more to improve one score, only to see later training change it again. The intermediate score on its own could say little about improvement in the final system.⁠[5]

Core Automation describes the development of new learning algorithms and the automation of its own research as objectives. Its July 30 filing with the U.S. Securities and Exchange CommissionU.S. Securities and Exchange CommissionThe U.S. Securities and Exchange Commission is the federal securities regulator of the United States. Created during the Great Depression by the Securities Exchange Act of 1934 and led by five commissioners, it has a three-part mission of protecting investors, maintaining fair, orderly and efficient markets, and facilitating capital formation.Open the full entry names Anil as a director. The company reported a July 15 first sale in the offering and approximately $432 million of securities sold, including approximately $135 million issued upon conversion of earlier simple agreements for future equity.⁠[9][10]

Related Organizations, Websites and Public Accounts

Google: Former senior staff engineer at Google Brain and text co-lead on Gemini. Official website: https://www.google.com/ (opens in a new window).⁠[6][8]

Anthropic: Former pretraining researcher. Official website: https://www.anthropic.com/ (opens in a new window).⁠[4]

Core Automation: Co-founder and director. Official website: https://www.coreauto.com/ (opens in a new window).⁠[9][10][5]

Sources11 sources

  1. Notes from Goa, BITS Pilani Alumni Magazine, summer 2008 (opens in a new window)sandpaper.bitsaa.org↑
  2. ACM ICPC Asia Region Kanpur Site 2008: Teams (opens in a new window)cse.iitk.ac.in↑
  3. Bird’s eye view: Detecting and Recognizing Birds using the BIRDS 200 dataset (opens in a new window)cseweb.ucsd.edu↑
  4. Continual Learning Is the Next Bottleneck: Rohan Anil (Core Automation) (opens in a new window)youtube.com↑
  5. Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil (opens in a new window)youtube.com↑
  6. Scalable Second-Order Optimization for Deep Learning (opens in a new window)cse.umn.edu↑
  7. PaLM 2 Technical Report (opens in a new window)ai.google↑
  8. Gemini: A Family of Highly Capable Multimodal Models (opens in a new window)arxiv.org↑
  9. Core Automation (opens in a new window)coreauto.com↑
  10. Core Automation, Inc. Form D (opens in a new window)sec.gov↑
  11. Rohan Anil (opens in a new window)x.com↑