Registration: https://vergil.columbia.edu/vergil/course/20263/73055/19580

About the course

There is a lot of excitement and concerns around the rate of progress in AI systems.

We will start with technical content on how frontier models are trained and evaluated. From there the class will be largely discussion and participation-based, with a final project. We hope to have multiple guest speakers from frontier labs throughout the semester.

Questions we will potentially explore together:

Instructor

Steven Yin

Steven leads Midtraining and STEM RL at SpaceXAI. Previously, he led the Meta Learning team at OpenAI. Before that, he did high-frequency trading at Hudson River Trading.

Audience and prerequisites

Audience
We invite students from all departments to join our discussions!
Prerequisites
While there is no hard technical prerequisite, familiarity with machine learning concepts (e.g., understanding how transformers work) is highly useful. We expect students to be able to pick up necessary technical concepts as needed.

Guest speakers

We aim to host several guest speakers from frontier labs and other AI organizations. Confirmed speakers will be listed here as they are scheduled.

Final project

TBD.

Readings

If any of the following looks interesting, this is the right class for you.

  1. Oct 2017Artificial Intelligence and Economic Growth
  2. Mar 2022Training Compute-Optimal Large Language Models (Chinchilla)
  3. Mar 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of LLMs
  4. Sep 2023Explosive Growth from AI Automation: A Review of the Arguments
  5. Nov 2023The A.I. Dilemma: Growth versus Existential Risk
  6. Mar 2025GATE: Modeling the Trajectory of AI and Automation
  7. Mar 2025Measuring AI Ability to Complete Long Tasks
  8. Apr 2025AI 2027
  9. Apr 2025AI as Normal Technology
  10. Jul 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
  11. Aug 2025Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of AI
  12. Aug 2025Transformative AI, Existential Risk, and Real Interest Rates
  13. Sep 2025How People Use ChatGPT
  14. Sep 2025What Will AI Look Like in 2030?
  15. Dec 2025Capital in the 22nd Century
  16. Jan 2026State of AI: An Empirical 100 Trillion Token Study with OpenRouter
  17. Apr 2026When Does Automating AI Research Produce Explosive Growth?
  18. May 2026Is Labor a Luxury in the Long Run?
  19. May 2026The Politics of Jobless Prosperity
  20. Jul 2026AI 2040: Plan A
  21. Jul 2026The Economics of Recursive Self-Improvement
  22. Aug 2026The Hugging Face incident and the road ahead
  23. Aug 2026Understanding AI and Productivity