README

Awesome LLM Strawberry (OpenAI o1)
 !GitHub stars !GitHub forks 

This is a collection of research papers & blogs for OpenAI Strawberry(o1) and Reasoning.

And the repository will be continuously updated to track the frontier of LLM Reasoning.

 OpenAI Docs
- https://platform.openai.com/docs/guides/reasoning
- 

 News
- [OpenAI] Introducing deep research
- [OpenAI] o3 preview & o3 mini
- [OpenAI] Introducing ChatGPT Pro
- [Google DeepMind] Gemini 2.0 Flash Thinking
- [Ilya Sutskever] AI with reasoning power will be less predictable
- [SemianAlysis] Scaling Laws – O1 Pro Architecture, Reasoning Training Infrastructure, Orion and Claude 3.5 Opus “Failures” 
- [DeepSeek] DeepSeek-R1-Lite-Preview is now live: unleashing supercharged reasoning power!
- [Moonshoot] 数学对标o1系列，搜索再次进化，Kimi 新推理模型与你一起拓展智能边界
- [Moonshoot] Kimi 发布视觉思考模型 k1，多项理科测试行业领先
- [InternLM] 强推理模型书生InternThinker开放体验：自主生成高智力密度数据、具备元动作思考能力
- [新智元] 万字独家爆光，首揭o1 pro架构！惊人反转，Claude 3.5 Opus没失败？

 Blogs
- [OpenAI] Learning to Reason with LLMs
- [OpenAI] OpenAI o1-mini Advancing cost-efficient reasoning
- [OpenAI] Finding GPT-4’s mistakes with GPT-4
- [ARC-AGI] OpenAI o3 Breakthrough High Score on ARC-AGI-Pub
- [Anthropic] Building effective agents
- [hijkzzz] Stabilizing MoE RL Without Router Replay: The Online IcePop Solution
- [hijkzzz] REINFORCE++-baseline is all you need in RLVR
- [hijkzzz] Exploring OpenAI O1 Model Replication
- [Nathan Lambert] OpenAI’s Strawberry, LM self-talk, inference scaling laws, and spending more on inference
- [Nathan Lambert] Reverse engineering OpenAI’s o1
- [Andreas Stuhlmüller, jungofthewon] Supervise Process, not Outcomes
- [Nouha Dziri] Have o1 Models Cracked Human Reasoning?
- [Rishabh Agarwal] Improving LLM Reasoning using Self-generated data: RL and Verifiers
- [Wei Shen] Generalization Progress in RLHF: Insights into the Impact of Reward Models and PPO
- [Dominater069] Codeforces - Analyzing how good O1-Mini actually is
- [Tibor Blaho] Summary of what we have learned during AMA hour with the OpenAI o1 team

 Talks
- [Noam Brown] Parables on the Power of Planning in AI: From Poker to Diplomacy
- [Noam Brown] OpenAI o1 and Teaching LLMs to Reason Better
- [Hyung Won Chung] Don't teach. Incentivize.

 Courses
- [DeepLearning.AI] Reasoning with o1

 Twitter

OpenAI Developers

- All the questions addressed by the API team during the December 17, 2024 AMA
- We’re hosting an AMA for developers from 10–11 AM PT today.
- Today we previewed Reinforcement Fine-Tuning
- 





Noam Brown

- 
- 
- 
- 




Jason Wei

- 
- 
- 




Others

- 

- 
- 



 Open-source
 Models
- [Alibaba Qwen Team] Qwen3
- [Alibaba Qwen Team] QwQ
- [Alibaba Qwen Team] QvQ
- [DeepSeek] DeepSeek R1
- [NVIDIA] Nemotron-Research-Reasoning-Qwen-1.5B
- [Skywork] Skywork R1V2
- [rLLM] DeepScaler
- [NovaSky] Sky-T1
- [GAIR-NLP] O1 Replication Journey: A Strategic Progress Report
- [OpenO1 Team] Open-Source O1
- [Tencent] DRT-o1
- [Alibaba] Marco-o1
- [CUHK-SZ] HuatuoGPT-o1

 Codebase
- [OpenRLHF Team