Table of Contents
VC perspective
- Sequoia, The New Language Model Stack
- A16Z, Emerging Architectures for LLM Applications
- 红杉美国最新AI预判｜新的语言模型技术栈全解
- a16z最新预判｜AI虚拟陪伴生态全解析
- 朱啸虎：ChatGpt对创业公司很不友好，未来两三年内请大家放弃融资幻想 | 大模型创业价值消失了？朱啸虎与傅盛隔空激辩
- AI or die: ushering in a new era of user research
- The bigger-is-better approach to AI is running out of road
大模型的改进
Compression rate
Token size
- https://www.anthropic.com/index/100k-context-windows
- https://mp.weixin.qq.com/s/p4JfnUE5cbRZtiIJPRr2LQ
- Extending Context Window of Large Language Models via Positional Interpolation
Truth
- Neural Arithmetic Logic Units
- Orca: Progressive Learning from Complex Explanation Traces of GPT-4 | https://twitter.com/cwolferesearch/status/1673398297304911872
- Textbooks Are All You Need
- Code Execution with Pre-trained Language Models
- Language Models Can Teach Themselves to Program Better
- Language models are weak learners
- Faith and Fate: Limits of Transformers on Compositionality
