This section contains polished articles and personal thoughts on COMPSCI 714 (AI Architecture and Design).
Posts here are written to:
- explain key insights clearly
- summarize stable understanding
- serve as reusable references
- use as a tool box
Build a GPT-2 from scratch
by build a gpt2 to show all the detail of how to train a llm