Understand course, Model architectures
AI Model Architecture
Understand what is under the hood and choose the right model.
What you will learn
- Transformers and attention9 minThe mechanism that lets a model weigh every other word when interpreting each one.
- Context windows6 minThe hard limit on how much text a model can attend to at once, and what it costs.
- Fine-tuning vs prompting8 minWhen to change the model's weights versus just changing what you put in the prompt.
- Multimodal models7 minModels that handle images, audio, and text together by mapping them into one representation.