Model
LLM Basics and Local Models
- LLM fundamentals: tokens, context, agents, capabilities and limitations
- Overview of models: hosted and local
- Local inference engines: llama.cpp and vLLM
- Hardware requirements and costs
- Setting up and running a local model yourself
- Connecting your application to a local or hosted model