Artificial Intelligence
Beginner → Advanced
13 chapters
Free certificate

Generative AI & LLM Engineering

Tokens, embeddings, RAG and agents — explained with playable visuals.

Chatbots feel magical until you see them predict one small token at a time. This course turns that magic into steps you can watch and build yourself.

Your progress (saved in this browser)0/13

Try it in 10 seconds

Every chapter teaches like this: guess first, then see why.

Predict first

An LLM writes an answer by…

Your roadmap

  1. Chapter 1

    What an LLM Actually Is — Inside the Next-Token Machine

    Free interactive AI lesson: watch an LLM predict the next token, slice text into tokens, tune temperature live, and estimate cost and context-window limits.

  2. Chapter 2

    Tokens: Watch Text Split into Pieces

    Explore how LLM tokenizers split text, inspect token IDs, learn the basics of byte-pair encoding, and see how tokens affect cost and context limits.

  3. Chapter 3

    Temperature, Sampling & Context Windows

    Experiment with logits, temperature, top-k and top-p sampling, then learn how context windows are budgeted and why relevant facts can get lost in the middle.

  4. Chapter 4

    Embeddings: Meaning as Points on a Map

    Visualize how embeddings represent meaning, compare cosine similarity, explore vector arithmetic, and see how semantic search finds related content.

  5. Chapter 5

    Vector Databases & Similarity Search

    Compare brute-force and approximate nearest-neighbor search, explore HNSW indexes, metadata filters, distance metrics, and vector database choices.

  6. Chapter 6

    RAG: The Complete Pipeline Step by Step

    Build a mental model of retrieval-augmented generation, from chunking and retrieval through prompt assembly, reranking, and common production failure modes.

  7. Chapter 7

    Prompt Engineering & Structured Output

    Practice system prompts, zero-shot and few-shot strategies, chain-of-thought prompting, prompt injection defenses, and schema-constrained output.

  8. Chapter 8

    Reducing Hallucinations & Evaluating Answers

    Learn why models hallucinate, practice grounding and verification, and evaluate answer quality with rubrics, RAG metrics, and golden datasets.

  9. Chapter 9

    Tool Use, Function Calling & ReAct Agents

    Trace the tool-calling round trip, define tools with JSON schemas, build ReAct agents, and add safety limits and human approval to agent workflows.

  10. Chapter 10

    Production LLM Engineering — Cost, Latency & Reliability

    Model token costs and latency, apply prompt caching and routing, and design reliable production AI systems with retries, circuit breakers, and safeguards.

  11. Chapter 11

    Fine-Tuning & Alignment (LoRA, QLoRA, DPO & RLHF)

    Choose between prompting, RAG, and fine-tuning; explore LoRA and QLoRA, alignment methods, and practical dataset engineering.

  12. Chapter 12

    Multimodal LLMs — Vision, Documents & Real-Time Voice

    Explore vision-language models, image tiling, document understanding, realtime voice agents, and production guardrails for multimodal AI.

  13. Chapter 13

    Capstone AI System Design & Interview Preparation

    Bring the course together with a senior-level AI system design lab, chapter-by-chapter interview questions, and a capstone challenge.

Related courses