K

K

Free

AI Engineering track

Transformers

Attention, scaling laws and the transformer architecture as it ships today.

8 concepts3 labs

0%

0% complete

Keep going!

Concepts

Start learning

Work through the concepts in order, or jump to what you need.

Attention Mechanism

Concept · Hands-on lab included

Self-Attention

Concept · Hands-on lab included

Multi-Head Attention

Concept · Hands-on lab included

Positional Encoding

Concept · Hands-on lab included

Encoder-Decoder vs Decoder-Only

Concept · Hands-on lab included

Scaling Laws

Concept · Hands-on lab included

Pre-training & the Base Model

Concept · Hands-on lab included

Causal Masking

Concept · Hands-on lab included

Practice

Hands-on labs

Apply what you've learned in guided, production-style environments.

Browse all labs

Scaled Dot-Product Attention by Hand

30 min · intermediate · Self-Attention

Sinusoidal Positional Encodings

25 min · intermediate · Positional Encoding

Implement Causal Attention from Scratch

40 min · intermediate · Causal Masking

Continue

Next modules

Keep your learning streak going with related modules.

Python

The Python skills AI engineering builds on — typing, async, packaging and testing.

APIs

HTTP, REST, auth, rate limits, SDK patterns and API design for AI systems.

Data Handling

Preparing documents, JSON, embeddings pipelines and data validation for AI.