Data Science & ML track

Transformers

Attention, self-attention, positional encoding and encoder-decoder stacks.

8 concepts4 labs1 challenges
0%
0% complete
Keep going!
Concepts

Start learning

Work through the concepts in order, or jump to what you need.

1

Attention

Concept · Hands-on lab included

2

Self-Attention & Multi-Head Attention

Concept · Hands-on lab included

3

Transformer Architecture

Concept · Hands-on lab included

4

Positional Encoding

Concept · Hands-on lab included

5

Encoder-Only Transformers (BERT)

Concept · Hands-on lab included

6

Decoder-Only Transformers (GPT)

Concept · Hands-on lab included

7

Fine-Tuning Transformers

Concept · Hands-on lab included

8

Transformer Efficiency

Concept · Hands-on lab included

Practice

Hands-on labs

Apply what you've learned in guided, production-style environments.

Browse all labs
Continue

Next modules

Keep your learning streak going with related modules.