AI Engineering track

Model Serving

Serving strategies, batching, streaming, GPU inference and providers.

8 concepts4 labs1 challenges
0%
0% complete
Keep going!
Concepts

Start learning

Work through the concepts in order, or jump to what you need.

1

Serving Strategies

Concept · Hands-on lab included

2

Providers vs Self-Hosting

Concept · Hands-on lab included

3

Request Batching

Concept · Hands-on lab included

4

Streaming Responses

Concept · Hands-on lab included

5

Serving Gateways

Concept · Hands-on lab included

6

GPU Inference Basics

Concept · Hands-on lab included

7

Deploying Model Updates

Concept · Hands-on lab included

8

Scaling Serving

Concept · Hands-on lab included

Practice

Hands-on labs

Apply what you've learned in guided, production-style environments.

Browse all labs
Continue

Next modules

Keep your learning streak going with related modules.