Real-Time Inference

Online serving, latency, autoscaling and online feature lookup.

6 concepts4 labs1 challenges

0% complete

Keep going!

Concepts

Start learning

Work through the concepts in order, or jump to what you need.

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Practice

Apply what you've learned in guided, production-style environments.

40 min · intermediate · Streaming Inference

35 min · intermediate · Online Servers and Engines

40 min · advanced · Latency and Throughput Tuning

35 min · advanced · Real-Time Governance and Skew

Continue

Keep your learning streak going with related modules.

The full ML lifecycle and the operational discipline MLOps adds.

MLflow tracking, run metadata, reproducibility and comparing experiments.

DVC, data lineage and immutability for training data.