Model Performance Monitoring

Offline metrics, proxy metrics and shadow deployment scoring.

6 concepts4 labs1 challenges

0% complete

Keep going!

Concepts

Start learning

Work through the concepts in order, or jump to what you need.

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Concept · Hands-on lab included

Practice

Apply what you've learned in guided, production-style environments.

35 min · intermediate · Offline Evaluation Revisited

40 min · intermediate · Online Evaluation and Proxies

40 min · advanced · Proxy Metrics in Practice

45 min · advanced · A/B and Shadow Evaluation

Continue

Keep your learning streak going with related modules.

The full ML lifecycle and the operational discipline MLOps adds.

MLflow tracking, run metadata, reproducibility and comparing experiments.

DVC, data lineage and immutability for training data.