DevOpsForge
K
K
Free

Platform

Home

Tracks

OverviewLearning Path

Tools

LabsTroubleshootingInterview PrepTemplatesCheat SheetsRoadmapsChallengesProjects

Community

AI MentorSettings
Free
AI Engineering track

Evaluation

LLM eval sets, metrics, golden tests, offline evaluation and eval automation.

8 concepts4 labs
0%
0% complete
Keep going!
Concepts

Start learning

Work through the concepts in order, or jump to what you need.

1

Evaluation Overview

Concept · Hands-on lab included

2

Golden Tests

Concept · Hands-on lab included

3

Eval Metrics

Concept · Hands-on lab included

4

LLM as Judge

Concept · Hands-on lab included

5

Offline Evaluations

Concept · Hands-on lab included

6

Eval in CI/CD

Concept · Hands-on lab included

7

Eval Automation

Concept · Hands-on lab included

8

Eval Data Engineering

Concept · Hands-on lab included

Practice

Hands-on labs

Apply what you've learned in guided, production-style environments.

Browse all labs

Golden-Test Harness

25 min · beginner · Golden Tests

Simulate an LLM Judge

30 min · intermediate · LLM as Judge

Deterministic Golden-Suite Runner

40 min · advanced · Offline Evaluations

Curate & Balance an Eval Dataset

35 min · advanced · Eval Data Engineering

Continue

Next modules

Keep your learning streak going with related modules.

0%

Python

The Python skills AI engineering builds on — typing, async, packaging and testing.

0%

APIs

HTTP, REST, auth, rate limits, SDK patterns and API design for AI systems.

0%

Data Handling

Preparing documents, JSON, embeddings pipelines and data validation for AI.

DevOpsForge - AI Engineering · Evaluation
DocumentationSupport