Pilot planning

Define your first
model evaluation.

Describe the input, the result your application needs, and the standard it must meet. Download a brief to align your team before evaluating a model.

A focused evaluation.

Bring representative examples, the output you need, and the baseline you use today.

  1. Define the job

    Identify a recurring task and the person who reviews the result.

  2. Build the evaluation set

    Include typical examples and known failure cases. Hold some data back from development.

  3. Agree on acceptance

    Measure correctness, review effort, latency, and processing cost.

Your answers stay in this browser. This creates a local file for you to share.