THE EVALUATION HARNESS

LEARNING GOALS By the end of this chapter you will be able to explain what an evaluation harness is, describe the four levels of granularity at which an agent can be measured, tell the difference between data that comes from real production traces and data that comes from curated datasets, and compare offline evaluation with online evaluation.