HOW LLMs WORK FOR THE NON-SPECIALIST

PRACTICE LAB CONNECTION The Resume Review Agent will send resumes and a job posting to a model, so every idea in this chapter applies. Practice by estimating, for a single resume review, how many tokens go in and how many come out. Think about statelessness: when the lab reviews resume number two, the model will not remember resume number one unless the harness deliberately includes it. Think about temperature: a review that must be consistent from one run to the next should use a low setting. And think about hallucination: if the agent claims that a candidate has a certain degree, the harness should be able to point to the place in the resume that says so. Use the prompts below with sample material from the lab once it exists, or with any short prompt of your own.