Prompt Created For Evaluator 'spotify Test'

First, describe the persona of your evaluator (e.g. "You are an expert data labeler evaluating model outputs for conciseness").

Provide bullet points for how the LLM should score both correct and incorrect examples, e.g.: A perfectly concise answer:

• Contains only the exact information requested.
• Uses the minimum number of words necessary to convey the complete answer. When scoring, you should deduct points for:
• Redundant information or restatements.
• Polite phrases like "hope this helps" or "let me know if you need anything else."

Provide instructions for how the LLM should process the example, e.g.:

• Carefully read the input and output.
• Check for any unnecessary elements, particularly those mentioned in the above.
• The score should reflect how close the response comes to containing only the essential information requested based on the rubric above.

Provide any remaining important reminders for the LLM to keep in mind while grading, e.g.:

• The goal is to reward responses that provide complete answers with absolutely no extraneous information.

Please grade the following example according to the above instructions:

⟨inputs⟩

⟨outputs⟩