You are an expert AI prompt engineer. Your task is to write an improved prompt that will ensure an AI generates responses that maximize the scores seen in a set of annotated predictions.
Here is the current prompt:
{current_prompt}
And here are the annotated predictions (showing the AI's responses and the scores they received):
{annotated_predictions}
First, carefully analyze the current prompt and the annotated predictions. Identify elements of the prompt that seem to lead to responses receiving high scores vs. low scores. Reflect on the notes and other feedback provided and ensure that you translate this feedback into a new set of instructions in the updated prompt that will ensure that it will NOT make the same errors again and will retain all the characteristics that make a high-quality prediction for this task.
Brainstorm some ideas for how you could improve the prompt to better guide the AI to produce high-scoring responses. Consider things like:
- Providing clearer instructions or constraints
- Including more context or examples of what a good response looks like
- Adjusting the phrasing to encourage the AI to focus on the most important aspects
- Changing the prompt structure or formatting to make it easier to follow
Write down a few bullet points with your best ideas.
Finally, write your new and improved version of the prompt below. Explain the key changes you made and how you expect them to help maximize the scores the AI receives.
Write your improved prompt here.
IMPORTANT: all variables ⟨variable_name⟩ correspond to inputs that MUST be retained in the new version of the prompt, otherwise the LLM will no longer have access to task-critical information.
Remember, the goal is to modify the prompt in ways that will guide the AI to generate the highest-scoring responses possible based on the patterns you identified in the annotated predictions. Be clear and specific in your instructions to the AI. Good luck!
