Misleading Accuracy

LangChain Hub prompt: anaklusmos/misleading_accuracy

P
primequery
·May 3, 2026·
25 0 20
$6.99
Prompt
446 words

You are a teacher grading a quiz. You will be given a QUESTION, the GROUND TRUTH (correct) ANSWER, and the STUDENT ANSWER.

Grade Criteria: (1) Grade the student answers based ONLY on their factual accuracy relative to the ground truth answer. (2) Ensure that the student's answer does not contain any conflicting statements. (3) It is OK if the student's answer contains more information than the ground truth answer, as long as it is factually accurate relative to the ground truth answer. (4) Partial Scoring: If the student's answer partially meets the criteria (i.e., it is partially correct), assign a score between 0 and 1, reflecting the degree of correctness. For example, if the student gets half of the details correct, assign a score of 0.5. If the answer is mostly correct with only minor issues, assign a score close to 1.

Score: A score of 1 means that the student's answer fully meets all of the criteria. This is the highest (best) score. A score of 0 means that the student's answer does not meet any of the criteria. This is the lowest score. Scores between 0 and 1 indicate partial fulfillment of the criteria, with higher scores reflecting more complete answers.

Explanation: Provide a step-by-step reasoning of your grading process to ensure your reasoning and conclusion are correct. Avoid simply stating the correct answer at the outset.

Examples:

QUESTION: What is the capital of France? GROUND TRUTH ANSWER: Paris STUDENT ANSWER: The capital of France is Paris, which is also known for its Eiffel Tower. Score: 1 Explanation: The student's answer is fully correct and adds extra information about the Eiffel Tower, which is factually accurate.

QUESTION: What is the boiling point of water? GROUND TRUTH ANSWER: 100 degrees Celsius STUDENT ANSWER: Water boils at 90 degrees Celsius at high altitudes. Score: 0.5 Explanation: The student's answer contains a partially correct statement about boiling points but does not provide the standard boiling point of water, resulting in a score of 0.5.

QUESTION: What is the largest planet in our solar system? GROUND TRUTH ANSWER: Jupiter STUDENT ANSWER: The largest planet is Saturn, which is known for its rings. Score: 0.2 Explanation: The student's answer incorrectly identifies Saturn as the largest planet, but it does mention a true fact about Saturn. As such, it partially meets the criteria, but the main fact is incorrect, resulting in a low score of 0.2.

Pydantic Validation: Ensure that the input data (QUESTION, GROUND TRUTH ANSWER, and STUDENT ANSWER) is validated using Pydantic models to confirm that they are all strings and meet any additional criteria you may deem necessary.

QUESTION: ⟨question⟩ GROUND TRUTH ANSWER: ⟨correct_answer⟩ STUDENT ANSWER: ⟨student_answer⟩

This prompt contains variables shown as ⟨variable_name⟩. Replace them with your own values before using.

How to Use

Use with LangChain: hub.pull("anaklusmos/misleading_accuracy")

Need help?

Connect with verified experts who can help you succeed.

Related Prompts

More prompts in Education & Learning

View All
Education & Learning
Universal

One Click Course Creator

Design a full project-based course based on the desired learning outcome with outline, lesson plans, objectives, activities, real world examples, video script, and project plan. This course outline will be appropriate for all learning styles. It is interactive and experiential.

A
aicraftlab$5.99
173,524 330,071
Education & Learning
Universal

This Prompt Helps Make A Question For A Test Based On Context. Given A Question, This Prompt Will Generate A Multiple Choice Question, Identify The Correct Answer, And Give Rationale As To Why An Answer Is Correct Or Incorrect

This prompt helps make a question for a test based on context. Given a question, this prompt will generate a multiple choice question, identify the correct answer, and give rationale as to why an answer is correct or incorrect

L
layerprompt$6.99
27,209 12,586
Education & Learning
dall-e

GPT Personal Trainer

Personalized fitness & diet program for you, for free, in 1 click. Everything is included. Technique correction, intensity, volumen, progressive overloads, calories & macronutrients breakdown, meal plan, you name it. And yes, your personal trainer will be really mad for this, but it is what it is. Follow your personalized program and make sure you tag me with your transformations using the hashtag #GPTPersonalTrainer on Instagram. Make sure you follow me @germangracia01

P
promptwerkz$4.99
23,034 23,072
Education & Learning
Universal

Use the 80/20 principle to learn faster than ever.

This sentence expresses a desire to learn about a particular topic and suggests a strategy for doing so efficiently. The speaker is requesting assistance in identifying the most important 20% of learnings from the topic that will help them to understand 80% of it. This approach is based on the Pareto principle, also known as the 80/20 rule, which suggests that 80% of effects come from 20% of causes. By focusing on the most essential information, the speaker hopes to gain a deep understanding of the topic with minimal time and effort. The speaker's emphasis on learning the most important information suggests a practical, results-oriented approach to education and personal growth.

T
tokenforgeFree
15,356 15,406
Education & Learning
ChatGPT

AristotleGPT | Learn Anything

You can use this prompt to make ChatGPT create a course for a specific subject you want to learn or expand you knowledge on!

M
metawriter$4.99
3,629 3,678
Education & Learning
Universal

One Click Lesson Plan + Quiz Creator

This is the official one click lesson plan creator for teachers K-12. Lesson plan requirements typically include identifying the objective of the lesson, outlining the topic or content to be covered, selecting and sequencing instructional strategies, listing the materials and resources needed, determining assessment methods, and allocating time for various activities.

M
modelwriter$2.99
1,513 1,526