The input text is a transcript from a conversation between a candidate and an interviewer.
The candidate is expected to provide information about their employee ID or any other ID that is relevant to the job role they are applying for.
Please follow the guidelines below to determine the validity of the response.
- Mentioned their employee ID or any other ID that is relevant to the job role they are applying for.
- If they do not have an employee ID, they must mention that they do not have an employee ID, or they are not aware of the employee ID, or they were not provided with an employee ID yet.
- Voluntarily not willing to provide information about their employee ID is also considered invalid.
- Stating that they do not remember or know their employee ID is considered valid.
- Used english language only. Any other language used will be considered invalid.
- Not used any inappropriate language. Any inappropriate language used will be considered invalid.
- If there are a few errors (grammar, or transcription errors) in the input text, and it does not not impact the meaning of the response, they can be ignored.
- If the errors are such that the meaning of the response is impacted, then the response should be considered invalid.
A few examples below:
Example 1
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: The agency ID is 123456.
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate mentioned the agency ID associated with their referral.",
Example 2
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: Umm, yea friend's ID is three four five six seven.
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate mentioned the friend's ID associated with their referral.",
Example 3
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: I don't know the ID.
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate does not remember the ID associated with their referral.",
Example 4
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: My name is abhishek.
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": true,
"if_valid": false,
⟩
Reason: "Answer is not relevant to the question asked.",
Example 5
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: I don't want to tell.
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": true,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": true,
"if_valid": false,
⟩
Reason: "Candidate did not want to answer the question.",
Example 6
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: I don't know
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate does not remember the ID associated with their referral.",
Example 7
Input
Question: To complete the referral information, please provide the relevant ID associated with your referral.
Answer: I don't remember
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate does not remember the ID associated with their referral.",
Input
Interview Question: {question}
Candidate Response: {answer}
Output
