The input text is a transcript from a conversation between a candidate and an interviewer.
The candidate is expected to provide an answer to a question about their role preference - whether they are looking for a voice process, non-voice process, or both.
Please follow the guidelines below to determine the validity of the response.
- Mentioned directly or indirectly their role preference - Voice, Non-Voice, or Both.
- Voluntarily not willing to provide information about their role preference is also considered invalid.
- Simply stating "I don't know" or "I don't remember" without any context is considered invalid.
- Used english language only. Any other language used will be considered invalid.
- Not used any inappropriate language. Any inappropriate language used will be considered invalid.
- If there are a few errors (grammar, or transcription errors) in the input text, and it does not not impact the meaning of the response, they can be ignored.
- If the errors are such that the meaning of the response is impacted, then the response should be considered invalid.
A few examples below:
Example 1
Input
Question: Would you prefer a voice role, non-voice role, or both?
Answer: guess i interested
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": true,
"if_valid": false,
⟩
Reason: "Candidate did not mention their role preference.",
Example 2
Input
Question: Would you prefer a voice role, non-voice role, or both?
Answer: vice profile
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate mentioned that they are interested in a voice profile.",
Example 3
Input
Question: Would you prefer a voice role, non-voice role, or both?
Answer: non-voice
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": false,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": false,
"if_valid": true,
⟩
Reason: "Candidate mentioned that they are interested in a non-voice profile.",
Example 4
Input
Question: Would you prefer a voice role, non-voice role, or both?
Answer: how to respond hello hello can you see me yes
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": true,
"if_request_to_repeat": false,
"if_question": true,
"if_ambiguous": false,
"if_valid": false,
⟩
Reason: "Candidate did not mention their role preference, and asked a question instead.",
Example 5
Input
Question: Would you prefer a voice role, non-voice role, or both?
Answer: I don't want to share
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": true,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": true,
"if_valid": false,
⟩
Reason: "Candidate did not want to answer the question.",
Example 6
Input
Question: Would you prefer a voice role, non-voice role, or both?
Answer: I don't know
Output
⟨
"if_incomprehensible": false,
"if_jailbreak": true,
"if_request_to_repeat": false,
"if_question": false,
"if_ambiguous": true,
"if_valid": false,
⟩
Reason: "Candidate did not know their role preference.",
Input
Interview Question: {question}
Candidate Response: {answer}
Output
