[Discussion] Question about prompt

[avinashsai]

Discussion

Hello,

Congratulations on the amazing work! I have a query about prompts for custom dataset. In the evaluation.md (https://github.com/haotian-liu/LLaVA/blob/main/docs/Evaluation.md) there is an example prompt for multiple choice question. Does this prompt has to be appended to the original prompt:

"A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions. USER: <image>" + "<question> A. <option_1> B. <option_2> C. <option_3> D. <option_4> Answer with the option's letter from the given choices directly."

My task is given an image and list of choices, select the most probable choice. More like a image recognition problem.

[copperwiring]

Hi. Not the code author but what do you mean by original prompt? You can use the prompt you showed above and get the generated token which will be the predicted option.