here’s that same conversation with a human:
“why is X?” “because y!” “you’re wrong” “then why the hell did you ask me for if you already know the answer?”
What you’re describing will train the network to get the wrong answer and then apologize better. It won’t train it to get the right answer
from their own site:
Alpaca also exhibits several common deficiencies of language models, including hallucination, toxicity, and stereotypes. Hallucination in particular seems to be a common failure mode for Alpaca, even compared to text-davinci-003.