adingbatponder<p>AI question. Say I <a href="https://fosstodon.org/tags/finetune" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>finetune</span></a> <a href="https://fosstodon.org/tags/llama2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama2</span></a> by <a href="https://fosstodon.org/tags/finetuning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>finetuning</span></a> on a text task: </p><p>deciding if a new text contains new information over the original</p><p>and </p><p>label the training sets with: new-information (A) , and no-new-information (not-A)</p><p>how does the <a href="https://fosstodon.org/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> reliably interpret the question: </p><p>Is there new information in this text as compared with the original as uploaded?</p><p>How does a llm make the link to the label given in the training? After all: the labels names could have been just A and not-A ?</p>