korrents

korrents · piece

Extrinsic Hallucinations in LLMs

Lilian Weng · 7 Jul 2024 · lilianweng.github.io

2 korrents from this piece

Lilian Weng did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. To avoid hallucination, LLMs need to be (1) factual and (2) acknowledge not knowing the answer when applicable.
  2. These empirical results from Gekhman et al. (2024) point out the risk of using supervised fine-tuning for updating LLMs' knowledge.